Haha, I love that. My least favorite thing about this hobby is the tendency towards consumerism. Bags, tripods, lenses, filters, light sources, etc... So I like your style, Matt.
There is another, more important reason for using dipper bags, and that is for your Security.
Camera bags being snatched is no new phenomenon, years ago, I read an article that advised carrying a dipper bag, in stead of a street kit or while traveling, so at first glance, you seem to be on an afternoon of errands with a baby, in the care of someone near-by.
This is an area where you should pay attention to your own safety and those that are with you, say a model on a walk and shoot... anywhere.
I've used heavy fabric shopping bags, to carry 'light' and I may do so again, depending on where I'm at, going or other factors photographers should be aware of.
My favorite non-camera bag for many years was my old Army flight helmet bag, from tthe 1970's. Zipper top, handles only, padded and difficult to see the shape of what's inside, it went everywhere with me, until one of the handles tore from normal, long term use.
I now carry it for other small items, including some point and shoot or rangefinder, but unless I come across another good helmet bag, dipper bags and packs will have to do for casual, non-camera bag kit.