Yep, happens to me all the time. No camera, the shots are everywhere. Camera at the ready, not much happening. Even though I'm giving photography a break, I still need to carry something, because we know what happens when you don't.
I cannot stoop to carrying a digital P&S (or a digital anything), so my hacked Nikon FG w/ non A.I. H 50 lens will give me the quality and the small size. A light little rangefinder like a Konica C35 initially sounded good, but you can't do closeups w/ those. When it rains, I like shooting the water on plants and stuff.