Yes, but I think it's part of the process of becoming a better photographer. Like loading sheet film backwards, pouring the fix before the developer, etc. Realizing that great photo opportunities are rare takes time (along with a lot of poor images, along the way). The key is to remember the ones that got away, so you don't make the mistake again.
In my case, there's a specific image I think of when I consider skipping a shot. I came very close to not taking it. It was August, on Cape Cod, about 25 years ago. Brutally hot, and I had already lugged my metal monorail 4x5 around for hours. The shin bruising wooden camera case had already taken it's toll, as had the heavy tripod on my shoulder, and my eyes were stinging with sweat. I had just finished (what I thought) was my last shot, and all I could think of was getting home, and an ice cold beer. After I packed up, I saw something else...
My instinct was to say, "screw it", but I set up again, got the shot, and have since sold it dozens of times. At the time, I remembered shots I didn't take. It was those that made me get this one... It's now the photograph I think of when I want to say "screw it".
