To me this is an issue that really depends on a range of factors, including considerations with regards to not only the situation and subject matter, but also thoughts on format, expected viewing medium, and importantly the audience for the piece.
I have a few notebooks kicking around with thoughts and sketches of photos that I want to take, set pieces with models and props, some even including locations and extra reference photos, and they border on being treated like a painting in many ways. (Expect that I've long since learned that I do not have the time or patience to refine my drawing and painting skills to where I want them, so instead of pencil and brush I'm using cameras.) A few of these shots have literally been years in the making, and may still be years more before I can create a print that I'm happy with. (And I could get the first trial print of some of these ideas, and then can the entire concept to the piece, and I have no idea if that will happen till I can see it in reality.)
Those pieces are very much in rather stark contrast to how I approach most of my sports photography, where I've embraced a rather different style than is suitable to mention here, but there are no second chances for the shot in a sporting event. There might be similar shots, and frequently it is difficult to sort though the vast number of photos one can produce with some of the gear that's been made available in the last decade, but two moments that look similar are still very different moments. In the case of sports I'm shooting for the players, and helping them reinforce their memories of the moment and aid them in promoting their sport. (I almost only shoot roller derby to be honest.)
So you take what looks like a shot when it is in front of you, you position yourself where you expect you can get the best angles before the action happens, and you roll with what the players give you. I experiment to try new things, and generally end up cursing the lighting available, and in several years of photographing the sport I think I've produced maybe two images that I would be happy enough to print for myself. But in this case I'm not doing it for myself, and my opinion on what a 'great photo' is isn't really as important as the opinions of the players and the fans looking at the grainy, sometimes blurry, and badly lit images.
The cheaper and easier it is to take and view a finished photo, then the easier it is to delete it if you see it is utterly terrible at first glance. The cheaper and easier it is to store and hang on to the photo for awhile and come back to look at it later? Well then it gets easier to file the 'maybe' images away.
You can always destroy and image you have later in the future. But it is rather difficult to get it back after you destroy, and even harder if you never took it in the first place.
My core view is: Think before you take a photo, but don't be scared to take what might be a bad photo unless you're absolutely sure it is a bad one.