Having a 35mm on you always is better than having not any camera due to weight and inconvenience - especially in terms of medium format cameras. However, if you want to stick to medium format only, you can get a folder camera. But they aren't that good if you like to do quick snaps. Please use your 35mm gears. You'll be able to carry and shoot more frequently with it.
Bests,
Ashfaque
ahh, the 35mm vs medium format debate. Maybe only bested by the plastic vs stainless dev tank debate

You're right about the hassy. I'm starting to save up for a view camera, and a good backpack for it!