You have to be able to focus your chosen focus aid (ground glass, rangefinder spot, split-image, microprism, etc.).
This may mean custom prescription glasses, special diopters in the camera focus, etc. If you can do that without contacts, fine. Though I can't imagine you want to swap contacts out very often, so presumably you would use glasses.
Where things get difficult is if your eyesight needs significant correction for astigmatism or another issue that a simple diopter will not manage. I have to use some form of prescription glasses for close work, so I use flip up magnifiers with large format cameras.
I find SLRs next to impossible without using my 'computer' prescription which lets me focus around 3 feet. My regular and reading prescriptions are too far off.
You might fine gentle reading glasses in front of your contacts work if you just need to get a little closer. using a 35mm SLR with glasses can be awkward because you cannot get your eye as close to the eyepiece, but it is doable.