There are ways to quantify this. The accuracy of a rangefinder is set by: the baseline of the rangefinder, its magnification, and the minimum angle your eye can resolve. For example, suppose you have a rangefinder with baseline 50mm and finder magnification 0.7x, and your eye can resolve an angle difference of 1 arcminute (which is 1/3438 of a radian). Think of a triangle where the short side is the effective baseline of the RF (baseline*mag), the two long sides are the distance from the object to the RF windows, and the tiny opening angle is 1 arcminute. Thus, the maximum useful distance of the rangefinder is D:
D = baseline * finder mag / minimum_angle = 50mm * 0.7 / (1/3438) = 120 meters.
So for these numbers, which are about right for a typical rangefinder camera or small aux rangefinder, 120 meters or about 400 feet is the farthest distance you could hope to resolve; any further and it might as well be infinity. There is probably a slop of a factor 2 in here depending on your vision and other details (compact RFs have smaller baselines and finder mag, etc), but essentially, a city block is about enough; 100 feet is too close to be infinity.
It's also possible to figure out how accurate the RF needs to be to focus a lens, using the required extension and depth of focus; this depends strongly on focal length, it goes as focal length squared. Which is why most RF systems max out around the equivalent of 135mm on 35mm format.