Olympus made a few f/5 lenses, which must have been even more difficult to use with the microprism or split image.
As the prior poster said, you must center your eye perfectly so that both halves are clear.
BTW, there are many 80-200 zooms out there that are faster than f/4.5 (and thus easier to focus).
My collimator-tests show that the following lenses are sharp wide open:
Kiron 80-200/4
Zuiko 75-150/4
Tamron 70-210/3.8-4
Tamron 70-210/3.5
Vivitar Series-1 70-210/3.5
Mark Overton