Welcome to Photrio.
I'm not sure you are doing anything wrong, but I would caution that these finders and cameras are very demanding on batteries, and if the battery is near to exhaustion, the displays sometimes behave strangely.
A fresh, silver oxide battery is highly recommended.
Also, it is to be remembered that there are electrical contacts in the battery compartment and on the film back, which also need to be kept clean.
Finally, I have one lens that has an aperture selected prong that doesn't always engage automatically with the corresponding pin on the meter (in my case, the version N that came out with the Super). I'd suggest checking that as well.