Yes, the FE should be powered with silver-oxide cells, not common alkaline cells.
From page 6 in the owner’s manual.
“The Nikon FE's built-in exposure meter and the electronic shutter control circuits are powered by two button cell type 1.5V silver-oxide batteries.”
From Google:
“The primary electrical difference between 1.5V alkaline and silver oxide batteries lies in their voltage stability and energy density. Alkaline batteries offer a nominal voltage of 1.5V but experience a voltage drop as they discharge. Silver oxide batteries, on the other hand, maintain a more constant voltage of around 1.55V throughout their lifespan, making them ideal for devices requiring stable power."