Would you generalize..."at Carrefour or Carrefour Market, but not Carrefour City or Carrefour Express" ?
I would certainly suggest to just skip the Express and City locations, yes.
The most straightforward way IMO would be to just go on Google Maps and tap some locations of these supermarkets, and then select one that looks decently sized, with its own parking lot, etc. I just had a quick peek and pretty much none of the supermarkets in the city proper look like they'll have much in the way of batteries etc. They'll carry AA's and AAA's and some button cells, and that'll be it, for the most part.
I'd suggest taking up on
@Daniela's advice and seeking out the nearest FNAC.
Alternatively, look for actual camera stores; a few of them are still around. E.g.
https://www.antiq-photo.com/ or
https://photosuffren.com/ Even if they don't have these batteries, they'll likely be able to pinpoint
@Sirius Glass into the right direction. Sirius' command of French will surely help.