What is the problem with brick buildings? Never heard of bricks being radioactive.
Read this:
https://doris.bfs.de/jspui/bitstream/urn:nbn:de:0221-201210099810/3/BfS_2012_SW_14_12.pdf
"Due to their geological origin, all raw materials used in the manufacture of building materials contain a certain amount of natural radioactivity, especially from Potassium-40 and the radionuclides of Uranium-238 and the Thorium-232 decay series. These radionuclides cause during the stay in buildings a radiation exposure of humans."
But of course if you stay in a brick building with a thoriated lens and a Geiger-counter, the counting effect with and without such lens near the meter can be frightening.
I should add that just the lens itself can have a barrier effect, depending where the respective lens element is located. So you might read a max. value at one end and a min. value at the other, even down to room level.
Measurement of radioactivity is a tricky thing, so take any DIY metering with a grain of salt.