I think that's a reasonable guess. I'd add one more thought to it: photon energy. This correlates with wavelength and blue photos are thus less energetic than ones in the UV bands. There may be a threshold energy required to bump the stray electrons back into place and allow the matrix to relax. This likely depends on the material and perhaps on the type of F-center. I fed the question into AI (sketchy, of course) and it comes up with a range of 2.5-3.5eV, which encompasses the longer UVA wavelengths and the blue spectrum. It also alleges that UV is more efficient; this seems to make sense when taken at face value given the higher energy involved, which would make it more likely that an exposure event has the desired effect. I think it's a reasonable assumption that UV will work better, but that blue might get the job done provided sufficient exposure is given.
Yes, energy has to matter because if a photon isn't energetic enough it won't kick whatever is causing the defect over the energy barrier to put it back into place. I remain a little skeptical that the effect is exactly analogous to F-centers (electrons sitting in an atom's spot) in crystals, because glasses aren't crystals but amorphous solids, and so have a much less regular structure even at the atomic scale.
This is possibly relevant because I suspect the irregular nature of the solid makes the defect energy a less well defined quantity. In other words, for some types of solid-state phenomena, there's a fairly strict excitation energy and a photon below that energy just isn't going to do anything. (A similar-but-different example is the band gap in semiconductors. Which is tangentially why you can't use a silicon CCD to detect near-infrared photons, they aren't energetic enough.) For crystals, if you displace a single atom from one lattice location or another, the energy should be about the same since the periodic structure is the same. But for glasses, the energy might be different between two locations, since even the surrounding short range structure is different. However, higher energy photons will definitely be more likely to have an effect: UV beats blue, and who knows if redder light is energetic enough.
Anyway, that's hand-waving. A little bit of web searching suggests that the glass transition is not as easily modeled as crystalline structure. I got more specific and found (by googling eg "activation energy of defects in silicate glass"), this article: https://www.sciencedirect.com/science/article/abs/pii/S0168583X98008842
"Activation energy spectra for annealing of ion irradiation defects in silica glasses" which seems topical. I can't read the whole thing (possibly when I get back to the office). They cite defect energies of 0.26-1.85 eV in alkali-borosilicate glasses, which are at least similar to optical glasses. I believe the radiation intensity used to create the defects was much much higher than the kind of self-irradiation familiar in thorium glasses.
