I don't imagine it would be a good idea. I personally don't freeze my film, but do refridgerate it, and even then I allow a good couple of hours to warm up to ambient. Although I can't confirm it, I would imagine that the main problem would be condensation, especially if the ambient is quite warm/humid, just like the beer bottle when you first take it out of the 'fridge. The common consensus is to allow plenty of time for the film to return to room temp before loading it into cassettes or the camera. Those moe enlightened Apuggers may know more reasons than I have listed.
Tony