I use a mix of brands (including Kalt) and I haven't really had any fuzz issues but I usually either blow cassettes out with compressed air or use light-tack masking tape to get extra crud out of the felt traps before I reload them. I use the masking tape like a lint roller, just wrapping some around my finger, sticky side out, and lightly pressing the velvet light trap.
One thing I've noticed is that the old Kodak Snap Cap cassettes - still readily available NIB on Ebay if you're patient - have better build quality overall and that includes the light traps. Harder to find are old Ilford cassettes, which you'll only find used (Ebay again) and which are built like tanks. They also have very sturdy traps. Even harder to find are old Ansco cassettes, also built like tanks.
The modern (I assume Chinese-made) no-name metal cassettes from the auction site or Freestyle aren't as sturdy as the old ones I listed and their light traps aren't as robust but they do work fine as long as your cassette hygiene* is good and I haven't had any real problems with them. They just don't feel as butch as the old ones.
*I just made up 'cassette hygiene'. I gotta remember that and add it to my list of techno jargon!