Mixing fix and toner is fine. The issue I run into is that your fixer will become useless as fix long before your toner will. This tends to waste the selenium toner.
If you need the contrast, there are several ways to increase contrast that involve other methods, such as sulfide toning. The contrast change can be fairly dramatic, but once toned, that is pretty much where the neg will stay.
Bleaching and redeveloping in Pyro, such as PMK, can do a fine job and give that grain masking of the stain.
I have found up to 2 full grades of contrast with sulphide toning and 1/2 to a whole grade with selenium.
YMMV,