My guess is that the ND-filter is indeed a 4-stop filter, when the negatives are not way underexposed. In that case it's Kirk made the right analyses.
The underexposure is probably caused by not compensating for the reciprocity factor of your film. Starting with F11 and 1/30, closing down to F22 would give 1/8. Adding a red filter (2.5 stops) would give something like F16.5 at 1/2 sec. Adding the ND filter for 4 stops should give F16.5 at 8 sec, or F22 at 12 sec. This time should be compansated for to about 20 sec. using TMax100.