You don't know which sheet is which otherwise, I assume...
So, let's see... Ortho film is sensitive to blue and green. A yellow filter blocks blue but passes green. So, a negative made with ortho film and a yellow filter should have darker blues and lighter greens (assuming that the correct filter factor was applied).
If your "contrastier" negative has darker blue skies (less density in the negative) and/or lighter green foliage (more density in the negative), then it would be the one made with the yellow filter.
Does that correspond to your results?
Best,
Doremus