If the camera works well with B & W (negatives of good contrast), it should be fine for color film, either C-41or E-6. Consider that a number of APUGers have posted very acceptable color photos in the Gallery which were shot with lenses far older than, and in some cases inferior to, your Yashikor.
Why would you even think that it would be a problem? The Yashica D surely was introduced long after color film was no longer an oddity, or even that much of a specialty item. Even earlier than that, film manufacturers were producing gobs of panchromatic B&W films which would have given inferior results had the cameras not been equipped with lenses that were not apochromatic, or at least achromatic.
Short answer: no problem. If it makes good images with panchromatic B&W film, it will make good images with color film. If you want to maximize contrast with any film, and saturation with color film, use a lens shade and be mindful of the direction of the light. This will greatly reduce flare and give more crisp results.