but what produces blue colour in the print?
Generally cyan + magenta.
I can't see any combination of green, red and yellow producing blue
Well, for starters, RGB stands for Red Green Blue, so there's your blue.
Anyway, as we've established, RGB's not what's used in the print if you use RGB filters to make in-camera separateions. RGB filters during exposure = CMY pigments during printing.
Nevertheless, if you look at the work of Katayoun (see eg.
here) you'll notice that the magenta is in fact quite red and the cyan is kind of muted, and so is the yellow. By today's standards, we might not considered that a 'proper' CMY pigment set. Still, it produced a wide gamut of hues - just not as wide as in the case where higher-chroma pigments would have been used.
If you think about this a little more, you'll realize that there's a 'tuning' that needs to take place between the transmission spectrum of the RGB taking filters and the reflectance spectra of the CMY pigments. In practice, this perfect fit would not have been the case in early work relying on in-camera separations; the cyan would not have been the perfect complement to red, etc. This creates particularities in how hues are rendered, and it's the reason why Katayoun spent so much time trying to figure out which pigments would have been used for 1930s Vivex prints - with modern pigments, she realized she didn't get the colors Yevonde created her work for/with!
If you want to understand better how mixing pigments works, I can recommend reading Bruce MacEvoy's excellent website on the topic. It's written for watercolorists, but the general principles apply to any form of color printmaking just the same. Start e.g. here:
https://handprint.com/HP/WCL/color14.html
You'll notice that in a way, you could start with any set of pigments to mix your way towards a full gamut. There are benefits and drawbacks to whatever combination you'd choose. Note that this is also true for CMY, which is relatively poor at rendering orange, green and violet. The main reason we don't see it that way (literally) much of the time is that human vision adjusts quite flexibly to the gamut we're being offered. Only if we have a reference at hand that's more saturated, we'll notice the difference. Note also that the magenta's we generally use in (commercial) printing are in fact quite red, and the cyans are often quite blue (but not always). They're not fixed points on the color circle!
And yes, you
could in fact make a workable palette using red, green and blue pigments. The 'saturation cost' (see MacEvoy's website) will be in the secondaries; i.e. it'll poorly render yellows, magentas and cyans. Of course, the separation negatives would have to be tailored towards this uncommon approach. How successful the palette would work, would depend on the mixing behavior of the pigments involved, which in turn relies heavily on their absorption spectra and transparency. It seems that only fairly recently, suitable pigments in the green, violet and orange ranges of the spectrum have become commonplace and hence, they are now being widely used in digital printing (think of expanded gamut CMYKOGV printing). Historically, to the best of my knowledge, green has always been a difficult color in terms of pigments with a relative lack of them altogether, while oranges tend to be low in chroma and violets are often both low in chroma and not particularly lightfast (I'm taking big & sloppy strides through a large landscape here, mind you).
just in reproducing the effects early users would have achieved.
They would have been all over the place, so I'd feel comfortable suggesting to just experiment happily away!