Any way to mount a neutral density filter? That might be a relatively easy answer.
I'm actually a little surprised your exposures are that short. But I know on my first foray into pinhole shooting, I had obtained some 400 film and discovered that wanted to be down in the sub-2 second range which was too difficult to time with a manual flap, so I bought some 100 film. (I don't suppose there's any ISO 25 stuff left.)
Two of the last 3 Worldwide Pinhole Photography Days were cloudy, even rainy for me, so that helped draw out my exposures. With films having high reciprocity failure, things get longer fast too. I used Ilford Delta 100
last year, and in a wooded setting, some exposures ran out into the 40 to 60 second range. I admit a wild reciprocity curve does add complexity -- or at least reduces the intuitive determination of exposure.
I should add, my efforts were with a 4x5 using about 160 mm or so pinhole to film and a Bronica body cap adapter at about 90 mm -- maybe that shrinks the optimum pinhole size -- I was up around f250 or so.
My 2 cents,
DaveT