g'day Scott
not sure what you mean by blurry, pinhole images are not sharp by normal lens photography standards, however by using some simple maths they can be designed to be as sharp as possible
the maths should take into account the distance from the pinhole to the film plane/sensor (somewhat like focal length)
if you are sometimes using extension tubes and sometimes not, then you are changing the distance from pinhole to sensor (focal length)
an equation i've used to good effect;
d = square root of 2.6x0.00055xfl
where d is the pinhole diameter, 0.00055 is the average wave length of light and fl is focal length
this equation then gives you the optimum size pinhole that will produce the sharpest possible image over that fl, you then divide the fl by the diameter of the pinhole to calculate relative aperture
if i roughly measure the distance from the lens mount to the film plane mark on my Canon 400D the fl is about 50mm so;
d=square root of 2.6x0.00055x50 (all in mm)
d=sr of 0.0715
d=0.267mm
calculate relative aperture;
f=50 divided by 0.267
f=187
hope this helps
Ray