It's all relative. Simply put, a Holga is the least expensive new medium format camera you can buy. It's probably less expensive than most used MF equipment. In fact, it's probably one of the cheapest cameras you can buy, period. You can blow as much as maybe $10 on a disposable, does $25 for a reusable MF camera seem like that much more? Think of all the ways you can blow $25 these days - a cheap meal, even going for coffee with a few friends, it's remarbkably easy to spend $25 on what seems like nothing. Then think about spending $25 on a remarkable little camera that has converted so many to film, brought so many others back to film, and has the potential to make you very happy with some unique, interesting and remarkable images.
You say it's too expensive, I say it's a bargain.