I have a Holga FN 120, or something like that, and it is fun, but I personally am having a whole lot more fun building pinhole cameras and using old print paper. I bought a set of pinholes from some outfit online, Pinhole Resource I believe, and I am using those. I just go out to the garage, cut up some plywood or whatever is handy, and nail it together, except the back. I spray paint the inside flat black. Then I take the Frankencamera into my darkroom and tape a piece of photo paper cut close to the size onto the backboard. I then tape the backboard to the camera with some duct tape. A quick aperture calculation and I can determine a shutter speed based on the estimated speed of the paper. (What I have been using lately seems to be about 2 ISO.)
I use a piece of electrical tape as a shutter (tough to repair but easy to replace) and go outdoors with a stopwatch and take a picture. It can be hard to tell what you will end up with though I am getting better at it.
Obviously there is a little more to it but it isn't really rocket science. Of course, if you aren't in to the building process you can buy one. That is what I did to start, picked up an Ilford Obscura. It came pre-built with directions and a box of Delta 100 sheet film, a box of Ilford MGIV print paper (I think), and a box of Ilford Direct Positive paper. All for about $75. I think the camera was actually free. I still use it but once I got started I wanted to go bigger, lots bigger.
Anyway, you can have tons of fun and not have to buy any plastic cameras at all. Or lenses, or much of anything traditional. I can use old, expired, boxes of paper, scan the results if I don't exceed my flat bed size, and work with the result in Photoshop. Or I can take the results, let my granddaughter paint on them a bit, and take them to Art in the Park in the summer and sell them to buy more expired paper.
Just think, I am now a successful artist with sales to match using nothing but expired photo paper, a big, homemade, wooden box, some duct tape, a couple or three pieces of electrical tape, and $49 dollars worth of pinholes from Pinhole Resource. Oh yeah, a granddaughter with water paints (she gets paid before I do. She prefers Tootsie Rolls.) Before I was a struggling photographer with a Deardorff V8 unsuccessfully trying to sell anything to help pay for film and paper, not too mention the camera, tripod and all the other goodies I thought I needed! Now I don't even need a tripod. I just use duct tape to strap my box to a wooden stool my daughter used to use to step to the sink and wash dishes. (I get my duct tape by the case from Harbor Freight.)
EDIT - My next camera is a refrigerator box stiffened with (guess what) and painted inside flat black using a worn out paint roller. I have another, much thinner box, that slides inside for the paper/film. I'll even be able to vary the focal length, kind of like a zoom lens! I will probably need some really big photo paper for this one. And probably another stool.