Take a look at the M4-P body - they can be found in good user condition for $700ish, twice that for a mint LNIB example. An M6 classic (non-TTL) would also be a good body to consider. The 0.72 viewfinder is a good all-around choice, although some who wear glasses prefer the 0.58 viewfinder.
As far as lenses, look at the Summicron 50mm and 35mm - they offer fantastic performance at decent prices with an f/2 maximum aperture.
Also consider the 28mm f/2.8 Elmarit for a wide angle lens.
For a budget 50, look at the 50mm f/2.8 Elmar. I recently saw one in near mint condition priced at $575.
here are some places to shop -
www.sherrykrauter.com
www.camerawest.com
Also, talk to Ken Hansen - his email is
khpny19@aol.com
If you look hard enough, you can get started in the world of Leica for in the $1000 to $2000 price range for one body and one lens. Of course, a $1000 camera & lens will be used with alot of cosmetic wear (a "user" camera) - but it's a place to start.
A user Leica still beats the pants off of any other 35mm rangefinder - or SLR, for that matter (JMHO).