...try to pick a single B&W film and developer combination to start off with [and stick with it for a while]...
And it is best to pick one that is trouble free and performs well. For every strange combination there is someone who will swear by it - and many more who will swear at it.
Kodak TMax (or Ilford Delta) film - 100 ASA for 35mm, 400 for 120 - and Kodak D-76 (or Ilford ID-11) developer will always yield high-quality results. For this reason (and for reasons I don't understand) many people will recommend you use anything but.
There are hundreds of posts declaiming East Block and private label films and odd developers. And even more pleading for help with pinholes, dust, scratches, curling, static, strange tonal renderings, streaks, drags, mysterious blobs and complete failure. Your time and effort in taking the picture are more valuable than any few dollars you may save with off-brand materials.
On the subject of tanks - I'm firmly in the stainless steel camp. A good tank and reel will last you a lifetime - I still use ones I bought close on 50 years ago. Hewes make the best reels by a very wide margin. Nikor USA made the best tanks.
You can set up anywhere. Most people start at the kitchen sink. A closet is all that you need for loading the tank. A pyrex graduate is adequate for mixing chemistry, and a set of liter pop bottles are as good as anything for storing it. Digital kitchen thermometers are cheap and reliable - you don't need accuracy for B&W as much as repeatability. You can often pick up a complete 'kit' on ebay or craigslist. A 'wanted' advertisement in the local paper should bring lots of offers to 'come over and take it away' from digerati, ex-wives and estate executors.
Aside from developer you will need fixer (any brand will work), stop bath (1/2 white vinegar, 1/2 water works fine) and Photo-Flo.
As John mentioned, there is a good tutorial on the Ilford web site.