Go with D-76. It's not the best developer, but it is very tolerant to beginner mistakes, such as incorrect film exposure, temperature, agitation, etc. Also, D-76 has arguably the biggest wealth of development info for different films versus other developers. Until you find your way and what kind of look you really love, do D-76. Use Dektol for paper developer. Also, if you go to FreeStylePhoto.biz, you can get the knockoff version of Kodak Chemicals called "Legacy Pro" which is obviously cheaper. It's the same exact thing, just repackaged under a different brand.
For film, use Arista Premium 400, also available at Freestylephoto.biz. It's repackaged Tri-X. Tri-X will be your all-purpose, extremely tolerant film. Arista Premium is $2 a roll, Tri-X is $4, even though they are the same exact thing. You will inevitably go use some other black and white film, but for beginning film person, Tri-X + D-76 + Internet will give you more information, more resources, and more examples than you'll ever need.
For printing, go with Ilford or Kentmere papers. They are both very consistent and predictable. Not as nice as say, Bergger or Adox papers, but cheaper. You can do Foma papers, but you might risk fogging unless you have a red-safelight.