The combination gets pretty complex and is usually not uniform. There is silver, as described above, and gelatin, and water, and air, with all its components and contaminants. There are also usually some residual processing chemicals, but hopefully not much of any of them. The paper also influences the environment, and it is usually coated with some chemicals. It's the residual chemicals and stuff from the air that diffuse through the gelatine to attack the silver. If you tone the print, the toner partially converts the silver to some colored material. For the common sulfide and selenium toners, that material is silver sulfide and silver selenide, which are more stable than silver metal. For gold toners, metallic gold is plated out onto the silver. Other toners convert the silver to less stable colored materials. Of course, the toners also leave behind some residual materials that mostly get washed out.