Selenium is a nasty chemical. It kills livestock, fish and birds. The line between needed levels of selenium and toxic levels is a narrow one. Found in the soil in various amounts, livestock die from eating the grass grown on soil containing high selenium levels, and human intervention in the movement of water can concentrate the selenium in the environment. Don't fear it, but respect it.
Filter feeders concentrate contaminates in the water. In Puget Sound, I suppose one should be able to get drugs and vitamins supplements galore by eating the shellfish. Prescribed (and street) drugs going thru the sewer system far exceed the amout of selenium!