Since there are so many different environments in the soil,...

Since there are so many different environments in the soil, the likelihood of finding different organisms and different chemistries is high. The world is full of microorganisms that have learned, chemically, how to get along, how to communicate with, how to influence other animals. It might turn out that they're making chemical molecules that turn out to be useful to people.