Josh,
I have a ML350 G6 with two processors and 4 fans and they are running at 13%. How many processors do you have? Did both come installed or you installed the second proc later?
I'm asking because, this unit has 4 different configurations, some of them for 1 Proc come with a small Baffle, some of them require a large Baffle. Open the hood and look at the label.
Also, check in the BIOS under Advanced Options->Thermal Configuration. Mine is set to "Optimal Cooling".