NO! You don't need much math, depending on the science. Psychology you need intro statistics, and calculus...and pretty much those same math requirements for all the sciences. The difference at my school is how many physics, chem, bio courses you need to take.
Physics might need more math, though. Yes, much more. Two years of it, about.
Calculus is easy. Really. Just make sure you find a really good teacher. Seriously. The only reason I got an A in calculus is because my professor made me feel like I could and should.