I got my hands on a copy of The Art of Computer Programming #2 (Seminumerical Algorithms) and I felt uncomfortable while browsing through it. It resembles my old math books.. on steriods. I was considering buying the trilogy (and getting the 4th volume later on) but now I'm not so sure anymore :(
If vol. 2 is too steep for your taste, start with Concrete Mathematics. It's a nice review of most of the math used in all the volumes. It's also one of the most beautifully typeset textbooks I've ever known.