Analysis of algorithms is really all math. How heavily do you want to get into the topic? The math is usually straight forward, but it uses calculus heavily. If you don't understand calculus, its going to appear opaque.
For years, Stanford University used Donald Knuth's Concrete Mathematics as a prerequisite for analysis of algorithms. Any university bookstore will have the textbook that their CS classes use for analysis of algorithms. Its a fairly advanced topic, typically junior or senior year for undergrads, or first year of grad school.