Well i have a background in some normal calculus, and some Newtonian physics.

So you're probably familiar with basic integrals and derivatives? You probably also want to learn vector calculus as well as differential equations (including Fourier analysis) if you don't know them. That should help you with most classical mechanics and electromagnetism. You might also want to pick up some linear algebra.

A book I've seen used is

*Calculus* by James Stewart. (I was a mathematics and physics double major in college, so my calculus books were much heavier than you'll need for physics, but I used Spivak).

Another good reference book on mathematics is

*Mathematical Methods for Physicists* by Arfken and Weber. I wouldn't try to learn from that book, but it's good to have on hand.

Wolfram MathWorld is another useful resource to look things up.

When you have the mathematics in hand, you can try to tackle something like

*Classical Dynamics of Particles and Systems* by Stephen Thornton or

*Introduction to Electrodynamics* by David Griffiths, both of which are very well-regarded advanced undergraduate textbooks. Griffiths has some sections on special relativity. General relativity is usually a graduate-level course, as it involved much more complicated mathematics.

If those look too advanced for you, then something like Tipler's

*Physics for Scientists and Engineers* or

*Fundamentals of Physics* by Halliday, Resnick and Walker are good introductory books.

With all these books, you don't need the latest edition if you're teaching yourself. You can probably find them used for much cheaper.