The correct answer here is likely to vary depending on your country and institution as what is expected knowledge will change.
The best advice I can give is to have a good understanding of the basic maths. From a UK perspective I would recommend knowing the core A-level Maths pretty well (and preferably further maths too). For US people Wikipedia suggests AP calculus is roughly the same level. There are loads of books covering these topics probably your school notes\textbook will be fine.
From my memory of my physics degree I think the people who struggled most had a poor understanding of the maths paricularly further maths level. Although no knowledge was assumed, everything else is built on this so becomes much harder if you don't understand.
Personally I wouldn't bother with a more Physics related textbook. But this is more personal preference. If you really want something I would look and see if your university has a basic set text and look at this. My university recommended You & Freedman, University Phyiscs, which is decent enough. I think I looked at it less that 5 times during my course though so definitely not essential.