For any quantity $x$ there are an unlimited number of related quantities like $y=1/x$ and $z=1/(x-3)^2$ and so on that have infinities in different places. When $x=\infty$, $y=0$. When $x=3$, $z=\infty$, and so on. So finding a particular quantity $x$ in an equation being infinite may just mean that it is more appropriate to talk about $1/x$.
There is a particularly famous example in black hole physics: the Schwarzschild singularity at the event horizon. When Schwarzschild first solved Einstein's equation to find the gravitational field of a point mass in a vacuum, there was a radius at which the expression went to infinity.
Schwarzschild's solution looked like this:
$$ds^2=\left(1-{2Gm\over c^2 r}\right)c^2 dt^2-{1\over 1-{2Gm\over c^2 r}}dr^2-r^2 d\theta^2-r^2\sin^2\theta \ d\phi^2$$
The part in the middle ${1\over 1-{2Gm\over c^2 r}}$ goes to infinity when $r={2GM\over c^2}$.
For a long time, people thought this meant the physics became meaningless and invalid at the event horizon. However, it later transpired that this was just an artifact of the coordinate system used. It's like the way the latitude and longitude coordinates go crazy at the north and south poles. Nothing strange or unphysical actually happens there - the sphere looks the same at the north pole as everywhere else. It's just the coordinate system that doesn't work there. Just as there are other coordinate systems where the north pole on Earth looks normal, so there are coordinate systems where the event horizon of a black hole looks normal and unremarkable.
The singularity at the centre of a black hole, however, cannot be removed by any coordinate change. Spacetime 'forms a sharp point' there, like pressing into a rubber sheet with a sharp pencil. If you look at any other portion of spacetime and magnify it sufficiently, it always starts to look like a tiny microscopic patch of flat space, in which we can use flat-space physics to predict what will happen. Surfaces with this property everywhere are called "manifolds". However, if you magnify the space around the pointy singularity, it never flattens out - it looks pointy at every scale. Spacetime is no longer a manifold, as general relativity assumes. This means we can never apply our well-understood flat-space physics.
In a manifold, there are $360^\circ$ around any point (thinking two-dimensionally). But at the point of a cone there are less, and as the point gets sharper, the range of angles around it approaches zero. In addition, the time axis points inwards towards the singularity, so it is the future for every possible path. Nobody has any idea what to do with that, or what physics would look like in such strange circumstances. What effect does having less than $360^\circ$ around a point have on sub-atomic physics? If a particle is spinning, does it go round faster, or does it try to overlap itself, or what? Since we don't know how elementary particles work at that scale, anyway, we can't even guess.
(I'm simplifying hugely, of course. I'm just trying to give a vague intuitive impression of the sort of problem it poses.)
Saying that the curvature goes to infinity and thus becomes nonsensical is a simplification, to avoid having to talk about the real issues. Curvature going to infinity just means 1/curvature goes to zero, and if you can explain your physics using 1/curvature instead, maybe nothing will go wrong. In the case of the Schwarzschild black hole's central singularity, the problem is that all the matter gets packed into an ever smaller space, the energy density increases without limit, and we just don't know what happens at energies far higher than those we have explored experimentally. (Like, $10^{1,000,000}$ times higher is still tiny compared to infinity!) Do the known rules of physics still apply? Almost certainly not, but nobody knows what to replace them with.
weary
should bewary
– mowwwalker Mar 18 '21 at 20:03