Note: Throughout the answer, I am treating the scenario from the point of view of Newtonian gravity.
Uniform solid sphere
The force function of a uniform sphere is continuous. Thus, the force never changes abruptly. Below is the graph between gravity and the distance from the sphere's center:

Image source
As you can see, the function is a continuous one, and doesn't change it's value suddenly when you cross the surface.
Uniform spherical shell
However, in case of a uniform spherical shell, you will get to see a discontinuous force vs distance graph, something like this:

Image source
Here, the value of gravitational field/force inside the shell is zero, whereas just outside the shell, it's non-zero. This results in an abrupt change in force.
Physical feasibility
This discontinuity of a vector field is not at all unphysical or infeasible. There's nothing wrong to have an abrupt change in a force field. However, if a field has a potential associated to it (in other words, if the field is conservative), then the potential must be continuous. Because a conservative field is defined as the negative of the gradient of potential, and the gradient of the potential cannot be defined if the gradient is discontinuous. So, for a field to exist everywhere, it's potential must be continuous. The field doesn't need to satisfy continuity.