I just began studying electrostatics in university, and I didn't understand completely why the electric potential due to a conducting sphere is
$$ V(\vec{r})=\begin{cases} \dfrac{1}{4\pi\epsilon_0}\dfrac{Q}{R}, & \text{if $r \le R$}.\\ \\ \dfrac{1}{4\pi\epsilon_0}\dfrac{Q}{r}, & \text{if $r \gt R$}. \end{cases} $$
Where Q is the total charge and R is the radius of the sphere (the sphere is located at the origin).
I only understand the second part of this equation (when $r > R$).
I know Gauss Law. know the charges go to the surface. I know the electric field strictly inside it must be zero. (I also know the electric field is not defined for a point that lies exactly in the surface). And I know $\vec{E} = -\nabla{V}$.
Therefore, I know the electric potiential inside the sphere must be constant. Let $C$ be this constant.
It seems that
$$ C = \lim_{r \to R^+} V(r) = \dfrac{1}{4\pi\epsilon_0}\dfrac{Q}{R} $$
But why is this true? My textbook says: because the electric potential must be a continuous function. But why? I am hoping for a non-experimental reason.
Please be precise when mentioning $r<R$ or $r\le R$. Those are different and I get easily confused when people misuse those.