Spacetime can be modelled using a four-dimensional topological manifold. Say we denote the manifold using $(M, \mathcal{O})$ where $\dim M =d$. The structure $(M,\mathcal{O})$ is not sufficient for talking about a notion of differentiability of a curve on the manifold. We need to make more choices or more information before we can talk about the differentiability.
Now Schuller says (within the first 5 minutes) that for one, two and three-dimensional manifolds we have the only one choice for a notion of differentiability (or rather all the possible choices are equivalent). For five, six, seven and higher dimensional topological manifolds there's a finite number of choices (in each case) for talking about a notion of differentiability. According to chapter 4 of this set of lecture notes, the former is a corollary of Morse-Radon theorems, whereas the latter is a result from surgery theory.
Number of $C^{\infty}$-manifolds one can make out of given $C^0$-manifolds (if any) - up to diffeomorphisms:
\begin{array}{l | c | r } \dim M & \# & \\ \hline 1 & 1 & \text{Morse-Radon theorems} \\ 2 & 1 & \text{Morse-Radon theorems} \\ 3 & 1 & \text{Morse-Radon theorems} \\ 4 & \text{uncountably infinite} & \\ 5 & \text{finite} & \text{surgery theory} \\ 6 & \text{finite} & \text{surgery theory} \\ \vdots & \text{finite} & \text{surgery theory} \end{array}
This chart probably has some exceptions. For instance, @QiaochuYuan points out that:
Donaldson showed that Dolgachev surfaces have countably many smooth structures.
My questions basically are:
Is it simply coincidence that only four-dimensional topological manifolds have infinite choices for talking about a notion of differentiability? Or does this have a physical significance?
Which fundamental postulates of physics would change if say our spacetime were (say) a three-dimensional or a five-dimensional topological manifold with only a finite number of choices for a notion of differentiability?