Let me concentrate for a moment in the geodesic equation, since it is an ordinary differential equation and easier to describe. The set of all solutions of the geodesic equation is equivalent to the space of initial conditions of the theory, since an initial coordinate plus an initial momentum completely determine the geodesic and vice versa. So instead of talking about the set of solutions we can talk about the space of initial conditions in other words the phase space of the theory.
Starting from a specific solution which corresponds to a specific point in phase space, we have two cases.
1) The initial point is invariant under a group of symmetries of the Hamiltonian.
2) The initial point is invariant only under a subgroup of the group of symmetries of the Hamiltonian.
The first case corresponds to spontaneously unbroken symmetry of the classical system, while the second to a spontaneously broken symmetry of the system. Spontaneous symmetry breaking is not just a quantum phenomenon, it has a classical counterpart. Moreover, in classical theory, spontaneous symmetry breakdown can occur in finite number of degrees of freedom in contrast to quantum theory where it requires an infinite number of degrees of freedom.
In the following answer, I tried to explain how the above phenomenon is realized in the geodesic equation of a particle in $3$-space on one hand and a particle moving on a sphere on the other hand.
In the first case (free particle in $3D$) an initial condition starting from the origin and having a momentum along the $z$-axis. Both the position and momentum are invariant under the group of rotations about the $z$- axis (a $U(1)$ group). In this case this $U(1)$ symmetry group is not spontaneously broken. In the sphere case, if we choose to start from the south pole then the position is invariant under the group of rotations about the $z$ axis but the momentum is not because it must be tangent to the sphere. Thus this is the case of a spontaneously broken symmetry.
What happens now is that in the first case all points of the geodesic trajectory are invariant under the rotation about the $z$-axis, while in the second case, except for the south and the north pole, the classical trajectory is not invariant under the rotation about the $z$-axis. In the sphere case the rotation group maps a solution (great circle) into another solution.
Now, for the equations expressed as partial differential equations; basically the principle is the same, but the initial conditions are the field configurations on a Cauchy surface. The space of initial conditions is infinite dimensional in this case, but in many cases we can show that it has the properties of a phase space (symplectic or Poisson). In these cases also a a partially invariant initail solution corresponds to spontaneous symmetry breaking, which causes the configurations of almost all times to be non-invariant under the symmetry.