There is some discussion about this Here. If an isolated system of particles under gravitational force is allowed to decrease its energy by means such as inelastic collision, then eventually all particles will end up on the same plane. Reasons for that are already explained in many other posts, but NONE of them includes any mathematical formulation and quantitative analysis.
But HERE, I am looking for a mathematical formulation of such a system. Here is what I have tried. DO NOT complain that I have made ridiculous assumptions: I know what's actually happening with the solar system, but to model it with math, I have to simplify it, because I am unable to come up with better models.
Let there be $N$ particles with positions $\mathbf x_k$ and mass $m_k$. When particles $i,j$ collide, if they stick together, they lost some kinetic energy. The amount of energy lost is $$ \frac{1}{2} (m_i\dot{\mathbf x}_i^2+m_j\dot{\mathbf x}_j^2)-\frac{1}{2}(m_i+m_j)\left(\frac{m_i\dot{\mathbf x}_i+m_j\dot{\mathbf x}_j}{m_i+m_j}\right)^2\\ =\frac{m_im_j(\dot{\mathbf x}_i^2+\dot{\mathbf x}_j^2-2\dot{\mathbf x}_j\cdot \dot{\mathbf x}_i)}{2(m_i+m_j)}=\frac{m_im_j|\dot{\mathbf x}_i-\dot{\mathbf x}_j|^2}{2(m_i+m_j)}. $$
So I get an idea of how much energy is lost. However, I can't see why this makes the planets closer to a plane.
If I use this collision model, can I prove that eventually, after many collisions, all particles will be very "close" to a plane? I know that the plane should be perpendicular to the angular momentum vector, but how can I express the notion of "close" with formulae.
Is there a better model to help me predict how much time elapses before all particles are sufficiently close to the plane? i.e. $\mathbf x_k\cdot \mathbf J<\epsilon$ for some small $\epsilon$ we choose. $\mathbf J$ is angular momentum.
I am an ESL learner, so please ask me to clarify things if there are any errors.