Newton's second law states $\vec F \propto \vec a$. The proportionality constant is defined as the mass ($m$) of the particle on which the force ($\vec F$) is acting and whose acceleration ($\vec a$) is being measured. Therefore, a definition such as $\vec F = m^2 \vec a$ would be consistent with Newton's second law.
what problem will "$\vec F = m^2 \vec a$" cause in the formulation of mechanics. What about a multi-particle system.