As far as we know the quarks are not free not because of their fractional charges but because of the independent strong force interaction that grows with distance within the radius of the proton or neutron.
However, a valid observation IMO is also that free elementary particles with fractional charges are not observed so far to be possible.
Can it be that there is a correlation of the strong force with fractional charge and what would this relation be like?