Very simply explanation but in terms of waves, the light is emitted in most angles, but the superposition of all of the corresponding waves means that only one results(most of the time). Look up Fresnel equations, it’s actually more complex then you'd think. For example for a given polarisation there's an angle where no light is reflected at all, but the same angle on a different polarisation there is reflection. Also e.g refraction, you'd mostly assume there is only 1 " beam" of light with a single direction..Yet there is something called bi-refringence that splits up the light into 2 beams causing a double image( for unpolarised light)
comment:Obviously to understand refraction and reflection for different materials, different frequency and polarisation of light, requires ALOT and I mean ALOT of math, and alot of concepts such as electromagnetic polarisation density and its relation to permitivity(modelling as harmonic oscillator e.g), EM boundary conditions, solving maxwell's equations, Deriving Fresnel relations. But the key thing is this, When an electromagnetic wave in incident at a material, the Em wave that is made of an electric and magnetic field exerts a force on the charge configurations inside materials, causing those charges to be accelerated. these charges produce EM waves due to this acceleration, and the SUM of all of those waves ( superposition) make up the light that we see as being " reflected or refracted" the math shows what the SUM of the waves look like. reflection of light isn't even the same light, it's different light that is produced by the accelerated charged inside the material