A light source can emit single photons or radiate many photons, a light source can emit in a confined direction (laser, flashlight) or many directions (bulb). Photons are best considered as being waves in the EM field and the EM field can handle many many photons due to superposition of waves .... but energy is never lost in the medium (EM field).
Only electron activity puts waves (photons) in the EM field as quanta (one at a time), only electrons (in atoms) eventually absorb photons (as quanta) .... there are likely many photons in space that are travelling energy in the EM field that will never get absorbed.
Nobody knows what a photon actually does in space, we can only absorb them to observe. We can also generate, for example we can bounce a laser off the moon. Based on c and the time taken we determine they travel in a straight line.
An excited electron in an atom (even before real photon emission) is already interacting with the EM field (virtually, forces only) ... thus we can say it is considering all directions .... but it does not mean the real the photon is traveling all paths .... the EM field with the electron considers all paths. The real photon direction likely results from the EM field/electron interaction. In a laser cavity we heavily confine the EM field ... which gives the eventual photons a confined direction.
Maxwell proved that the E field and the M field were tied together and proposed that light was a unified concept of E and M, he also derived a propagation equation for light which would support straight line travel of a confined wave packet .... this accomplishment is as astounding as Einstein's E=mc^2.
So swerving is not likely ..... but since we can't observe the EM field directly we will never know .... we can only observe energy coming out of the EM field as quanta/photons.