This is a philosophical physics question which came to me when I was calculating diffraction-limited focal spots during my PhD.
When discussing diffraction, most textbooks (such as Hecht's Optics or Wikipedia) begin with Maxwell's equations, for example:
$$\nabla \times\vec{E}=-\frac{\partial \vec{B}}{\partial t} \tag{1}$$
They then derive the wave equation and go on through the Huygens principle and the Kirchhoff integral and may finally end up at Fraunhofer diffraction arriving at something like the following formula:
$$\tilde{E}(\tilde{x})=\int_{-\infty}^{\infty}E(x)\exp(ikx\tilde{x}/D)dx \tag{2}$$
My question is basically: what is the meaning of the complex variable $E$ in Equation (2)? Let me explain. Hecht is pretty clear that this is the same as the electric field in Equation (1) (it stayed this way all the way through the derivation) and that the observed intensity is the modulus-squared of some rapidly oscillating electric field. The fact that the electric field $q\vec{E}=\vec{F}$ is complex is thought of merely as a mathematical tool - though it is not clear what the mathematical relation is to the good old real-valued DC field.
Edit2: Note that $E$ in Equation (2) is truly complex valued. If I had given the same equation in the Fresnel limit, for example, a perfect thin lens at the slit would not change the amplitude, but would introduce a phase of the form $\exp(ikx^2/f)$. So $E$ is not in general real.
Maxwell's equations are certainly the last word in classical electrodynamics. And everyone has done single- and double-slit experiments to verify the eventual result of Equation (2) as far back as highschool, perhaps by shining a laser through some slits. The fact that a continuous electric field interferes to create minima and maxima seems sensible.
However, we also know that this idea of a continuous electric field is misleading: the diffracting light consists of billions of photons. We could just as easily perform the experiment sending photons through slits at a rate of 1/minute. Then, there is no way that two successive photons could interfere with each other. In that case, if we had a CCD for example, rather than seeing a smooth intensity profile increasing in intensity with each new photon, we would see a grainy picture emerge as each photon stikes a particular pixel on the CCD. Only after a statistically significant number of photons would we begin to approximate the smooth e.g. $\mathrm{sinc}(\tilde{x})$ function.
One explanation is clear: the complex-valued variable in Equation (2) whose modulus-squared we must take is not the electric field, but something like the wavefunction (or a relativistic equivalent). This would explain the paragraph above and allow the electric field to be real. But then, why does it emerge directly from Maxwell's equation, like Hecht insists the electric field has? Clearly Equations (1) and (2) make very accurate experimental predictions, but how are they reconciled with quantum field theory?
Edit: How is an electric field reconciled with e.g. electron diffraction, which can form an identically "grainy" distribution?
By the way, after many debates with research physicists, the best answer I've heard so far is: "Well, I'm a physicist, so ultimately everything is a field theory"
My question is how quantum field theory and the diffraction of particles - photons, electrons, etc - can be reconciled philosophically with Maxwell's equations of classical electrodynamics.
– Valentin Aslanyan Mar 07 '17 at 19:21