Let $\phi(\mathbf{x},t)$ be a field, and $\pi(\mathbf{x},t)$ be the conjugate momentum field.
A standard practice is to apply the equal time commutation relation: $$[\phi(\mathbf{x_1},t), \pi(\mathbf{x_2},t)] = i\hbar\delta^3(\mathbf{x_1} - \mathbf{x_2}).$$
My question is, why have equal time at all? Why not say:
$$[\phi(\mathbf{x_1},t_1), \pi(\mathbf{x_2},t_2)] = i\hbar\delta^3(\mathbf{x_2} - \mathbf{x_1})\delta(t_2 - t_1)~?$$
What is the fundamental flaw with the above?