You can do the integral with Coulomb's law directly. More intuitively, you can consider that as you get closer, the different charge elements give a larger electric field, but they to be more parallel to the charged plane, and that component is cancelled out by the charge element on that opposite side.
The integral:
$$\vec E=\int \frac{k~dq}{r^2}\hat r=k\sigma \int\frac{dA}{r^2}\hat r $$
By symmetry, we can argue that the electric field will be perpendicular to the plane. I'll call that the $\hat z$ direction. Then we can find just the z component:
$$E_z=\vec E\cdot\hat r=k\sigma\int\frac{dA}{r^2}\hat r \cdot \hat z$$
This is best considered in cylindrical coordinates. If the point we're looking at is $d$ away from the plane, and $\rho$ is the distance from the point parallel to the plane, this comes out to:
$$ E_z=k\sigma\int\frac{dA}{r^2}\frac{d}{r}=k\sigma d\int_0^\infty\frac{2\pi\rho ~d\rho}{(\rho^2+d^2)^\left(\frac{3}{2}\right)}$$
Integration by u-substitution with $u=\rho^2+d^2$, $du=2\rho~d\rho$:
$$E_z=k\sigma\pi d\int_{d^2}^\infty \frac{du}{u^{\frac{3}{2}}}=k\sigma \pi d\left(\frac{2}{\sqrt{u}}\Big|_{d^2}^\infty\right)=2k\sigma\pi $$
Or in terms of $\epsilon_0$ instead of $k$: $$E_z=\frac{\sigma\epsilon_0}{2}$$