I seem to be misunderstanding the definition of gauge or symmetry transformations. Given a lagrangian, a gauge transformation is defined to be a continuous transformation such that $$ \delta \mathcal{L} = \partial_\mu A^ \mu$$ where $A^{\mu}$, I assume, is zero at the boundaries. Now, in deriving the conserved current, we assume that the field $\phi$ is "on-shell". This means that $\phi$ is a stationary solution. So any infinitesimal variation $\phi' = \phi + \epsilon \psi$ will result in a zero change in the lagrangian. But doesn't that mean that every transformation is a symmetry transformation of the lagrangian?
However, I think a symmetry transformation doesn't need to be infinitesimal but all of the books I looked at, derive the conserved current using an infintesimal approximation to the translation. But doesn't this method of restricting it to infitesimal transformations make the method useless since any infinitesimal translation doesn't change the action?