As so often with nuclear physics, this is a complicated issue whose quantitative treatment needs either difficult calculations or handwaving, but let's try to give an overview.
A doubly magic nucleus doesn't always have a high binding energy per nucleon. It needn't even be stable. Helium-$10$ is a famous example: it's not even particle-bound. You'll probably object that's nowhere near the optimum $N$ vs. $Z$ for $A=10$, viz. $\frac{N}{Z}=1+\frac{a_C}{2a_A}A^{2/3}$ or however you'd rearrange it. But this famous result, which makes neutrons substantially outnumber protons in large stable nuclei, also makes it hard for large doubly magic nuclei to perform well.
For example, you mentioned the next magic atomic number after iron is $Z=50$, but no stable isotope of tin is doubly magic. Or if you consider $N=50$, neither $Z=28$ (nickel) nor $Z=82$ (lead) is anywhere near stable. (While lead is famous for a doubly magic isotope, nickel ironically prefers to be an isotone of iron-$56$, which isn't even singly magic.)
At even higher magic numbers, just having a stable nucleus - never mind one that's doubly magic, with $N=Z$ or otherwise - is increasingly difficult, because large nuclei in general can easily fail. For starters, nothing transuranic will occur in nature. Admittedly we're nowhere near $Z=92$ yet, but the fact two pre-uranium elements don't exist naturally either illustrates just how many $(Z,\,N)$ combinations can fail. This shows "work out $N/Z$ for your chosen $A$, and hence determine $N$ and $Z$" sometimes only tells us the least unstable isobar.
We may as well compare iron-$56$, for which neither $Z$ nor $N$ is magic, to nickel-$56$, for which both are with $Z=N$ even, i.e. a multiple of helium-$4$. While stellar nucleosynthesis largely consists in building up such nuclei, there comes a point where $N$ should be quite a bit more than $Z$. Therefore, binding energy per nucleon peaks not at such a nucleus, but the decay endpoint of one. It's no surprise nickel-$56$ becomes cobalt-$56$ by positron decay, which then becomes iron-$56$ by a second position decay. It's also no surprise, if you consider each iron isotope's possible origin, that iron-$56$ is not only stable but almost all of the element.