From Wikipedia's article on electrostatics (emphasis mine),
...electrostatics does not require the absence of magnetic fields or electric currents. Rather, if magnetic fields or electric currents do exist, they must not change with time, or in the worst-case, they must change with time only very slowly. In some problems, both electrostatics and magnetostatics may be required for accurate predictions, but the coupling between the two can still be ignored. Electrostatics and magnetostatics can both be seen as Galilean limits for electromagnetism.
The coupling referred to here is the Maxwell's equations: (specifically Faraday's law and Ampere's law):
\begin{align}
\frac{\partial\mathbf E}{\partial t}&=c\nabla\times\mathbf B\\
\frac{\partial\mathbf B}{\partial t}&=-c\nabla\times\mathbf E
\end{align}
(using Gaussian units here).
What the quote I gave at the beginning is saying is that, because electrostatics means there is no time-varying field, the one field being induced from the other cannot actually happen as you've requested, simply because of the definition of electrostatics.