Consider the force exerted by a spring on an object: $$\vec{F}=-k\vec{X},$$ where $\vec{X}$ is the deflection of the spring from its self-equilibrium. Calculate the time rate of change of the spring force:$$\frac{d\vec{F}}{dt}=-k\frac{d\vec{X}}{dt}.$$
Is the deflection changing is the spring is oscillating? Yes. So the time rate of change of the force exists. Now the real question is "Is the time rate of change of force useful for analysis in physics (as opposed to engineering/comfort/etc.)?" Generally, no. Hamiltonian mechanics answers this question in that only the first derivatives of position and momentum, along with constraints, are sufficient to describe the motions of systems.
Other responders may expand on this idea.