Yes, in a resistor, the electric field accelerates the electrons.
In a resistor, scattering collisions make the average velocity of the electrons in the resistor approximately constant (for a constant DC voltage source).
When the electrons some out of the resistor and enter a superconductor,
they begin ballistic conduction.
The electrons suddenly being moving in ways described by Newton's laws of motion --
in particular, they initially just keep going at the same velocity they were at when they left the resistor. Just as you suspected.
(A superconductor is more or less by definition a material packed full of movable electrons that electrons can travel through without scattering).
However, (still in accordance with Newton's laws), there can be a transient voltage across a physical superconductor. When that happens, the electrons inside accelerate faster and faster, since there is no scattering to slow them down, until they hit the boundary of (and in some cases exit) the physical superconductor.
I suspect the paradox you are alluding to occurs even without the superconductor.
Say we have a battery in New York, and a light bulb in Los Angeles,
connected by 2 very long copper wires.
If there is a break in either wire near Los Angeles, the light bulb almost instantly goes dark.
But after we fix that break, how does the battery miles away almost instantly "know" to start pumping again, pulling electrons out of one wire and pushing them into the other, and somehow those electrons -- creeping along at a few inches per minute -- almost instantly turn on the light bulb?
One of my favorite explanations begins
"The charges start out inside the light bulb filament." -- William Beaty 1995,
and leads us to: What is electricity, really?