A rigid body is rigid because it pushes back when you push on it. This push back is the reaction force. The body pushes back just hard enough to keep you from pushing into the body.
For a flat surface like your first picture, the reaction force is perpendicular to the surface. Any sideways force is friction. Friction prevents or opposes two surfaces sliding past each other. This is different from penetrating into each other.
Typically, you figure out how strong a reaction force is by how strong other forces are. Gravity pulls the roller down with force $mg$. The reaction force is just strong enough to prevent this. The roller has no downward acceleration. The total vertical force is $0$. The magnitude of the reaction force must also be $mg$.
The reaction force is the same if the surface is made of ice. The roller can slide sideways freely. But it can't penetrate into the ice.
Even thought there is no perpendicular direction at the step, you can apply these ideas to figure out the direction of the reaction force.
When the roller contacts the step, which direction would cause it to penetrate into the step and which would allow the roller to move without distortion. The roller can rotate around the point of contact, but not decrease the distance from the center of the roller to the step.
There are tension and gravity forces that try to push the roller. You can resolve it into a component in the forbidden direction and perpendicular to that direction. The reaction force opposes motion in the forbidden direction.