The answer to your question is the four velocity and the fact that we happen to live in a universe where the four velocity vector's magnitude has to stay constant.
Even objects "at rest" (in a given reference frame) are actually moving through spacetime, because spacetime is not just space, but also time: apple is "getting older" - moving through time. The "velocity" through spacetime is called a four-velocity and it is always equal to the speed of light. Spacetime in gravitation field is curved, so the time axis (in simple terms) is no longer orthogonal to the space axes. The apple moving first only in the time direction (i.e. at rest in space) starts accelerating in space thanks to the curvature (the "mixing" of the space and time axes) - the velocity in time becomes velocity in space. The acceleration happens because the time flows slower when the gravitational potential is decreasing. Apple is moving deeper into the graviational field, thus its velocity in the "time direction" is changing (as time gets slower and slower). The four-velocity is conserved (always equal to the speed of light), so the object must accelerate in space. This acceleration has the direction of decreasing gravitational gradient.
Edit - based on the comments I decided to clarify what the four-velocity is:
4-velocity is a four-vector, i.e. a vector with 4 components. The first component is the "speed through time" (how much of the coordinate time elapses per 1 unit of proper time). The remaining 3 components are the classical velocity vector (speed in the 3 spatial directions).
$$ U=\left(c\frac{dt}{d\tau},\frac{dx}{d\tau},\frac{dy}{d\tau},\frac{dz}{d\tau}\right) $$\
If in your example, you put a object initially at rest (relative to Earth) into Earth's gravitational field, then General Relativity tells us that the Earth's gravitational field will have an effect on the object, it will slow it down in the temporal dimension (GR time dilation). Now this means that the object's four velocity's temporal component will change. Remember, the magnitude has to stay constant, so the spatial components will have to compensate (change), meaning, that the object will start moving towards the center of mass of the Earth.
You could say that the objects are trying to reach a balance between the velocities in the different dimensions, but rather, one of the ultimate messages of General Relativity is that an objects velocity is not independent in the different dimensions, the object's velocity in the temporal dimension affects the velocity in the spatial dimensions and vica versa.