If you were to place an object with 0 velocity, that means that it isn't moving…
No, it doesn't, because that doesn't really mean anything. Velocity is a coordinate dependent quantity, so zero velocity (really zero 3-velocity) simply means that you've chosen a coordinate system in the 4-velocity is given by $(1,0,0,0)$.$^*$ Note that I said a coordinate system, rather than the, because while setting to velocity of a particular object uniquely specifies a global inertial coordinate system up to a choice of origin in special relativity, this is not the case in general relativity, due to the fact that a spacetime manifold need not have a global inertial coordinate system, so instead, you can only get a locally inertial coordinate system, which is not unique. The fact that it's not unique is important because, even if the 4-velocity remains as $(1,0,0,0)$ in one locally inertial coordinate system, there could be another locally inertial coordinate system in which the representation of the 4-velocity changes. In other words, it is not actually possible, in principle, to compare the velocity of the object at different times. This is a consequence of the fact that concepts like rest and motion can only be defined with respect to a local observer in curved spacetime, whereas these concepts can be defined with respect to an arbitrary observer in flat spacetime.
If you find all of this differential geometry stuff confusing, a more intuitive way summarize this is to say that Newton's First Law does not apply in general relativity, because "staying at rest" and "staying in motion" are not well defined in curved spacetime.
$^*$using the $(+,-,-,-)$ metric signature and units with $c=1$