Suppose an inertial frame $S^\prime$ is moving with a relative velocity $\textbf{v}=v\hat{n}$ w.r.t another intertial frame S with their axes parallel and $\hat{n}$ is an arbitrary direction. In that case the coordinates of the two frames are related by boost only and no rotation.
Now consider three such frames $S_1$, $S_2$ and $S_3$. Let the relative velocities $\textbf{v}_{21}$ and $\textbf{v}_{23}$ are not parallel but the axis of all the three frames are. In that case, it is inferred that the coordinates of $S_1$ abd $S_3$, are related not only by a boost but a boost as well as rotation. Now, here is my problem.
There is a relative velocity between $S_1$ and $S_3$. Let us call it $\textbf{v}_{31}$. As the axes of all the frames are parallel, so for the frames $S_1$ and $S_3$, we are back to the situation mentioned in the first paragraph. So why shouldn't the coordinates of 1 and 3 are only related by boost and no rotation? Where am I making the mistake?