Yes it can be. But that's not why time is unidirectional.
There are models of the universe that are consistent with all observations and that have the symmetries we expect where spacetime is $$\mathbb R^4=\{(a,b,c,d):a,b,c,d\in\mathbb R\}$$ and time is equal to $t=\sqrt{a^2+b^2+c^2+d^2}$.
However time is unidirectional for a totally different reason, which is because of the signature of the metric. The metric is what clocks and rulers measure. For instance the thing I called time, $t,$ isn't what clocks measure. It cant be because two clocks that move differently measure differently. So they aren't measuring something about the universe (like where in 4d spacetime you are), they measure something about the particular path they were following in the universe. Rulers do that too. When they move differently they measure differently. So what they measure is something about their path.
What they measure is the metric along their path.
So the metric could allow things to move backwards in time by have two independent time directions (this would give a signature of (2,2) for two independent timelike directions and two independent spacelike directions) so you would have room to do a rotation in time. But the metric in our space doesn't allow you to rotate around all the way, you can only wiggle a bit while you keep moving radially outwards in 4d (in this model, there are other models that are also consistent with observations so far in which time isn't a radial direction in 4d at all).
So the metric is important. For instance it might look like space is getting bigger at a certain rate in this model, after all the 3d set of points with a fixed $t$ seems larger for a larger $t$ but since measurements are based on the metric, the real question is does the metric get larger or smaller on those surfaces of larger $t$ and depending on whether it does the size of the universe (as measured by rulers in the universe that are measuring the metric like all rulers do) could be getting larger, or smaller.
And you could even make the universe collapse in a finite amount of time by making the metric have clocks tick slower and slower for larger $t$ so even though it looks in the picture like you have an infinite amount of time for the universe to live, you might not.
So the details of the metric are super important. And in general relativity the work goes into finding out how that metric changes from point to point and time to time.