I don't know if this is more a question for mathematicians or physicists (or even philosophers), but what would be the difference between time having a beginning infinitely long ago and time having no beginning (apart from the obvious, one had a beginning and the other didn't)? How could we tell whether it has always existed or began infinitely long ago?
In other words, did time have a beginning or did it begin an infinitely long time ago? How could we tell?
It appears, from Ryder Rude's answer and the embedded link, that the problem is addressed in questions about the shape of the universe.