We know that time always flows on and on i.e. from past to present and then to future.
Therefore, a direction can be assigned to time. Since, the direction of time is unique and it is unspecified or unstated. That is why time cannot be a vector though it has a direction.