So I know you already accepted an answer but in my opinion this is very important and is not discussed with our undergraduates enough:
The notion of "is a tensor" as we use it in physics is generally syntactic, not semantic.
That means that it is not a physical object which is a four-vector or not a four-vector, rather it is a vector equation which is either covariant or non-covariant, and the easiest way to write it in a covariant way is if all of the constituent entities "are tensors."
Here's what I mean in more detail: technically you have a geometrical space, and the inhabitants of that space are the true, semantic, $[m, n]$-tensors. There are a set of "scalars"1 and atop that are defined your "vectors"2 and atop that you can define coordinate systems3 and covectors and $[m,n]$-tensors in general4. That's where the "real" tensors live.
But when I say "this is a tensor" in physics what I mean is that this expression singles out one and exactly one tensor in the geometrical space. If it does, then that physical quantity "is a tensor," and if it does not, then it is not.
This is why we can say "a vector is anything that transforms like a vector." We mean "if you shift from coordinates $C$ to coordinates $C'$ in the geometrical space, we know how its vectors' components mix together. If an assortment of measurable numbers happens to mix together in the same way, then it can be associated with exactly one of these tensors and in that sense the assortment "is a tensor."
So the easiest example, though it may reach into a course you have not yet had, is a Christoffel symbol. A Christoffel symbol is a part of differential geometry which helps us take derivatives in curved spaces. A symbol like $\Gamma^a_{bc}$ certainly looks like a [1, 2]-tensor. It has numeric components just like one! Why is it famously "not a tensor"?
It's because: there does exist a tensor which has those components in the present coordinate system, and you can calculate what those components of that tensor must be in a transformed coordinate system, but if you derive the Christoffel symbol of that other coordinate system, it will not have those transformed components. So yes, the Christoffel symbol in some coordinate system $A$ happens to coincide with a tensor, but if you shift to a different coordinate system $B$ then you will discover that it was indeed just a coincidence that that particular geometrical entity was your $\Gamma$. The abstract notion of "Christoffel symbol" is defined in a way such that it might be embodied by a number of different tensors depending on the coordinate system, and that is why it is "not a tensor".
Do you see what I mean when I say that it is a syntactic concept? The equation does single out a set of numbers and that set of numbers is some tensor, the problem is that in different coordinate systems the same equation singles out a different entity and hence that expression is not a tensor expression.
So special relativity says when you accelerate towards a clock it appears to tick faster, proportional to both its distance to you and your acceleration. This is the only fundamental fact which special relativity adds to our physics; everything else can be derived from it. We happen to have a 4D Minkowski space where the abstract geometrical entities obey Lorentz transforms preserving a metric $\operatorname{diag}(1, -1, -1, -1)$. And if we work it out, the assembly of components $(ct, x, y, z)$ will, if you control for the fact that the geometric space doesn't know what "units" are, correspond to a single geometric entity in that space: if you transform those coordinates with this rule from special relativity, you will find that the new position and time components match the relativistic components. And thus we say that these components "are a four-vector."
- You can get special relativity from general relativity in a very boring limit. In general relativity you have some abstract space of "points" $\mathcal M$ and you must define a set of real-valued scalar fields $\mathcal S \subset \mathcal M \to \mathbb R$, which must be "smooth" in the sense that the set must be closed under what I call "$k$-functors", these are functions from $C^\infty(\mathbb R^k, \mathbb R)$ interpreted as acting "pointwise" on the output, e.g. for $k=2$ we'd have $f[s_1, s_2](p) = f\big(s_1(p),~s_2(p)\big)$. This set also defines your topology, hence how the space is connected. Note that this gives closure under pointwise addition and multiplication.
- In general relativity the vector fields are the Leibniz-linear maps $\mathcal V\subset \mathcal S\to\mathcal S$. So if $V$ is a vector field, this "Leibniz-linear" term means that for any $k$-functor, using $\bullet^{(i)}$ to mean "partial derivative of $\bullet$ with respect to its $i^\text{th}$ argument", we would say $$V\Big(f[s_1, s_2, \dots s_k]\Big) = \sum_{i=1}^n f^{(i)}[s_1\dots s_k]\cdot V(s_i).$$
- You technically need to assume a coordinate system in GR. Formally the axiom says that around any point there exists a neighborhood and $n$ scalar fields $c_{1,2,\dots n}$ such that any vector field can, within that neighborhood, be written as an $n$-functor $f[c_1,\dots c_n].$ Then one can uniquely identify a vector as a directional derivative with components $v_i = V(c_i).$ Those components are always scalar fields, mind.
- A covector is a linear map from vectors to scalars, $\operatorname{Hom}(\mathcal V \to \mathcal S)$ or however you want to notate it. An $[m, n]$-tensor is a multilinear map from $m$ covectors and $n$ vectors to a scalar. There is an axiom stating that there exists a metric $[0,2]$-tensor and a $[2, 0]$-tensor inverse to it, providing a bijection between the vector space and the covector space and more generally between all $[m,n]$-tensors with the same $m+n$. In addition to this, one needs an axiom that any $[n, 0]$-tensor can be written as some big sum of products of vectors, so that the space of tensors is not substantially more interesting than the products of the spaces of vectors and covectors.
...and FWIW I'm an experimental physicists, not a mathematician.
– DanielSank Sep 11 '18 at 07:53