The metric tensor of inertial frames in S.R is given by $$g_{\alpha \beta}=diag(1,-1,-1,-1)$$ It's inverse $$(g_{\alpha \beta})^{-1}=g_{\alpha \beta}$$
I was wondering what this means geometrically. I know in General Relativity (I haven't delved deeper into this), the metric tensor has non-zero off-diagonal components, therefore, I wouldn't expect the metric tensor to be the inverse of itself but why is this true in Special Relativity where we only deal with flat spacetime?
I'm trying to think of it right now that the properties and trajectories in flat spacetime look the same forward and backward (like multiplying it by its inverse) so it forces the inverse to be the same as the original but I'm not sure (this could be baloney but I don't have math to support to disprove it right now).
Since the metric tensor basically encodes the properties of spacetime, what does this particular result mean physically?
Note: I've just started learning classical field theory and use Landau & Lifshitz Classical Field theory (Vol.4)