Specifically, why is the operator “sandwiched in” between $\Psi^*$ and $\Psi$? i.e. Why isn’t the formula just $$\langle \hat{Q} \rangle = \int \hat{Q}\cdot|\Psi|^2 dx = \int \hat{Q}\cdot\Psi \cdot \Psi^* dx$$ instead of $$\langle\hat{Q}\rangle = \int \Psi^* \cdot\hat{Q}\cdot\Psi dx~? $$
I get that operators are generally noncommutative in QM, which is why the expressions aren't equivalent (or, more specifically, they're only equivalent if $\hat{Q}$ is Hermitian), but I don't get why we use the second expression instead of the first, as the first is just applying the definition of expected value from statistics. Expected value isn't even a physics thing, it's a math/statistics thing with a very straightforward definition, so how does it make it any sense to go changing it?
Does it have something to do with the operators being complex-valued? That's the only thing I can think of, especially because, for observables, which always correspond to real numbers, the operators have to be Hermitian, and, if I understand correctly, in that case, the QM formula reduces to the usual statistics formula. Hence, it would seem the formulas are only different when the operator outputs a complex value. But, looking at the wikipedia article on complex random variables, the formula doesn't really seem any different than the usual one for real random variables:
So what the heck is up with this formula? I know it's a postulate of QM, not derived from something else, but there still has to be some REASON for postulating it, and it can't just be empirical, since the formulas are only different for non-observables.
I did find this thread but it's mostly just people demonstrating that, for observables, the formulas are the same, which I already know. What I want to know is why, in QM, we start out with a different definition of expected value in the first place, regardless of whether it reduces to the usual definition in the special case of Hermitian operators.
The only other semi relevant thread I could find was this one, but that person was more wanting to know how it made sense to use expected value in QM at all, rather than about the difference in the two definitions.