Yes, for physicists, it is the same thing.
I try to summarize differences from math sources:
An operator A verifying $\langle Au,v\rangle = \langle u,Av\rangle$ is called symmetric.
In this case, the definitions domain verify $D(A) \subset D(A^*)$. So you have, in general, no equality between $A$ and $A^*$, because the domains of definition are different.
An operator is hermitian if it is bounded and symmetric.
A self-adjoint operator is by definition symmetric and everywhere defined, the domains of definition of $A$ and $A^*$ are equals,$D(A) = D(A^*)$, so in fact $A = A^*$ .
A theorem (Hellinger-Toeplitz theorem) states that an everywhere defined symmetric operator is bounded.
There is also a subtlety, that is, for every hermitian operator, you can construct an extension of this operator, which is self-adjoint.