The idea that the pressure is the force for a given directed area suggests at first that pressure $P=F/A$, a ratio of two vectors, but this is not defined. Instead, say that $F=PA$, where $P$ can be defined, but is not uniquely determined by the two vectors as given.
Within the mode of your question - there are really two different pressure concepts.
One of them is exactly the (sorry for mentioning) stress tensor you said you did not understand, but actually you do - enough to see what is going on. The stress tensor is just the relation that gives the vector force on a vector directed area. Strictly, the pressure tensor is the negative of the stress tensor as pressure is the negative of tension (think of pulling a balloon out rather than pushing it in).
The other concept is the scalar pressure, which is the average normal force. The normal force is a scalar (just a number) - the length of the normal force on a unit area as a vector. If this scalar is taken in three orthogonal directions and averaged, this is what is called the pressure. It is also just a number. And since it is the average in all directions - it does not depend on direction.
If, for example, you get a block of rubber and push it down on the top but pull it out from the sides, then the force per unit area will be different for a horizontal surface inside than for a vertical surface. But the pressure will be the average. So, it is possible to have zero pressure even though the forces are not zero - if a small chunk of the material is being pulled and pushed so that the average is zero.
But, while you can do this to a fluid, such as water, the result would be that the water would flow out the side with the lower pressure. So, this could only occur for a short time. Actually, in this case, the inertia of the water starts to be important - that that introduces the idea of dynamic pressure, due to resistance of the fluid to motion. This introduces a number of complications including that the pressure can depend on the speed of the observer. So, there are quite a few conundrums in the pressure concept.