In a classic picture, holes are conceptualized as the “absence of an electron” in an otherwise full electron system. The movement of holes is effectively achieved through electron motion as shown in Figure 3.17. This hole can be perceived as moving when another electron fills it. When an electric field is applied, electrons and holes move in opposite directions. Electrons, which are negatively charged, move in the opposite direction of the electric field. Conversely, holes are viewed as positive charge carriers (absence of electron) and move in the same direction as the electric field.

from Neamen, D. A. (2012). Semiconductor physics and devices: Basic principles (4th ed.). McGraw-Hill.
However, in the context of energy band theory, holes and electrons actually move in the same direction under an electric field. This might seem counterintuitive given their opposite charges, but it can be explained through the concept of effective mass. In the energy band theory, the effective mass of a carrier is inversely related to the curvature of the energy band. For electrons, the effective mass is negative in the top of valence band (positive in the bottem of conductive band), which means their response to an electric field is as if they had positive charge. Thus, both holes (viewed as positive charge carriers) and electrons in the top of valence band move in the same direction when an electric field is applied.
An explanation provided by Wiki

(from https://en.wikipedia.org/wiki/Electron_hole)
The net current in a semiconductor is the total effect of the electron near the bottom of the conduction band and the hole near the top of the valence band.
One perspective to understand this involves imagining a picture where only holes exist near the top of a valence band. This can be likened to the 'empty seat' analogy explained in Wiki. Here, the electrons responsible for the movement of holes do not follow the parabolic approximation of the energy band model (therefore do not move in the same direction as the electric field). This is similar to visualizing a crowded theater where people's (electrons) movement to occupy empty seats (holes) results in the apparent movement of the empty seat. The empty seat appears to move against the crowd, mirroring how a hole moves in the same direction as an electric field, which is opposite to the natural movement of an electron.