Abstract: As one of the important sea state parameters for navigation safety and coastal resource management, the ocean wave direction represents the propagation direction of the wave. A novel algorithm based on an optical flow method is developed for the ocean wave direction inversion of the ocean wave fields imaged by the X-band radar continuously. The proposed algorithm utilizes the echo images received by the X-band wave monitoring radar to estimate the optical flow motion, and then the actual wave propagation direction can be obtained by taking a weighted average of the motion vector for each pixel. Compared with the traditional ocean wave direction inversion method based on frequency-domain, the novel algorithm is fully using a time-domain signal processing method without determination of a current velocity and a modulation transfer function (MTF). In the meantime, the novel algorithm is simple, efficient and there is no need to do something more complicated here. Compared with traditional ocean wave direction inversion method, the ocean wave direction of derived by using this proposed method matches well with that measured by an in situ buoy nearby and the simulation data. These promising results demonstrate the efficiency and accuracy of the algorithm proposed in the paper.