Optical flow is a vision-based approach that is used for tracking the movement of objects. This robust technique can be an effective tool for determining the source of failures on slope surfaces, including the dynamic behavior of rockfall. However, optical flow-based measurement still remains an issue as the data from optical flow algorithms can be affected by the varied photographing environment, such as weather and illuminations. To address such problems, this paper presents an optical flow-based tracking algorithm that can be employed to extract motion data from video records for slope monitoring. Additionally, a workflow combined with photogrammetry and the optical flow technique has been proposed for producing highly accurate estimations of rockfall motion. The effectiveness of the proposed approach has been evaluated with the dataset obtained from a photogrammetry survey of field rockfall tests performed by the authors in 2015. The results show that the workflow adopted in this study can be suitable to identify rockfall events overtime in a slope monitoring system. The limitations of the current approach are also discussed.