The Leap Motion controller: A view on sign language

Abstract

This paper presents an early exploration of the suitability of the Leap Motion controller for Australian Sign Language (Auslan) recognition. Testing showed that the controller is able to provide accurate tracking of hands and fingers, and to track movement. This detection loses accuracy when the hand moves into a position that obstructs the controller's ability to view, such as when the hand rotates and is perpendicular to the controller. The detection also fails when individual elements of the hands are brought together, such as finger to finger. In both of these circumstances, the controller is unable to read or track the hand. There is potential for the use of this technology for recognising Auslan, however further development of the Leap Motion API is required.