Abstract:
A non-intrusive real-time program detects the face and face
features of a moving workstation user at a rate of between 10
and 30 Hertz. Based on the face pose, it determines where
on the display the subject is looking. Button selection can be
done by opening the mouth. The long term goal is to provide
a system for controlling a computer using head movements
and gaze direction. A skin color model is used along with
geometric knowledge about the face and weak assumptions
about the lighting. Good results are reported with various
subjects and conditions, including facial hair, 3D motion,
and use of eyeglasses.