FaceRig + Leap Motion

Digitally embody characters with real time facial and hand tracking

(YouTube) FaceRig Trailer.
(Steam) Leap Motion add-on for FaceRig.
(Steam) FaceRig (Main Product).

FaceRig is a program that aims to enable anyone with a webcam to digitally embody awesome characters. The output can be recorded as a movie or streamed to Skype, Twitch, Hangouts or any service that traditionally uses a webcam in real time.

The FaceRig support for Leap Motion™ Controller DLC enables you to add this sensor to the FaceRig multiple sensors update. You can combine the Leap Motion™ Controller (for hand tracking) with another regular camera (for face tracking).

FaceRig is available on Steam (paid), and the DLC for enabling your Leap Motion Controller can be found here (free).

Note that the multisensor update is currently part of the "nextversion" branch of FaceRig. To switch to this, open your Steam client, go to Library, Software, right click FaceRig and select Properties. Go to the Betas tab and select "nextversion" from the dropdown.

To set up the Leap Motion hand tracking switch to Advanced UI and choose Advanced Tracking Configuration - Trackers and add the Leap Motion sensor (you can choose it from the drop down menu and click the Add button). You will also be able to change the plane from horizontal to vertical from the Leap Motion tracking settings.