Affiliate Link Generator Copied!

|
1.415.462.1982

2024.x KeenTools FaceTracker

EDIT in Admin Edit in WP

Add to Wishlist

KeenTools FaceTracker
   

Downloads

Download demos and trial versions, product documentation, free presets and more.

KeenTools Package for NUKE

You may download a free Demo after logging in.

KeenTools FaceTracker

FaceTracker is a plugin for Foundry Nuke that lets you track human faces easily without leaving Nuke, and without mocap rigs and markers. The tracking information can be later used for retouching, adding scars, relighting, face replacement, aging and de-aging, etc.

For best results we recommend using it with FaceBuilder. FaceTracker is similar to GeoTracker but in addition to model’s position it also tracks facial gestures. Our tracking algorithms are stable contrary to neural networks solutions, precise, allow full manual control and don’t require any kind of on-stage preparation like facial motion capture rigs.

 

Accurate & Fast Tracking

We want to bring latest achievements of the scientific world to the production pipelines, meaning you have the best algorithms and approaches at hand when you use our tracking plugins. Speaking of the speed, we can’t guarantee you the realtime tracking, but we are really close to it, so you wouldn’t need to wait long.

Integrated Workflow

You don’t need to export and import anything from and into Nuke, the whole tracking process is happening inside: you create a FaceTracker node and start tracking using a 2D Viewer, and checking the results in 3D Viewer when needed.

What You See Is What You Get

You don’t need to meddle with sliders and knobs, you just create ‘pins’ on the face mesh in the Viewer and drag them to the corresponding position. The face model is adapting while you drag the pins.

Manual Control & Precision

While we try to make everything full automatic requiring as little as possible human work hours, we still focus on precise tracking results, so you can control the process and adjust the results and keyframes to a full degree.

Nuke Indie support

All our nodes including FaceTracker are available in Nuke Indie. You need to install the 12.2v4 version of Nuke and 2020.1 version of KeenTools package or newer. There are no functional limitations compared to the standard Nuke.

Export FACS/ARKit blendshapes

Once the tracking is done, you can export the animation into a CSV file with ARKit-compatible FACS blendshapes, just like the Epic Games’ Live Link Face app provides you, so you can later use it with your own tools or integrate into Unreal Engine-based pipeline. You can also load this file into our FaceBuilder for Blender add-on to transfer animation to a different person for example.

Automatic face alignment

You don’t need to manually pin faces anymore! At least, not from the scratch. Our face alignment is not yet always 100% accurate, so it requires some manual adjustments sometimes, but it radically reduces the time of shaping the models. So much, we’ve actually stopped doing this manually in our team while testing and we don’t want to go back!

User Tracks (Helpers)

Usually you can just rely on our own tracking algorithms, but just in case, you can improve tracking quality using tracking data from other trackers. For example, you can import tracks of Nuke’s built-in Tracker node and FaceTracker will take them into account with the highest priority.

Surface Masks

You can mask out some polygons of the geometry that you want to exclude from tracking. For example some reflective parts of skin or eyeballs. Though usually you don’t need to do this, since FaceTracker deals with them pretty well on its own.

Roto Masks

Another way to improve tracking (in those rare cases when it actually fails) is excluding occlusions from tracking. To do it you can connect a roto node to the Mask input of FaceTracker and (re-) launch tracking.

Feels Like Built-In

Our plugins are written with C++ using low-level Nuke API. So you can be sure you’re working with tools with native-like experience.

Read the Guide

FaceTracker FAQ

Where can I find a tutorial?

It’s waiting for you here.

Do you have some examples to play with?

Sure! They’re on the examples page.

What model should I use as an input for FaceTracker?

We assume that you’re going to use FaceTracker along with FaceBuilder, using FaceBuilder’s output as an input model for FaceTracker. But you can easily use FaceTracker without FaceBuilder, check the question about a custom model below to find out how.

Can I use FaceTracker without FaceBuilder?

Yes, the workaround is described in the Custom Model question below. You don’t need a license for FaceBuilder to export a default model.

Can I use a custom head model?

You can export the default model of FaceBuilder, and then modify the shape keeping vertices count and order. Then you can import it back, and connect to FaceTracker. It uses vertices to understand what is what in the model (e.g. nose, lips, eyes, etc). So, you can manually move vertices if FaceBuilder’s result doesn’t suit you, remove or add faces, change normals and UVs, wrap a scanned model with our default model, etc.

Can I use custom blendshapes?

Not at the moment, but we are considering adding support for custom blendshapes in future.

Do I need to start tracking from a neutral face expression?

Not really, but it’d be easier if you can find a neutral expression to start from.

If I abort the tracking, the results would be lost?

No, the tracking information is saved frame by frame, so you can abort tracking at any moment keeping the tracking information you have already got intact.

I have a subscription for FaceBuilder, do I need another one for FaceTracker?

Yes, the FaceBuilder and FaceTracker are independent. You need subscriptions for both to work with both plugins. You can also get a bundle subscription.

How to export an animated model to a file?

You can use Nuke’s built-in WriteGeo node with ABC format. After pressing “Execute” button specify the frames you want to export.

Can I use FaceTracker in Nuke Indie?

Yes! You’d only need to install Nuke 12.2v4 or newer.

The Foundry Nuke 12, 12.1, 12.2, 13, 13.1, 13.2, 14

KeenTools for Nuke 2023.2 (07 August 2023)

  • Video Analysis up to 2 times faster
  • Improved tracking performance up to 20%
  • TextureBuilder up to 3 times faster
  • Accelerated surface masking
  • New build for Nuke 14 running newer Linux systems (RHEL9)

KeenTools for Nuke 2023.1 (07 March 2023)

  • Minor bug fixes and improvements

KeenTools for Nuke 2022.3.0 (18 December 2022)

  • Added support for Nuke 14 (classic 3D nodes)
  • Minor fixes and improvements

KeenTools for Nuke 2022.2.4 (28 November 2022)

  • Better unicode support
  • Fixed user tracks in FaceTracker and GeoTracker
  • Minor fixes and improvements

KeenTools for Nuke 2022.2.0 (3 August 2022)

  • FaceBuilder can reconstruct faces with finer details
  • Added MetaHuman-compatible UV layout
  • GeoTracker, FaceTracker: added transform handles in 2D
  • FaceBuilder, FaceTracker: fixed align face for anamorphic footage and translated cameras
  • Nuke 11 support removed
  • Many minor fixes and UI tweaks

KeenTools for Nuke 2022.1.1 (14 April 2022)

  • Nuke 13.2 support
  • Minor fixes

KeenTools for Nuke 2022.1.0 (6 April 2022)

  • Regularisation improvements in FaceBuilder and FaceTracker
  • Fixed anamorphic lens support in FaceBuilder
  • Fixed scaling in export
  • Pins can be toggled
  • Improved tracking workflow when there are not enough features
  • Fixed exporting bugs
  • Improved Align Face behaviour
  • Minor UI tweaks
  • ‘Output transformed geometry’ in FaceBuilder is now deprecated
  • 2D-masking in GeoTracker is now completely strict
  • General performance improvements
  • More stable Hardware ID in License Server

Where can I find a tutorial?

It’s waiting for you here.

Do you have some examples to play with?

Sure! They’re on the examples page.

What model should I use as an input for FaceTracker?

We assume that you’re going to use FaceTracker along with FaceBuilder, using FaceBuilder’s output as an input model for FaceTracker. But you can easily use FaceTracker without FaceBuilder, check the question about a custom model below to find out how.

Can I use FaceTracker without FaceBuilder?

Yes, the workaround is described in the Custom Model question below. You don’t need a license for FaceBuilder to export a default model.

Can I use a custom head model?

You can export the default model of FaceBuilder, and then modify the shape keeping vertices count and order. Then you can import it back, and connect to FaceTracker. It uses vertices to understand what is what in the model (e.g. nose, lips, eyes, etc). So, you can manually move vertices if FaceBuilder’s result doesn’t suit you, remove or add faces, change normals and UVs, wrap a scanned model with our default model, etc.

Can I use custom blendshapes?

Not at the moment, but we are considering adding support for custom blendshapes in future.

Do I need to start tracking from a neutral face expression?

Not really, but it’d be easier if you can find a neutral expression to start from.

If I abort the tracking, the results would be lost?

No, the tracking information is saved frame by frame, so you can abort tracking at any moment keeping the tracking information you have already got intact.

I have a subscription for FaceBuilder, do I need another one for FaceTracker?

Yes, the FaceBuilder and FaceTracker are independent. You need subscriptions for both to work with both plugins. You can also get a bundle subscription.

How to export an animated model to a file?

You can use Nuke’s built-in WriteGeo node with ABC format. After pressing “Execute” button specify the frames you want to export.

Can I use FaceTracker in Nuke Indie?

Yes! You’d only need to install Nuke 12.2v4 or newer.



California Consumer Privacy Act (CCPA) Opt-Out IconYour Privacy Choices Notice at Collection