KeenTools

Smart tools for VFX & 3D artists

GeoTracker for Blender

KeenTools
KeenTools
Published in
11 min readAug 8, 2023

--

Written Guide

Last updated: Feb 2025

Geometry-based object and camera tracking add-on for your favourite 3D creation suite. Easily track objects in your videos and bring them to life in 3D space, all within Blender.

Installation

If you already have any other KeenTools add-on installed in Blender, just update it. The new GeoTracker tab will appear on the sidebar (Shortcut: N — hide/show).

Blender 4.2: Download KeenTools Blender Pack, open Blender Preferences > Add-ons, click on the little arrow in the top right corner and select Install from Disk. Navigate to the downloaded zip file and install it. If you’re on Mac, find ZIP in the downloaded DMG file.

For Blender versions 2.8–4.1 check out this installation video

Next, install Core Library. You can do it either online or offline.

Unfold KeenTools extension and agree to the Licence Agreement. If your machine is connected to the internet, simply press Install online. Core Library will be downloaded and installed automatically.

For offline installation, download Core Library manually from our website. After download, press Install from disk and navigate to the downloaded file. Please keep in mind that the add-on and the core library versions should match.

Install KeenTools Blender Pack

Inputs

Start by pressing N to view the sidebar and then click on the GeoTracker tab to open the main panel. Press Create new GeoTracker. This will open the main panel with Inputs on the top. The fields marked in red are empty fields that must be filled to proceed to tracking.

Camera

By default, GeoTracker picks up the Camera from your Blender scene. If you accidentally delete it, you can create a new camera by clicking Add > Camera in the top left of the viewport.

You can plug a new camera into the Camera Input from the dropdown list or directly from the viewport with the picker (Shortcut: E).

Clip

Click on the folder icon next to the Clip field and load your footage. This can be either an image sequence or a movie file.

When loading an image sequence, GeoTracker reads the name of the first file in that sequence and if there’s a suffix, it sets it as the start frame on the Blender timeline. E.g. Sequence_1001.png will automatically set the playback to start off with frame 1001.

You can reposition the playback on Blender timeline by entering a specific frame number in the Start frame selector just below the Clip input. Be mindful that setting the start frame for your playback has to be done before analysing and tracking takes place.

For faster tracking you will need to analyse the clip. Press Analyse, select the frame range and hit OK. GeoTracker will scrub through the timeline forward and backwards and create an advanced motion vector file (.precalc ) on your disk, which you can use later for tracking other objects in the same shot. By default, it will be saved in your temporary folder on MAC or disk C on Windows. But, of course, you can choose a different location.

Geometry

Select Geometry that you will use to track the target object in your clip. By default, GeoTracker picks the cube from the Blender startup scene. You can use any model from your scene, including imported 3D models (File > Import). Click on the field next to Geometry to select it from the dropdown list, or use the object picker (Shortcut: E) to select it right in the viewport.

Load geometry

Similar to Geometry, GeoTracker picks up the default Camera from your Blender scene. If you accidentally delete it, you can create a new camera by clicking Add > Camera in the upper left of the viewport. You can always pick the right camera from the dropdown list or use the picker (Shortcut: E).

Before moving on to tracking, it’s important to press Analyse and hit OK. GeoTracker will analyse the clip and save the analysis data as a .precalc file on your disk. By default, it will be saved in your temporary folder on MAC or disk C on Windows. But, of course, you can choose a different location. This will make tracking much faster, though you can skip it by deselecting Use analysis cache file.

Pinning

Next step is overlaying Geometry on top of the target object in the clip. Press Start pinmode in the Tracking tab. Click anywhere on the mesh to create the first pin. Drag it to align the model with the object you’re going to track. Create more pins and adjust their positions to ensure a precise fit. Right-click on the pins you want to remove. Note that pins are only used for adjusting the model’s position. Their number and exact positions will not affect your tracking.

Match geometry with the footage

Wireframe colour and opacity are adjustable, and so are the size and sensitivity of the pins. You will find basic settings in the Appearance tab. More settings in Preferences > Add-ons.

Camera setup

The key to good tracking results is correct camera settings. If you know the focal length and film size of the camera on the set, just type them in in the dedicated Camera tab. In case you don’t or unsure about your camera data, you can tick Estimate focal length checkbox to get that value calculated for you. Note that automatic focal length estimation works only for the current frame while you’re pinning the model, and you need to have at least 4 pins set on the wireframe to activate it.

Tracking

Select tracking mode depending on your needs using these buttons in the Tracking tab:

Geometry — to follow the motion of an object

Camera — to track the camera position in a physical space (e.g. when tracking static objects).

Click on the Track Forward button. You’ll see GeoTracker estimating the position of the target object in the consequent frames. Whenever you see the mesh is off, pause tracking and adjust its position manually using the existing pins or creating new ones if necessary. GeoTracker will store the adjusted position and rotation by creating new keyframes. Note that the manual keyframes created this way do not affect the tracking data stored in the other keyframes. Press Refine to update the tracking data after each adjustment. Keep on refining your tracking until the motion of your 3D model is smooth and accurate.

Adjust and refine if geometry slips
Camera tracking example

Improve tracking accuracy with the Lock View option

Sometimes it’s hard to assess the tracking quality especially when dealing with dynamic shots. Use the Lock View button or keyboard shortcut L to stabilize the clip in the viewport. With no pins selected, GeoTracker will snap the view to your Geometry. But you can also lock the view to a specific point on your 3D model by selecting one or a group of pins. Learn more about this feature in our video tutorial.

Lock View results

Masks

Oftentimes various elements in the video get in the way of tracking, and that results in Geometry slipping away from the target object. Masking is a technique that lets you exclude problematic areas from tracking. GeoTracker offers not just one but three types of masks to deal with almost any occlusion you might encounter: Surface, Compositing, and Sequencemasks.

Surface mask allows you to select polygons right on the surface of your Geometry to exclude them from tracking. This can be useful when dealing with reflection or when you need to take out certain elements, like adjacent parts, of your 3D model from tracking.

To apply a Surface mask, switch to Edit Mode and select the polygons you want to mask out, then go to the Object Data tab in the Properties, create a new vertex group by clicking on +, and press the Assign button below. Return to Object Mode and select the newly created group in the Surface mask dropdown list. You can then switch to Pinmode to view the mask.

Create a Surface mask

Another way to fight off occlusions is 2D masking, which works for most overlays like the character’s hand or other elements in the foreground crossing the path of the track. You can either draw a 2D mask right in Blender using the Compositing mask option or import a pre-made mask using the Sequence option. Note that you can’t select both Compositing and Sequence masks within one tracking session. You can only use one at a time.

In order to use Compositing mask, go to Movie Clip Editor and select your clip. Switch the Tracking mode to Mask and click on Add> Circle (or other shapes that fit your situation). You can now press Move and place your mask over the element you want GeoTracker to ignore when tracking. Learn more about editing masks in Blender on this page.

You can adjust your mask position in other frames by creating new keyframes. Note that the keyframes you create in the Movie Clip Editor are independent of those generated by GeoTracker. Once you’re happy with the mask shape and position, go back to the 3D viewport and select your mask in the Compositingmask tab. Go to Pinmode to see your mask in action.

Create a Compositing mask

If you have a pre-made mask, you can import it using the Sequence mask option. You can then choose which of the RGBA channels you want to use for masking.

Import and adjust a Sequence mask

Just like with the loaded clip, GeoTracker reads the name of the first file in the mask sequence and if there’s a suffix, it sets it as the start frame on the Blender timeline. E.g. Mask_1001.png will set the mask to start off with frame 1001. If you need to adjust its position on the timeline, enter a specific frame number in the Start frame selector below.

Scene Tab

You can easily manipulate your scene from the Scene tab on the GeoTracker panel. The Transform section lets you Scale and Position your scene with the two corresponding buttons. You can scale either the whole scene relative to the selected Pivot point or Geometry relevant to Camera, or Camera relevant to Geometry. And when doing the latter, you can also lock the camera visualisation scale.

You can select either Camera or Geometry as the pivot point to Position your scene in 3D space. You can set the Location and Rotation values manually or use preset positions such as World Origin and 3D Cursor.

Position your scene

The Rig button lets you create an Empty with parented Camera and/or Geometry that you can use as a handle when building your 3D scene.

Go to the Animation section when you need to convert your Camera animation to Geometry or vice versa. Note that if both the Camera and Geometry are animated, pressing the Convert button will convert all animation to one, and then this operation will not be reversible!

Press Bake if you need to unparent Camera and/or Geometry. This will bake them, along with their animation, to World space.

Important! If your model rotates more than 360° between certain keyframes, we recommend using the Unbreak Rotation option. The algorithm behind it will go through all keyframes and make rotation continuous thus avoiding 360 degree jumps. It means that if rotation was 355° in the keyframe #24 and 10° in the keyframe #25, pressing this button will add 360° to keyframe #25, so the resulting rotation of the model will be 370°. It works backwards as well: going from 10° to 355° will make it -5°.

You have to be careful if your model rotates both forward and backwards between the nearest keyframes — then this operation will most likely make things worse.

Texturing

The Texture tab lets you grab texture from the tracked object in the video and then bake it onto the 3D model. You will first need to choose which frames you want GeoTracker to take the texture from. Go to the source frame on the timeline and press +. The snapshotted frame will then appear in the Add frames list. If you want to remove it, click -.

For best results, choose frames where the object is clearly seen from different angles to provide GeoTracker with ample data for creating texture. Avoid frames that are blurry or have something in the foreground that blocks the view of the object.

As you click Create Texture, GeoTracker projects the texture from the selected frames and bakes it onto your Geometry. Click the gear icon to access Texturing settings. Here, you can adjust the size of your texture and also set up things like Angle Strictness, allowing you to control how much the pixel color will be affected depending on the viewing angle, and Expand Texture Edges which lets you cover dark spots on the texture by expanding the edges.

Create texture

Click Export to get your texture as a PNG, JPEG, or EXR file.

You can also save the texture from all frames as an animated sequence by clicking the Save to Sequence button.

Export

Empty

In the Export tab you can export one or multiple Empties by specifying the source in the dropdown menu and pressing the Export button below it:

Geometry — geometry animation

Camera — camera animation

Selected pins — one or multiple Empties (drop a pin on the mesh and set its orientation before export)

Check Linked to keep exported animation synced with further changes in the tracking data.

Export an animated Empty

Render Wireframe

You can render playback with overlaid wireframe or just animated wireframe by pressing the Render Wireframe button. In the render output panel you can adjust controls like wireframe line width and color, and use options like Lit wireframe, Backface culling, Highlight facial features. If you need to render only animated wireframe without the playback, deselect Use background. It will be rendered out as a series of images according to the selected file format: PNG, JPEG or EXR.

Create tracking preview, demos or dailies

Video tutorials

Check out these video guides to find out more about GeoTracker for Blender.

Tracking Basics Tutorial
GeoTracker + FaceBuilder for Blender Tutorial
Basics of Camera Tracking

More tutorials are on their way!

Follow us: Facebook, Linkedin, Twitter, Instagram, YouTube, Discord, Reddit

--

--

KeenTools
KeenTools

Written by KeenTools

Smart tools for VFX and 3D artists

No responses yet