Tracker node

This documentation is for version 1.0 of Tracker.

Description

Track one or more 2D point(s) using LibMV from the Blender open-source software.

Goal

Track one or more 2D point and use them to either make another object/image match-move their motion or to stabilize the input image.

Tracking

  • Connect a Tracker node to the image containing the item you need to track
  • Place tracking markers with CTRL+ALT+Click on the Viewer or by clicking the + button below the track table in the settings panel
  • Setup the motion model to match the motion type of the item you need to track. By default the tracker will only assume the item is underoing a translation. Other motion models can be used for complex tracks but may be slower.
  • Select in the settings panel or on the Viewer the markers you want to track and then start tracking with the player buttons on the top of the Viewer.
  • If a track is getting lost or fails at some point, you may refine it by moving the marker at its correct position, this will force a new keyframe on the pattern which will be visible in the Viewer and on the timeline.

Using the tracks data

You can either use the Tracker node itself to use the track data or you may export it to another node.

Using the Transform within the Tracker node

Go to the Transform tab in the settings panel, and set the Transform Type to the operation you want to achieve. During tracking, the Transform Type should always been set to None if you want to correctly see the tracks on the Viewer.

You will notice that the transform parameters will be set automatically when the tracking is finished. Depending on the Transform Type, the values will be computed either to match-move the motion of the tracked points or to stabilize the image.

Exporting the tracking data

You may export the tracking data either to a CornerPin node or to a Transform node. The CornerPin node performs a warp that may be more stable than a Transform node when using 4 or more tracks: it retains more information than the Transform node.

Inputs

Input Description Optional
Source   No

Controls

Parameter / script name Type Default Function
Motion Type / motionType Choice None
The type of motion in output of this node.
None: No transformation applied in output to the image: this node is a pass-through. Set it to this mode when tracking to correclty see the input image on the viewer
Stabilize: Transforms the image so that the tracked points do not move
Match-Move: Transforms a different image so that it moves to match the tracked points
Remove Jitter: Transforms the image so that the tracked points move smoothly with high frequencies removed
Add Jitter: Transforms the image by the high frequencies of the animation of the tracks to increase the shake or apply it on another image
Transform Type / transformType Choice CornerPin
The type of transform used to produce the results.
Transform: The tracks motion will be used to compute the translation, scale and rotation parameter of a Transform node. At least 1 track is required to compute the translation and 2 for scale and rotation. The more tracks you use, the more stable and precise the resulting transform will be.
CornerPin: The tracks motion will be used to compute a CornerPin. A CornerPin is useful if you are tracking an image portion that has a perspective distortion. At least 1 track is required to compute the homography transforming the “From” points to the “To” points, and 4 required to track a perspective transformation.The more points you add, the more stable and precise the resulting CornerPin will be.
Reference frame / referenceFrame Integer 0 When exporting tracks to a CornerPin or Transform, this will be the frame number at which the transform will be an identity.
Set To Current Frame / setReferenceButton Button   Set the reference frame to the timeline’s current frame
Jitter Period / jitterPeriod Integer 10 Number of frames to average together to remove high frequencies for the add/remove jitter transform type
Smooth / smooth Integer t: 0 r: 0 s: 0 Smooth the translation/rotation/scale by averaging this number of frames together
Smooth / smoothCornerPin Integer 0 Smooth the Corner Pin by averaging this number of frames together
Compute Transform Automatically / autoComputeransform Boolean On When checked, whenever changing a parameter controlling the Transform Generation (such as Motion Type, Transform Type, Reference Frame, etc...) or changing the Enabled parameter of a track, the transform parameters will be re-computed automatically. When unchecked, you must press the Compute button to compute it.
Compute / computeTransform Button   Click to compute the parameters of the Transform Controls or CornerPin Controls (depending on the Transform Type) from the data acquired on the tracks during the tracking. This should be done after the tracking is finished and when you feel the results are satisfying. For each frame, the resulting parameter is computed from the tracks that are enabled at this frame and that have a keyframe on the center point (e.g: are valid).
Robust Model / robustModel Boolean On When checked, the solver will assume that the model generated (i.e: the Transform or the CornerPin) is possible given the motion of the video and will eliminate points that do not match the model to compute the resulting parameters. When unchecked, the solver assumes that all points that are enabled and have a keyframe are valid and fit the model: this may in some situations work better if you are trying to find a model that is just not correct for the given motion of the video.
Fitting Error (px) / fittingError Double 0 This parameter indicates the error for each frame of the fitting of the model (i.e: Transform / CornerPin) to the tracks data. This value is in pixels and represents the rooted weighted sum of squared errors for each track. The error is essentially the difference between the point position computed from the original point onto which is applied the fitted model and the original tracked point.
Warn If Error is Above / fittingErrorWarnAbove Double 1 A warning will appear if the model fitting error reaches this value (or higher). The warning indicates that the calculated model is probably poorly suited for the stabilization/match-move you want to achieve and you should either refine your tracking data or pick another model
/ transformOutOfDate String   The Transform parameters are out of date because parameters that control their generation have been changed, please click the Compute button to refresh them
Disable Transform / disableProcess Boolean Off When checked, the CornerPin/Transform applied by the parameters is disabled temporarily. This is useful if you are using a CornerPin and you need to edit the From or To points. For example, in match-move mode to replace a portion of the image by another one. To achieve such effect, you would need to place the From points of the CornerPin controls to the desired 4 corners in the image. Similarly, you may want to stabilize the image onto a moving vehicule, in which case you would want to set the CornerPin points to enclose the vehicule.
Set To Input Rod / setToInputRod Button   Set the 4 from points to the image rectangle in input of the tracker node
Export / export Button   Creates a node referencing the tracked data. The node type depends on the node selected by the Transform Type parameter. The type of transformation applied by the created node depends on the Motion Type parameter. To activate this button you must select set the Motion Type to something other than None
Mag. Window Size / magWindowSize Integer 200 The size of the selected track magnification winow in pixels