Reperformance: HDSDI Metadata SMPTE315M

{{LEFT}}

Previzion Embedded Metadata

As of build 6710, Previzion’s SDI output has all tracking data embedded in its video outputs. This is valid for both SDI outputs and embeds all tracking data, like x/y/z location, tilt/roll and lens information.

The data is embedded in ANC packages in line 10 using SMPTE 315M-2004 format.  The process of utilizing a recorded video with tracking metadata into Previzion is referred to as reperformance.

This feature allows Previzion users to literally bring their Previzion systems into the post-production environment.

Embedded metadata has the potential to change the way current virtual productions deal with their assets and Lightcraft is working on more tools to improve the VFX world.

The actual specifications can be downloaded from Dashboard through this link.

How does reperformance work?

The embedded metadata is frame accurate and is recorded alongside your footage.  Using a supported recorder and your Previzion system, you can replay “foreground” (a clean green screen feed) and set all your Previzion settings with the advantage of having more time to adjust the settings.

With simply the HD video recorder and your Previzion box, you can replay the clean green footage and set your key, load relevant scenes, move cameras, change lenses (if necessary) and so on.

Reperformance, playing back through Previzion, cannot refine tracking afterwards.  It’s most useful when tracking is working correctly and all that is needed is to key, color and/or add mattes.

For more tools and tracking refinements, consider using a metadata extractor in our Nuke pipeline (see Nuke Embedded Data Import).

How can I confirm I am recording the tracking data?

Since the recorders that are able to capture and store 315M ANC data can’t indicate the presence of SMPTE 315M data, the only reliable way to confirm presence of the data is to play it back into Previzion as indicated below in “Recommended Settings”.

Please note that many video converters, splitters and embedders often strip all ANC data, which may include timecode.  In these cases, make sure to bi-pass such devices to ensure the data is being passed through properly.

 

Supported Recorders

Lightcraft is actively in conversations with various HDSDI field recorder manufacturers to implement support with SMPTE315M and reperformance.

Please reference the table below to see if your recorder supports this feature:

 

Recorder Support 315M Untested
Pix 220i No
Pix 240i (v.3.5.1 or above) Yes**
Pix 260i (v.2.0.0 or above) Yes**
AJA Ki Pro (3.2.0.17 Tested) Yes
AJA Ki Pro Mini (4.2.0.13 Tested) Yes
AJA Ki Pro Quad (5.2 tested) No
AJA Ki Pro Rack (4.2.0.25 Tested) Yes
QTake HD (custom firmware) Yes
AJA Kona Card (AJA Recorder) O
ATOMOS Samurai Blade No
Blackmagic Design HyperDeck Shuttle No
Blackmagic Design HyperDeck Studio No
Cinedeck EX No
Cinedeck RX (3G/AES) O
Cinedeck MX O

 ** frame-by-frame tracking position may be recorded as ANC with a few frames offset.  This is not usable for “reperformance,” but it’s usable for tracking data extraction.

We are currently working with video recorder developers to add support to this feature, test and implement recording/playback to their specific recorders.

If you are planning on using a recorder and would like to have this feature supported, please contact support (at) lightcrafttech.com and let us know which recorder you are using.
{{RIGHT}}

Recommended Settings

For this setup, we recommend setting the HDSDI output from Previzion to be set to “Foreground” (clean green feed).

 

All you need to do is plug the recorder, like an AJA KiPro, into your Previzion HDSDI IN 1 and set as:

  • Sync: Generated
  • Location: Previzion Video
  • Lens: Previzion Video

  • Video Input Format: the correct video frame rate
  • HD-SDI 1: Enabled
  • There should be no error lights on.  However, please not that you may see “Timecode Repeating” light up when the video is paused, meaning that the timecode is paused at a given frame timecode address.
 Once this is setup, you can treat the footage as you would a Previzion camera.

Workflows

All in Previzion

  • Record the “Foreground” (green screen) feed to a 315M enabled video recorder down stream from Previzion during production
  • Plug the 315M enabled video recorder into the Previzion “Input 1”, and switch all the trackers to “Previzion Video”
  • Switch Previzion’s “Output 1″ to “Composite”
  • Play back the 315M enabled “Foreground” footage
  • Record the new comp on a second recorder connected to output 1

Using an external Keyer

  • Record what ever feed you want onto the 315M enabled video recorder, as long as it passed through Previzion during production
  • Plug the 315M enabled video recorder into the Previzion “Input 1”, and switch all the trackers to “Previzion Video”
  • Switch Previzion’s “Output 1” to “Scene” (3d only)
  • Connect a second recorder to “Output 1” in order to record the “Scene” feed
  • Composite green screen footage from the camera’s internal recorder, or a non 315M source with Previzion “Scene” footage in After Effects, or Nuke.  The compositing process will be normal 2D compositing that is already tracked, and timecode matched.