Replacing Camera footage in a post production workflow

 

Hey all, Im working on a project where we recorded the takes both in aximmetry w/tracking data and also in camera. What i would like to do is replace the reference footage with the higher quality camera footage that has been processed and keyed with a different software.  But I have been having trouble finding the right codec with an alpha channel that works in aximmetry and syncs back up with the Tracking data.

the method i have been using is to line up the camera footage with the ref footage on the same timeline and export the new processed file making sure its the same exact length as the ref, then I rename the new file the same as the ref and put it in the same folder as its .xdata counterpart. but this only works if I encode it as the same exact codec as the ref file.  the ref files were recorded as .mov using DNxHD codec at 1080p 24. but I  would like to replace it with a .mov using DNxHR codec with alpha at 2160p 24.  or Cineform w/alpha. 

when playing back the new files with the preferred codecs in aximmetry it plays the video file perfectly fine but no longer plays with the tracking data.  is this workflow even possible, if so does anybody have some insight how to do this correctly?

   SAV System

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

We were able to playback different encoded videos with the same .xdata. (even DNxHR and DNxHD and with different frame rates and resolution)
Can you provide more information on the issue. Are you gettings any error logs or messages in Aximmetry, like:

Which camera compound are you using and what kind of program or encoder (like FFmpeg) did you use to encode the video?

Warmest regards,

 
Profile Image
SAV System
  -  

actually I don't get any error messages and the video file plays back with no issue, but the linked tracking data no longer plays.   I'm currently using the "MixedCam_Unreal_A+B_8+8-CAM" I've tried all rest of the tracked camera compounds with the same results. Im using DaVinche Resolve to encode and edit 

 
Profile Image
DeataProduction
  -  

Have replaced the footage linked to .xdata and so far have not had issues despite the replaced footage being of different framerate/resolution or even container 

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

DaVinci Resolve overwrites the timecode of the video. So you have to change the Starting Timecode of your Timeline to your clip's timecode:
By default, DaVinci has starting time that starts from hour 1 and not 0. Also, it is likely you did not start recording from the first second of the timecode. To see where your timecode starts from, check your clip's Start TC:

Write this Start TC into the Start Timecode of the timeline:


And you are good to go in most cases. Also, keep the same frame rate as the recorded video.


If you are using multiple clips and you want to place them in the right place in the timeline.
Then beware that DaVinci does not add the clip to the correct timecode position if you drag-and-drop the clip into the timeline.
Instead, you will have to add the clip to the timeline by the Insert Selected Clips to Timeline Using Timecode option while being in the Cut section of the DaVinci:


If you are using interlaced video, then you have to enable interlaced processing on your timeline:
Right-click your timeline in the media and select Timeline Settings:

Untick Project Settings.
And select Enable Interlace Processing:

Warmest regards,




 
Profile Image
TwentyStudios
  -  

@Eifert: What does interlaced processing have to do with timecode? If the footage is shot progressive, wouldn’t enabling interlaced video mess with the image quality?

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

You are right TwentyStudio, it is only needed if you were recording the tracking with interlaced video.
DaVinci confused me as it automatically converts the video to progressive and even in the Clip Details it writes progressive after that.

Updated my previous comment.

Warmest regards,


 
Profile Image
TwentyStudios
  -  

@Eifert: Great! But no one should be using interlaced footage in 2022! Interlaced belongs to the age of CRT screens and makes no sense on LCD or Oled screens.