Cannot get the tracking data into Unreal Engine

 

Hello,

I am trying to record a shot with tracking data and then reproduce the result in Unreal Engine. I understand that the lens distortion data cannot be recorded in FBX file but I cannot get a camera with position and rotation compensated with the value in Aximmetry scene setup, and, I cannot get the focus distance value in Unreal Engine.

The following google drive link is the xdata and FBX file with a movie of program out.

https://drive.google.com/drive/folders/1KKOD6yZPVk0ATYrhBmm7KVad7Ffu2vcy?usp=sharing

See if anyone could help. An additional information is, I can re-render the CG inside Aximmetry with the playback function.

A second question is, can I make a high quality CG render (meaning, the render setting is high enough to make the machine cannot playback in real time) inside Aximmetry? Just like render a sequence in Unreal Engine. 

   KaManC

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

About the FBX file, we already have a conversation going on here: https://my.aximmetry.com/post/1276-i-want-to-export-a-fbx-file-with-all-stu
To add to that, the Focus Distance is not saved into the FBX file, only the Zoom Factor.
If you really want to save lens distortion data and focus distance with the Tracking module/compound and you don't mind the effort, in theory, you could save those into the scale of the Camera Transformation by editing the Record Data. And in Unreal you would need to parse it to your needs.
You could apply the Scene and Origin - Delta Cam Transf offsets in a blueprint of Unreal when using the FBX file, one add/subtract Transformation should be sufficient in the blueprint.

I am guessing running Aximmetry with Unreal high-quality render and Aximmetry waiting for Unreal would be the alternative to saving out everything into Camera tracking FBX. Currently, this would most likely need more effort to do as the FBX option. But it is possible, however, you would have to program both in Aximmetry and Unreal that they need to wait for each other.

If you want to make a high-quality CG render in Aximmetry's own render engine. You can just set the Video recorder to not render in Realtime. And it will render frames as fast as your hardware allows and will record them in the specified Frame Rate:

Like as you said, if your machine is not fast enough to render the scene you would want to do the above. This can be especially true if you want to render the scene in very high resolution and then downscale it.
If you use the above Video Recorder setting with an Unreal project, then anything that uses Game Time in Unreal will not be affected by the increased or decreased render speed. For example, if an object moved in Unreal using Game Time, and you render 1 frame every second with Aximmetry, then the object will move much faster in Unreal than intended.

Warmest regards,

 
Profile Image
S-Virtual
  -  

Hi,

I'm also interested in getting the focus distance and lens distortion data into the fbx file generated by the tracking module. May I ask if you guys find out a way? How would I parse it in Unreal when I import the FBX file into Sequencer?

Many thanks

 
Profile Image
LumiGrade
  -  

Interested in that too

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

We added to our backlog to record focus distance and lens distortion data into the FBX file. We will consider adding it in future releases.

Warmest regards,

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

We're excited to share that the latest version of Aximmetry, version 2023.2.0, has been released today!
The new version of Aximmetry can save Focus Distance into FBX:
Record_3-Audio: added recording of camera focus distance as well when exporting tracking data into FBX. Also added Focus Distance Scale to the TRACKING panel that has to be set manually, because different target third-party applications interpret focus distance differently.

To learn more about all the changes and improvements included in this version of Aximmetry, please visit the following link: https://aximmetry.com/learn/software-version-history/

Warmest regards,