Tracking issue with Broadcast Lens + EZ Track765

 

Our Setup:

- BMD Ursa G1 + Fujinon HA16X6.3BERM + EZ Track 765

Hi there,

We have the Broadcast edition of Aximmetry and we're having issues with setting up a tracked camera with EZ Track. In the "Camera Tracking" node i can peek the data coming in just fine in the Native Transf pin, but when i set up the scene, the zoom keeps jumping, and the focus does also zoom in the image, so both are zooming in or out. I created the Calibration Profile via EZ Profile, and uploaded it into Aximmetry on Device Manager.

Several questions:

- Should I use External Lens Data on or off?

- Must I have billboards with the tracked camera always?

- Whats cause the jitter?

- Should have a zoom device, even if the zoom and focus data is coming via Free-D?

- EZ Track already sends the Delta Cam and Head Transform, should I put any value in Aximmetry the same?

Note: EZ Track is outputing data just fine via Free-D (with some focus jitter, altough, very little)

Tracking issue with Broadcast Lens + EZ Track765

Tracking issue with Broadcast Lens + EZ Track765Tracking issue with Broadcast Lens + EZ Track765

   YAL_user

 
Profile Image
Stefan Reck
  -  

Doing the calibration profile as precise as possible is crucial as Aximmetry has no mechanism for error correction for this. Double check the profile by loading it into Aximmetry basic calibrator and then refine the EZprofile calibration until the tracking "sticks" in there regardless of the zoom level. Take your time, even an experienced tech from EZTrack needs about 1,5 days per lens to get this right. And don't forget to set and check the tracking delay (manually; the detector thing is useless for anything but wide angle lenses)


- Should I use External Lens Data on or off?

Off. This Data is baked into the lens calibration file.

- Must I have billboards with the tracked camera always?

No, and it improves the keying quality, but you will run into issues with edge expand not working and transitions from V CAM to T CAM not rendering the key cleanly. YMMV...

- Whats cause the jitter?

What trackers do you use with EZTrack? HTC Vive trackers jitter a lot, and EZTrack recommends buying through them as they put a custom firmware on that improves performance. We had mixed results with EZTracks own SWAN Trackers; they can cover a bigger area that the HTC Vives, but they are basically still under development and in our case had problems with the tracking precision, especially on longer focal lengths.

- Should have a zoom device, even if the zoom and focus data is coming via Free-D?

No, EZtrack integrates both of this into the Free-D Data stream if it is coming from their encoders. They have to be initialised every time the tracking hub has been powered down though, this is done by exercising zoom and focus through their full range on every tracked camera until you can visually verify that zoom and focus track correctly. Then note down the numbers for the correct raw extreme positions for every encoder in every camera as shown in the EZTrack web interface; this is a quick and easy way to notice immediately if an encoder gearwheel is loose on the shaft or not properly meshing with the lens any more. 

- EZ Track already sends the Delta Cam and Head Transform, should I put any value in Aximmetry the same?

This should be taken care of by printing an origin QR code marker, taping it down on the place in your studio that corresponds with the origin of your virtual set and triggering the origin detection in the tracked camera controls. Depending on the drift of the tracking system you will have to do this quite often. We do it daily...

 
Profile Image
YAL_user
  -  

Thank you Stefan!

We are using the full kit of EZtrack (HUB V2, swan tracker + the base stations (htc but from EZtrack).

The lens is a B4 wide angle:

  1. (wide) Fujinon - HA16x6.3BERM-M58 
    1. 1:18/6.3-101mm

There’s no external encoders gearwheels encoders. Lens send lens data to EZtrack hub via the appropriate cable.

We had the same setup before with Zero Density, but instead the EZtrack HUB v2 (we had the first one) and it worked good (as long as not doing quick moves). 

Tomorrow we will keep digging into this since would like to achieve at least same result as we had with ZD.

Thank you very much.


 
Profile Image
YAL_user
  -  

Hi there,

We've follow your directions and got some good results, altough not perfect. Can you tell us the right order of actions when dealing with the EZ Track software? Because we used the EZ Profile, then EZ Lineup and then Aximmetry Basic Calibrator. Is this the right order of workflow? And do we have to calibrate the entire range of zoom and focus of our lens?

 
Profile Image
JohanF
  -  

There’s no need to use the Aximmetry Basic Calibrator at all in your case. EZ Profile takes care of the lens calibration and EZ Linup calibrates the tracker to camera offset. EZ Lineup will also determine the absolute world zero to based on the position of the EZ Lineup calibration cube, so no need to use the Aximmetry marker world pose method. If EZ Lineup already send world pose to the EZ track system you shouldn’t enter it again inside  Aximmetry. Keep those at zero! Only thing to be aware of is that the floor plane (where the talent is standing) in your UE5 scene might not actually be at world zero. Not accounting for this is probably the biggest cause of tracking issues, so I would suggest checking that in Unreal and move the scene height if necessary. 

;