Tracking with Intel Realsense T-265 and Retracker Software

 

Hi,

due to low Budget (Education/School) we want to use Intel Realsense Tracker-T265 (https://store.intelrealsense.com/buy-intel-realsense-tracking-camera-t265.html)

and

Retracker Software. (https://retracker.co/)

Any experience on this?

Thanks, Gert

   CHS Villach

 
Profile Image
steki0
  -  

Its pretty good, reach out to Marwan directly from his website and he will help you, quickest source of 'how to' etc

https://retracker.co/


 
Profile Image
ericmarodon
  -  

I'm testing the demo at the moment and it looks promising.

BUT I must say the T265 camera is very hard to buy these days. It is being EOL by intel, and the next and last shipment will be in January or February (check on the website).

Add to that the global chip shortage, and and as a consequence, the formerly $200 tracker device is now either out of stock or going for $450 or more. You could order on intel website for $300 if you can wait a month.

I contacted Marwan who told me he was working on making retracker work with other kinds of devices in the future, but so far it's T265 or nothing.

I managed to get one used and I'm trying to get another one, but it's a struggle to find any at a decent price.

Regards


 
Profile Image
CHS Villach
  -  

Thanks for answering. Will contact Marwan.
Found 2 adresses, but as you metioned before the prices are raising.

aprox 350.- Euros and on Stock.

https://www.galaxus.at/de/s1/product/intel-realsense-tracking-camera-t265-kamera-diverse-drohne-zubehoer-14594092?gclid=CjwKCAiAhreNBhAYEiwAFGGKPIwH_XvVd41TBLutQV5qCrFxOPaBedn4NUbgYSWY6s-4_052rvRkuBoC_b8QAvD_BwE&gclsrc=aw.ds

https://www.electronicshop24.at/product_info.php?products_id=30000000005107226&ano=T5107226&mno=82637BRPLHV&ean=5032037148962&ref=geizhals

Sincerely, Gert

 
Profile Image
thehiepvnpakotek
  -  

Hello aximmetry ! I am using Board cast DE trial version. And I have used the calibration camera aximmetry version once and want to calibrate it a second time with another camcorder, it doesn't allow the camera signal to be displayed, can you tell me why? And I check the camera signal into the aximmetry software that has a signal. But when I go to the calibration camera, it doesn't show up. Looking forward to hearing from you soon. Thanks a lot

 
Profile Image
CharlieBG
  -  

Hi 
I got two more no unpack T265 sensors and not use. 
https://www.ebay.com/itm/225010484798
I will sell for 300 USD and I got one or two unpack but work great so will sell for 250 USD. 
Well need to calculate shipping of course.
So if someone interested contact me directly on charlievariysky@gmail.com
Best Regards      

 
Profile Image
thehiepvnpakotek
  -  

Hello !  i'm using the tracking camera T265 but when i calibrate the camera i don't get the camera signal into the software!!  I have turned it off and on again and still no signal.  I'm using aximmetry's Board cast DE trial version.  Can you give me some suggestions?  Thanks

 
Profile Image
TwentyStudios
  -  

You know you’re not supposed to get the video signal from the T265, right? Just the tracking data. What capture card and camera are you using? Do you get a signal from the camera in other apps?

 
Profile Image
thehiepvnpakotek
  -  

I am using a sony PMW z190 camera and when I go to the camera calibration software, it does not receive the signal as shown below.  I've tried using other apps to check the camera's signal, it's still there, even the aximmetry software still receives the camera's signal, only the camera calibration part has no signal.

 
Profile Image
TwentyStudios
  -  

You select the input separately in the calibrator. Try setting it to Auto instead of a specific resolution. Also, don’t use interlaced video on the camera l! That format belongs into the 90’s and will result in suboptimal keying quality. 

 
Profile Image
thehiepvnpakotek
  -  

ok thanks a lot!!  I will try your solution.  If I run into problems, I'll let you know!  Thanks a lot

 
Profile Image
Thong Tan xa Viet Nam
  -  

Hello Aximmetry. I followed your instructions, but when I go to Calibration camera software, my signal is frozen like the video I sent below.

Can you tell me why? Thank you

https://drive.google.com/file/d/1-2Xmkq5giEfPHKQxALgqdIpwQLCNqzL2/view?usp=sharing

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

Is the image frozen when instead of choosing AUTO, you choose the actual resolution and frame rate of your camera's video signal?:

In some rare cases, the AUTO option doesn't work.

Warmest regards,

 
Profile Image
thehiepvnpakotek
  -  

Hello aximmetry!!  I have a problem need your help, when I use the camera calibration software with the tracking camera T265 and the camera I use is sony PMWZ190 I did exactly as required to complete the camera calibration but my tracking still doesn't match when moving.  transfer is still wrong can you explain to me why??  Thank you very much

 
Profile Image
TwentyStudios
  -  

If you post a video of the issue it’s easier to determine what’s wrong. Have you adjusted the tracking delay in Aximmetry?

 
Profile Image
Thong Tan xa Viet Nam
  -  

You can visit the link below to tell me more reasons!! Currently I am using sony camera PMWZ190 so I can't find senson's parameters so I'm leaving default !! Thank you very much!!

https://drive.google.com/file/d/1-metWqFXar2U7Oj1HvXmMHs16KiDAX9b/view?usp=sharing

 
Profile Image
Thong Tan xa Viet Nam
  -  

Hi Aximmetry!! Are you still healthy these days?

I don't know if you have seen the error that I sent to you above? If you watch it, can you point out the errors to me? Thank you very much and I await your reply!!

 


 
Profile Image
Eifert@Aximmetry
  -  

Hi,

We are all well, some of us were taking healthy summer holidays.

You should set the video delay to zero, you almost never need to change that. Instead, just change the tracking delay.
Sadly, that is not the only problem here.

Note, that when turning off T265, it will reset its tracking data. So you will have to reposition the floor (scene).
If you could share the calibration file, that would help a lot in finding the source of the issue. You can export it using the Camera Calibrator:


The Sensor width doesn't affect the accuracy of the calibration and tracking. If you give incorrect values, the shown focal length values in Aximmetry won't be the same as the real-world focal length. Since PMWZ190 is a 1/3-type 3 CMOS sensor, it probably has a diameter of around 6 mm, much less than other sensors. You could ask the manufacturer for an accurate size.

Warmest regards,

 
Profile Image
Thong Tan xa Viet Nam
  -  

Hello Aximmetry! Are you still healthy? I sent you the camera Calibration file, can you check the errors for me? Thank you very much ! Have a good day! https://drive.google.com/file/d/1gy54gdjIWQTZBvUjPPF6QHQhnxifUbUC/view?usp=sharing

 
Profile Image
Thong Tan xa Viet Nam
  -  

Hello

How are you ? I know your work is very busy these days, but if you could, could you spare me a little time about the problem I sent you above? I am very concerned about the above issue and hope to receive your response as soon as possible!! Thank you for spending some time with me!! Wishing you a happy working week!!

 

 
Profile Image
TwentyStudios
  -  

@Thong Tan xa Viet Nam: Are you sure you’re using a properly printed calibration board? It needs to be exactly the dimensions as specified by Aximmetry. Taking the PDF to a professional printing service is recommended, as well as measuring it to verify that it’s correct. 

Like Eifert described, you will have to re-set the world pose each time you restart the T265. I would recommend using a more professional solution like ReTracker Bliss instead. 

 
Profile Image
Eifert@Aximmetry
  -  

Hi Thong Tan xa Viet Nam,

The delta head position distance is quite big in the calibration file: DeltaHeadPos="-2.714379, -35.67954, 232.2937"

DeltaHeadPos is the distance between your camera and your tracking device in centimeters. This means that your tracker and your camera are more than 2 meters apart if your calibration file is correct. As TwentyStudios said, this could be the result of an incorrectly printed calibration board.

Other than that, I didn't see anything wrong in the calibration file.

Warmest regards,

 
Profile Image
Thong Tan xa Viet Nam
  -  

Thanks Eifert@Aximmetry!!!

I also have a question about virtual production to ask you. I use the NewTek Tricaster TC410 Plus mixer combined with Aximmetry for virtual production.

When I put the signal from the Aximmetry PC into the Tricaster 410 mixer, I found that when using virtual cam motion, my virtual cam lines were jerky and not smooth. Do you know why? You can watch the video I sent at the link below!! Thank you very much, looking forward to hearing from you soon!!

https://vnews.gov.vn/video/menh-lenh-tu-trai-tim-71083.htm

 
Profile Image
TwentyStudios
  -  

@ Thong Tan xa Viet Nam: Are you sure you have everything set to the same frame rate? Camera, Aximmetry project settings and the Tricaster?

What are you using to capture the video from the camera and output the video from Aximmetry to the Tricaster?


What is your CPU/GPU load?

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

Note that the video/animation in the lower third is also not smooth:

Maybe the virtual cam being not smooth has the same underlying issue. Like the possible issues TwentyStudios mentioned.

Also, the keying could be better if you are using Aximmetry for keying. We have these two detailed pages about keying:
https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/green-screen-production/virtual-camera-workflow/prerequisites-of-a-good-keying/
https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/green-screen-production/virtual-camera-workflow/keying/

Warmest regards,