About the Unreal AR with tracking cam virtual set

 

Hello,

We're testing the Unreal track cam, it works, but we want to add the AR object on the top with the unreal engine render, I already add the AR camera at the editor, and it only had the AR render only, it's that right? if we need the unreal AR and the unreal VS I need 2 pc to do that? so how do I merge it? 

Thank you.

Best,

Ivan

   O Plus

 
Profile Image
O Plus
  -  

Hello,

In this case, Do I need another render engine to render the AR object at the front? Just like https://aximmetry.com/learn/tutorials/for-studio-operators/using-led-walls-and-ar-together/, So how do I merge The AR and the VR output? 

Best,

Ivan

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

Yes, to render with Unreal twice, you need two machines.

Couldn't you put the AR graphics into the same Unreal scene as the tracked camera scene? So both would be rendered by the same tracked camera.
If not, why it is so, we might be able to figure out a solution.

Otherwise, you can use the setup detailed here: https://aximmetry.com/learn/tutorials/for-studio-operators/using-led-walls-and-ar-together/#using-two-machines but instead of the led wall transmitting the video from one computer to the other, you will probably want to use NDI or capture cards between the computers to transmit the video.

In the Manage Devices you can set NDI output:

Also, you could use Aximmetry to render the AR objects, and then there is no need for two computers.

Warmest regards,



 
Profile Image
O Plus
  -  

Hello,

Yes, I put the AR graphics into the same Unreal scene as the tracked camera scene, it's the same scene, and there is two PC output, Do I need to output to the mixer to merge together? or Just output the AR graphic to the virtual set PC, and use the overlay node to merge it?


Best,

Ivan

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

You should only put the two scenes into one if you plan to use it with one tracked Unreal camera.
Otherwise, you will need two different scenes with different cameras, one with the AR camera and one with the tracked camera.

I was suggesting using only one scene with a tracked camera, cause that way you could run it all on one computer. If you only want the AR to appear over the billboards-talent, then tracked camera is enough. If for example, you want the billboard to step out from virtual reality into the real world, and have AR graphics over the real-world studio, then you will need an AR scene too. And this AR scene will have to be rendered by a different computer if it is done in Unreal.
Maybe I am misunderstanding something why you need this setup exactly, if you can detail a bit more what is your vision, I might be able to give better tips.

Yes, on the computer with tracked camera virtual reality you will have to connect the AR video to the Overlays pin of the tracked camera compound.

Warmest regards,

;