VR background with AR foregrou | Forum

VR background with AR foreground

Back to Posts

Hello Aximmetry

I wonder if it is possible to build VR background mixed with AR foreground at the same time.

I guess as only one camera can be used on a scene, maybe two machine will be required.

I guess;

- two machines. one for background VR+camera input, the other for AR

- same tracking data to two machine(main + AR)

- AR video output to main machine

- blend: VR to foreground, AR video to background --> PGM output.

- how to start at the same time? simple AR would be no big deal, but maybe some moving object will require same start point.

Hope to have your comment.

Thanks in advance.

Bruce

brucekim

Zoltan@Aximmetry

Hi Bruce,

I recommend the other way around. Render the VR on the first machine then send its program output to the other machine (via NDI or SDI), and add AR on the other machine. This way you dont have to deal with transferring any alpha data.

To start two animations on the the two machines at the same time you can use OSC to signal the starting for the other machine (OSC Out on the first machine and OSC Input on the second one). However you have to add artifical delay because of the SDI/NDI transfer latency between the machines.

brucekim

Hi Zoltan

Thanks for your recommandation.

This makes sense a lot more.

Regards.

Bruce

Rain_law

Zoltan@Aximmetry

Can you elaborate on this part? OSC has never understood this before, so I don't know what it is. I saw a document before that augmented reality by using AR modules in axismetry to augment reality, but there are many modules missing in AR, which are completely different from ordinary tracking cameras in a green screen environment, and even more uncontrollable. My reference documentation is the following link：https://aximmetry.com/learn/tutorials/for-aximmetry-de-users/using-tracked-cameras-and-augmented-reality-with-an-unreal-scene/。

Eifert@Aximmetry

Hi Rain,

Looking at this conversation: https://my.aximmetry.com/post/2099-set-a-virtual-object-as-the-foreground
It seems you want a different setup than the one discussed here, so you won't need OSC.

Warmest regards,

VR background with AR foreground

Cookie consent