LEDWall + Chromakey

Studio Operators Content Creation Node System NDI Virtual Camera Camera Tracking Augmented Reality Unreal

 

Dear,

I would like to combine three layers in one XR studio setup:

- LED Wall for background and ceiling

- 3D elements in front of set

- Chromakey part of teh studio where I want to use green or blue (mainly floor) 

Is this combination possible with Aximmetry?

Do I need three or more machines/PCs to do this?

Could I do multi camera (3) production in such setup?

Regards,

andrej

   Andrej360

 
Profile Image
Eifert@Aximmetry
  -  

Hi Andrej,

Yes, all of this is possible.

In the case of 3D elements in front of LedWall and the set, if you are using Unreal for both (3D elements and LedWall), you will need to use 2 machines. Like this: https://aximmetry.com/learn/tutorials/for-studio-operators/using-led-walls-and-ar-together/
In other cases, you can combine camera compounds within one compound on one computer. This will need some editing in the Flow Editor with nodes, as there are no fully ready-made solutions for such complex XR setups. We can help with that here on the forum or you can ask for more tailored help from sales@aximmetry.com.

For each virtual camera perspective, you want to render simultaneously with Unreal, you will need one computer. As you can render only one Unreal camera per computer.

Also, you should consider the requirements of the Led Walls. Can one computer render your scene for all the Led Walls at their resolutions? Note however there are ways to render fewer pixels in our LedWall compounds than the actual Led Wall resolution.
And can one computer have enough video output hardware to connect to all the Led Walls and also receive the inputs?

Warmest regards,

 
Profile Image
Andrej360
  -  

Dear,

Thank you very much!

Could I ask here on forum what would be your suggestion for HW setup:

14x4m LEDwall, 5x5m ceiling LED, 3x3m moving LEDwall for reflactions

max three cameras with FreeD (one camera with nCam, not used together with FreeD)

UR render

How many PC and licenses we need?

Could I include RTX4090 GPU already?

 
Profile Image
Eifert@Aximmetry
  -  

Hi Andrej,

For the LED walls, you need to know the pixel amount or resolution, like 4K UHD which is 3840 × 2160 pixels. The physical size alone doesn't say much. Also, it depends on various other factors, like how many capture cards can you put into one computer with how many output and input slots per capture card, what is the maximum resolution you can render your scene at without frame drop and how will you use the fill: https://aximmetry.com/learn/tutorials/for-studio-operators/using-led-walls-for-virtual-production/#fill-rendering (you can save on GPU processing power by reducing the Fill Resolution Mul parameter)

In the case of the cameras and tracking. Do you want to simultaneously render with Unreal more than 1 output (Virtual world camera's view) with a tracked camera compound? If yes, then you will need one broadcast license per such output.
I forgot to mention in the previous post, that this is not possible with the Led Wall compounds. It would be only possible with tracked cameras that only use Chromakeying. It doesn't make much sense in the case of Led Walls, as you can not render and display 2 different camera perspectives at the same location on the Led wall.
Note that, you can still set the 3 camera inputs into the Led Wall compound, but you will only use one of the Camera's inputs. While you can preview what the other cameras look at in the real world in the Matrix view.

So you will need 2 computers and 2 broadcast licenses if you plan to use the solution here: https://aximmetry.com/learn/tutorials/for-studio-operators/using-led-walls-and-ar-together/#using-two-machines plus additional computers and broadcast licenses if all your Led Walls can not be done with one computer.
You need a broadcast license per computers that are using Led Wall render.

Note that your floor chromakeying would also happen on the machines that render the LED wall and that will add some additional resource drain on your computer's CPU and GPU. The chromakeying will need some modifications in the actual LED wall compound, but we will be able to help with it here.

We can not give any guarantees on the RTX4090 GPU as it is too new. But of course, we plan to fully support it in the future.

Warmest regards,