Multicam, fill control and 360 player

 

Multi-Machine Camera Tracking:

We have successfully set up a multi-machine system but are encountering limitations in tracking two different cameras on two different computers simultaneously. The camera tab in the LEDWall tool currently only allows for switching between cameras, not rendering two different ones concurrently. Despite this, we can output two distinct tracked Unreal feeds from the two computers.


Our goal is to have one computer render from one camera and the other from a different camera. We’ve tested this by using the Composer app on both computers and feeding one computer’s feed to the other, and it works, but it’s not a streamlined solution. The tracking information is available to both machines, but we need a way to specify that one machine tracks one camera while the other tracks a different camera. Is there a way to achieve this? Could a composition or script be created to enable this functionality?


Outer Frustum Control (Fill Control):

We need to control the outer frustum (fill) with a custom image or video to minimize flickering. Using different outer frustums increases flickering for the talents. While we can feed the fill with an image or video, it gets distorted by the wall setup. Our goal is to feed the entire canvas with a video source without any wrapping or distortion. Currently, feeding the fill with an image or video results in an offset display, likely due to how the software handles the input. How can we make the fill display content accurately, without the software assuming it needs to wrap around or adjust the feed?


Displaying 360 Content on a 180-Degree Wall:

We are exploring the best way to display 360 content on a 180-degree circular wall. This is important for some of our creative filmings. What is the recommended approach for achieving a seamless display of 360 content on a 180-degree setup? Any guidance or solutions you can offer would be highly valuable.


   mathiashaughom

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

The biggest problem with rendering two different camera perspectives concurrently on the LED Wall is that the LED Walls display one image at a time. There are some ways to partially mitigate this fundamental limitation of LED Wall productions. For example, having very careful camera operators who ensure their cameras' perspectives never cross. We might be able to provide a solution depending on how you want to overcome this limitation.

Also, note that the latest version of Aximmetry (2024.2.0) supports camera inputs running on different remote computers in LED Walls:


This allows switching between them and not concurrent rendering.


Regarding the Fill control, there is an option to Freeze the Fill:
Multicam, fill control and 360 player
This should stop the flickering, but it will also stop the Fill from updating.
You can also do this per LED Wall in the LED Wall panels, instead of applying it to all LED Walls in the above image.

If you are experiencing flickering when getting too close to the LED Wall or being enclosed by it, you can fix it by using multiple LED Wall panels, then use a sticker module to stitch them together before outputting them. If you can describe in more detail the kind of flickering you experience or show a video of it, I can better determine if this solution is appropriate. If it is something else, I am still confident that we can come up with a solution that won't require you to change the entire Fill.



Regarding the 360 content, I am assuming it is a video or video stream. You can make a skybox from it, as discussed here: https://my.aximmetry.com/post/1951-is-it-possible-to-use-a-360-degree-image
There is even more information about using 360 content for LED Wall production here: https://my.aximmetry.com/post/2527-360-degree-video-on-led-wall

Warmest regards,




 
Profile Image
mathiashaughom
  -  

Perfect! Thank you very much.

The concurrent camera rendering is because we are using frame remapping/ghost frame. Because the cameras are synced to different subframes, we can overlap the fustums without a problem. How can we make a good solution for rendering concurrently 2 different camera angles on two different computers? Can you make a custom script for us?

I cant seem to find the 2024.2 version anywhere. When will it be available? 


Fill:

We really just need the fill to be customizable with an custom image. We can do this by just feeding the image into "F1 Rendered" but then it get distorted. 


Thank you for the 360 answers!


Regards, Mathias Haughom.

 
Profile Image
Eifert@Aximmetry
  -  

Hi Mathias,

Since version 2024.2.0 is still in beta, it is only available through the downloads page: https://my.aximmetry.com/User/MyDownloadshttps://my.aximmetry.com/User/MyDownloads


Subframe:

If your hardware handles the subframes, and you only need to provide videos for the different subframes, then there's an easy solution for this. You don't even need to edit the camera compound.
To accomplish this, you need to hijack the Playlist Select Cam feature.
First, turn it on in the CAMERA MODE panel:
Multicam, fill control and 360 player

Then, add the following logic to switch which camera input is active on the specific computers:
Multicam, fill control and 360 player

This should work with two computers as long as you correctly set the Cam Engines in the SELECT CAMERA panel:
Multicam, fill control and 360 player

Additionally, you must copy the settings of the LED Walls you use to unused LED Wall panels:
Multicam, fill control and 360 player
And set its Engine to the engine you use for the second CAM.
Multicam, fill control and 360 player

This method can extend beyond two computers. For example, in the switch module, you could add more subframes (Camera Inputs).
By editing the camera compound, you could also make it unnecessary to copy the LED Wall settings. However, I wouldn't suggest editing the LED Wall compound for this purpose if you have enough LED Wall panels to copy to, as this kind of sub-framing will likely be built into the LED Wall in the near future.


Fill:

Regarding the custom image on the Fill, if it doesn't matter that the image is visible on the Frustum, the solution is simple. Just place the image on the LED Wall's input before it goes out:

However, I assume you don't want it to show up on the Frustum. In that case, the solution is a bit more complex, as the Frustum and Fill are mixed by a shader. Probably the easiest solution is to duplicate the shader and its modules to use it as a mask by feeding in a solid white image for the fill and a solid black one for the Frustum.
First, you should understand how linked compounds can be edited and how to create a hierarchy of compounds. You can read about it here: https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/scripting-in-aximmetry/flow-editor/compound/https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/scripting-in-aximmetry/flow-editor/compound/

Inside the LED Wall camera compound, you can find the logic you need to edit at: LED WALLS/LED Wall %N=1/FINAL.
Duplicate the logic and use it as a mask like this:
Note that this will not change what you see in the STUDIO preview; it will only affect the image that goes out to the LED Wall.

Instead of having an image or video module there, the best approach is to use a Transmit Video module to feed in the custom fill image from outside of the camera compound. More on the Transmit module can be found here: https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/scripting-in-aximmetry/flow-editor/pin/#transmit-modules


After this, you can apply the changes to every LED Wall panel and its logic by unlinking the LED Wall %N=1/ compound you edited:
Multicam, fill control and 360 player

Then save it somewhere outside the built-in Aximmetry libraries as a new compound:
Multicam, fill control and 360 player

Then, you can select all the other LED Wall compounds to change their Import Source to the new compound file:

Keep in mind, that you will likely need to redo everything above for the custom Fill image each time you update Aximmetry, as these compounds are typically changed in every release.

Warmest regards,