Nvidia Broadcast Camera Support?

 

I have been using Nvidia Broadcast to clean up audio and it works perfectly as an input in Axi.

I am very interested in using it to clean up my camera input as well. Unfortunatelly Nvidia Broadcast virtual camera source is not seen by Axi. Can this be implemented?

Thank you


   magician

 
Profile Image
TwentyStudios
  -  

The Nvidia denoiser is probably not as good as the temporal denoiser in Aximmetry, at least for good quality sources.

 
Profile Image
magician
  -  

@twentyStudios This is for a different use case. I am not interested in the denoiser. I want to use the Nvidia Broadcast body segmentation filter.

 
Profile Image
TwentyStudios
  -  

Ah, I interpreted “clean up” as denoising. Body segmentation in Aximmetry would be great. 

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

To my knowledge, you can only remove the background with NVIDIA Broadcast. It won't show the actual segments of the body.
However, one of NVIDIA's SDK-s can probably do body segmentation in real-time, and we actually have these SDK-s on our request list: https://my.aximmetry.com/post/432-nvidia-broadcast-engine-sdk 

Warmest regards,

 
Profile Image
magician
  -  

@Eifert, Thank you.

My use-cases are supported with the current version of Nvidia Broadcast (person segmentation and eye contact specificaly) I am not interested in SDK access within Axi.

Nvidia Broadcast integrates as a virtual camera driver in client software, that driver is currently not supported by Axi. I would like to use Nvida Broaddcast in Aximmetry. Is this something that could be supported before too long?


 
Profile Image
Eifert@Aximmetry
  -  

Hi,

The virtual camera driver is also on our request list as it has been requested before: https://my.aximmetry.com/post/2129-can-aximmetry-output-virtual-camera 
I bumped the request based on your post in our request list.

Also, you can use a workaround, which would be to use an application like OBS to receive the signal from Nvidia Broadcast and then stream it via NDI to Aximmetry.

Warmest regards,

 
Profile Image
Eifert@Aximmetry
  -  

Hi,

I forgot about this when writing my previous comment: the Nvidia Broadcast will work directly in Aximmetry when using the /dshowlegacy command line switch:
https://aximmetry.com/learn/virtual-production-workflow/preparation-of-the-production-environment-phase-i/scripting-in-aximmetry/command-line-switches/ 

Warmest regards,

 
Profile Image
magician
  -  

Hi Eifert,

/dshowlegacy does not work for me and results in a crash.

Any updates on this request to directly access the Nvidia Broadcast virtual camera? The roundtrip to OBS and ingest via NDI is not an ideal use of processor bandwith and requires a higher Aximmetry license tier.  

Thank you,
Marco

 
Profile Image
Eifert@Aximmetry
  -  

Hi Marco,

We are looking to gather more specifics regarding the instances when Aximmetry experienced crashes while using the /dshowlegacy command line switch. Could you also provide details on any occasions in which you encountered difficulties utilizing the /dshowlegacy functionality?

Additionally, we kindly ask you to send any crash dump files to sales@aximmetry.com. We thoroughly investigate each file to improve our system and prevent future issues.

Regarding the Nvidia Broadcast virtual camera, although there is no new development to share at the moment, please be assured it is on our request list, including that it was requested by several users.

Warmest regards,

 
Profile Image
Eifert@Aximmetry
  -  

Hi Marco,

We are pleased to inform you that the crashes you have experienced related to /dshowlegacy have likely been addressed in the latest Aximmetry release, version 2023.3.1.

The following two crashes have been fixed:
Fixed that AUTO mode was not handled properly for DirectShow devices in /dshowlegacy mode, causing crash in some cases.
Fixed crash when using OBS Virtual Camera as input (only available in /dshowlegacy mode).

Warmest regards,