The best way is to get rid of the noise by adjusting your camera iso and exposure settings. The built in noise reduction in Sony cameras are also really effective.

Aximmetry also has a great temporal noise reduction that you can apply pre-keying or even just to the alpha mask (if you edit the keyer compound).

Thanks Johan, works great now