Enhance video taken with only starlight by using a physics-based noise model

Enhance video taken with only starlight by using a physics-based noise model

Dancing under the stars: video denoising in starlight
arXiv paper abstract https://arxiv.org/abs/2204.04210v1
arXiv PDF paper https://arxiv.org/pdf/2204.04210v1.pdf

Imaging in low light is extremely challenging due to low photon counts.

… demonstrate photorealistic video under starlight (no moon present, <0.001 lux) for the first time.

To enable this, … develop a GAN-tuned physics-based noise model to more accurately represent camera noise at the lowest light levels.

Using this noise model, … train a video denoiser using a combination of simulated noisy video clips and real noisy still images.

… capture a 5–10 fps video dataset with significant motion at approximately 0.6–0.7 millilux with no active illumination.

… achieve improved video quality at the lowest light levels, demonstrating photorealistic video denoising in starlight for the first time.

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Ryan Hutton on Unsplash

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
AI News Clips by Morris Lee: News to help your R&D

I apply innovative technologies like machine learning, computer vision, and physics to further an organization's goals. Am recognized innovator with 66 patents.