Industrial Consultancy & Sponsored Research (IC&SR) , IIT Madras

Method and System for Real-Time Restoration of Images captured in Extreme Low-Light Condition

Technology Category/ Market

Technology: Real-Time Restoration of Images captured;

Industry/Applications: Computer Technology, Computer Software, Photoshop;

Market: The global image capture market is projected to grow at a CAGR of 12.8%  during 2023-2030.

Image Gallery

Problem Statement

  • Eventhough a practical low-light enhancement solution must be computationally fast, memory-efficient, & achieve a visually appealing restoration, existing methods target mostly restoration quality whilst compromising on speed & memory requirements & this raises concerns about the implementation & deployment in real world applications.
  • Moreover, even if the computational aspect is set aside & computational efficiency is not a concern, it is still very challenging to restore images captured in extremely dark conditions.
  • Hence, present invention addresses the problems & can restore an ultrahigh-definition 4K resolution image in real time applications including efficient restoration quality.

Technology

  • The present invention describes a method & an apparatus of real time restoration of images captured in extreme low-light condition. (Refer Fig.1 & Fig.2)
  • Said method comprises a few steps explained and illustrated in figures:
  • In First step explains about capturing at least one image in an extreme low-light condition.
  • The following step describes about the computing an amplification factor based on one or more parameters.
  • Yet further step explains about the amplifying at least one image based on the computed amplification factor.
  • Still next step describes about selecting one or more scale levels from an image scale space, wherein each scale level has a respective high, medium, and/or low resolution with respect to one another, wherein said selection is performed by a by a scale selection unit, and selecting the one or more scale levels from image scale space comprises skipping one or more intermediate scale levels of the image scale space.
  • Further step describes about the parallelly encoding, by one or more encoders, the at least one amplified image at the one or more selected scale levels to restore the captured image with enhanced quality.
  • The encoding the at least one amplified image at higher scale levels comprises simultaneously processing a rectified output and a non-rectified output of convolutional layers present in modified Residual Dense Blocks (RDBs).
  • The modified RDB facilitates better restoration & maintains time-memory complexity efficiently.(Refer Fig.3)

APPLICATIONS:

Proposed invention is applicable in the area of below and related sectors:

  • Smart phone cameras,
  • DSLR cameras,
  • ADAS and automobiles
  • Image Editing/Enhancement software,
  • Photoshop,
  • Computer Technology.

Key Features/ Value Proposition

Technical Perspective:

  • Disclosed invention saves a large amount of time and computational overhead, which is necessary for real-world applications, but also enables accurate low-light image recovery with enhanced image quality. (Refer Fig.2)
  • Especially, said invention can restore an ultrahigh-definition 4K resolution image at 32 fps on a GPU.
  • The enhanced restored image is generated by skipping the intermediate scale level processing and by operating all the encoders (LSE, MSE and HSE) parallelly and independently on the amplified image. (Refer Fig.4)

Industrial perspective:

  • Claimed invention is not only cost-effective, computationally fast and memory-efficient, but also provides an accurate restoration of image captured in extreme low-light condition.

Questions about this Technology?

Contact for Licensing

sm-marketing@imail.iitm.ac.in
ipoffice2@iitm.ac.in

Research Lab

Prof. Kaushik Mitra,

Department of  Electrical Engineering

Intellectual Property

  • IITM IDF Ref. 2176

  • IN Patent No:462334

Technology Readiness Level

TRL-2/3

Proof of Concept ready

error: Content is protected !!