New Neural Network Tech Boosts Resolution Of Any Photo -

New Neural Network Tech Boosts Resolution Of Any Photo

Credit: forbes.com

  • Dec 06 2017 13:25About: 6 days ago
  • 13 views

A group of researchers from Russia’s Skoltech Institute and Oxford University in the UK has developed an almost spookily accurate way of restoring high-quality images from damaged originals using neural networks.

The system, developed by Dmitry Ulyanov, Andrea Vedaldi and Victor Lempitsky, is able to automatically enhance picture resolution, remove image noise and invisibly plug ‘holes’ in damaged photos with striking results.

Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky

Deep Image Prior removing text from an image by intelligent inpainting

Named ‘Deep Image Prior’, the method differs significantly from existing techniques such as those used by Google to enhance low-resolution images on Google+ in that the neural network needs no prior training.

Existing methods typically require a large set of example images from which the neural network can ‘learn’ before it is able to apply this knowledge to new input. However Deep Image Prior skips this stage entirely, generating restored output files from a single input image without prior training.

The results often come very close to the best training-based algorithms and are a huge step up from traditional learning-free methods.

Deep Image Prior can, therefore, be used to improve image quality in a range of scenarios without the need for computationally intensive pre-training or human intervention, whether you want to enlarge a small image, remove noise or repair treasured damaged photos.

Here Deep Image Prior effectively removes the compression artefacts from a highly compressed JPEG image.

Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky

JPEG Artifacts Removal

Here we see Deep Image Prior attempting to reconstruct an image from 50% of the original pixels.

Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky

Deep Image Prior image restoration.

As a further demonstration, the team shows how Deep Image Prior can combine a pair of images, one taken with flash, the other without. This results in a final image with the natural appearance of the non-flash image, but the clarity and detail only present in the flash version. This process has been implemented before, notably in some Nokia Lumia smartphones, but Deep Image Prior improves significantly on the quality of the final result.

Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky

Deep Image Prior flash / no flash combination

There are still significant limitations to Deep Image Prior’s approach. Because it works using only information from within the original image it can’t, unlike pre-trained neural networks, bring in any external knowledge to help it fill in any blanks.

As Dmitry Ulyanov explains, “The obvious failure case would be anything related to semantic inpainting, e.g. inpaint a region where you expect to be an eye -- our method knows nothing about face semantics and will fill the corrupted region with some textures.”

For more details including interactive samples, see Deep Image Prior and this Reddit post from Dmitry Ulyanov.

___

More On Forbes

Samsung's Radical New Smartphone Camera Could Be Headed For Galaxy S9

iPhone 8, iPhone 8 Plus Tests Reveal Apple's Biggest Upgrade

Google's Pixel 2 Secret Weapon Is 5x Faster Than iPhone X

Google's Pixel 2 Has Big Win Over Apple's New iPhones

GoPro Hero6 Black Vs. Hero5 Black: What's The Difference?

GoPro Hero5 Black Vs Hero5 Session: What's The Difference?

Google's Brilliant iPhone App Sucks On Android

Follow Paul on Twitter, Instagram and Google+



Follow Us on Twitter

almost spookily accurate restoring high-quality images from damaged originals using neural networks.

Related stories with New Neural Network Tech Boosts Resolution Of Any Photo

Airtel Rs. 349 Plan Now Offers 2GB Data Per Day, Rs. 549 Recharge Provides 3GB Daily -World News
Airtel Rs. 349 Plan Now Offers 2GB Data Per Day, Rs. 549 Recharge Provides 3GB Daily 6 days ago
Airtel subscribers will get 2GB data per day with Rs. 349 plan and 3GB per day with Rs. 549 pack now, and both packs will come with free outgoing calls on roaming as well.
Google Search Improvements Will Reduce Fake News Results: Shashidhar Thakur -World News
Google Search Improvements Will Reduce Fake News Results: Shashidhar Thakur 6 days ago
Google is taking significant steps to reduce the number of fake news on its search results.
Russia defiant in wake of Olympic ban -World News
Russia defiant in wake of Olympic ban 6 days ago
Russia has rejected the International Olympic Committee's decision to ban its athletes from the 2018 Olympic Winter Games in Pyongchang, South Korea. The decision is the result of accusations that Russia systematically supplied its athletes with...
Holly Willoughby and Phillip Schofield stunned by epic This Morning blunder: 'Oh my god' -World News
Holly Willoughby and Phillip Schofield stunned by epic This Morning blunder: 'Oh my god' 6 days ago
THIS MORNING hosts Holly Willoughby and Phillip Schofield were left stunned today when the programme suffered an embarrassing technical blunder.
Dramatic rescue of 10 men after Cyclone Ockhi capsizes their boat -World News
Dramatic rescue of 10 men after Cyclone Ockhi capsizes their boat 6 days ago
+MANDATORY ON-SCREEN CREDIT: INDIAN AIR FORCE+ Ten fishermen were rescued from a boat that was overturned by Cyclone Ockhi. The intense cyclonic storm has wreaked havoc on parts of India since December 1. A dramatic video shows an Indian Air Force ch
Go-kart racer spins out of control, hitting spectators -World News
Go-kart racer spins out of control, hitting spectators 6 days ago
This is the moment a go-kart racer spins out of control, flying into spectators at high speed. In the video, filmed on December 2 at the Great New York State Fair in Syracuse, a racer is coming around the corner on the oval track before suddenly losing
Germany opens inquiry after train collision injures dozens -World News
Germany opens inquiry after train collision injures dozens 6 days ago
Authorities have said it is too early to speculate what caused the collision between a freight train and a passenger train near Düsseldorf. The driver of the train was praised, however, for preventing a worse crash.
How Many Credit Scores Do You Have -World News
How Many Credit Scores Do You Have 6 days ago
You have more than one credit score. In fact, you may have more than 30. We break down all the different credit scores and what each means to your finances.
Special Report - Inmate deaths reveal 'torturous' use of Tasers -World News
Special Report - Inmate deaths reveal 'torturous' use of Tasers 6 days ago
COLUMBUS, Ohio (Reuters) - Corporal Matthew Stice pointed his Taser at Martini Smith’s bare chest.
Man appears in court accused of trying to kill May -World News
Man appears in court accused of trying to kill May 6 days ago
LONDON (Reuters) - A 20-year-old man appeared in court on Wednesday accused of plotting to kill British Prime Minister Theresa May by first detonating an explosive device to get into her Downing Street office.
Aussie official: Serena 'very likely' to defend -World News
Aussie official: Serena 'very likely' to defend 6 days ago
Defending Australian Open champion Serena Williams looks "very likely" to make her competitive return to tennis in Melbourne, tournament director Craig Tiley said.
Easyjet to take on Lufthansa within Germany starting in January -World News
Easyjet to take on Lufthansa within Germany starting in January 6 days ago
Can the British budget airline ensure that prices don't rocket in the German skies?