Facebook tests tech to help blind people enjoy photos

AP photo

Facebook on April 4  began using artificial intelligence to help people with visual impairments enjoy photos posted at the leading social network.

Facebook introduced machine learning technology trained to recognize objects in pictures and then describe photos aloud.
 
"As Facebook becomes an increasingly visual experience, we hope our new automatic alternative text technology will help the blind community experience Facebook the same way others enjoy it," said accessibility specialist Matt King.
 
The feature was being tested on mobile devices powered by Apple iOS software and which have screen readers set to English.
 
Facebook planned to expand the capability to devices with other kinds of operating systems and add more languages, according to King, who lost his vision as a US college student studying electrical engineering.
 
The technology works across Facebook's family of applications and is based on a "neural network" taught to recognize things in pictures using millions of examples.
 
More than two billion pictures are shared daily across Facebook, Instagram, Messenger and WhatsApp, King said.
 
"While this technology is still nascent, tapping its current capabilities to describe photos is a huge step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," King said.
 
The Silicon Valley-based social network said that it was moving slowly with the feature to avoid potentially offensive or embarrassing gaffes when it comes to automatically describing what is in pictures.
 
Words used in descriptions included those related to transportation, outdoors settings, sports, food, and people's appearances.
 

Continue reading on: