Accessibility’s nextgen breakthroughs will be literally in your head

Published October 5, 2020

Jim Fruchterman
Contributor

Jim Fruchterman is the founder of Tech Matters and Benetech, nonprofit developers of technology for social good.

More posts by this contributor

A $6 trillion wake up call for the tech industry

Predicting the future of technology for people with visual impairments is easier than you might think. In 2003, I wrote an article entitled “In the Palm of Your Hand” for the Journal of Visual Impairment & Blindness from the American Foundation for the Blind. The arrival of the iPhone was still four years away, but I was able to confidently predict the center of assistive technology shifting from the desktop PC to the smart phone.

“A cell phone costing less than $100,” I wrote, “will be able to see for the person who can’t see, read for the person who can’t read, speak for the person who can’t speak, remember for the person who can’t remember, and guide the person who is lost.” Looking at the tech trends at the time, that transition was as inevitable as it might have seemed far-fetched.

We are at a similar point now, which is why I am excited to play a part of Sight Tech Global, a virtual event Dec. 2-3 that is convening the top technologists to discuss how AI and related technologies will usher in a new era of remarkable advances for accessibility and assistive tech, in particular for people who are blind or visually impaired.

To get to the future, let me turn to the past. I was walking around the German city of Speyer in the 1990s with pioneering blind assistive tech entrepreneur Joachim Frank. Joachim took me on a flight of fancy about what he really wanted from assistive technology, as opposed to what was then possible. He quickly highlighted three stories of how advanced tech could help him as he was walking down the street with me.

As I walk down the street, and walk by a supermarket, I do not want it to read all of the signs in the window. However, if one of the signs notes that kasseler kipchen (smoked porkchops, his favorite) are on sale, and the price is particularly good, I would like that whispered in my ear.
And then, as a young woman approaches me walking in the opposite direction, I’d like to know if she’s wearing a wedding ring.
Finally, I would like to know that someone has been following me for the last two blocks, that he is a known mugger, and that if I quicken my walking speed, go fifty meters ahead, turn right, and go another seventy meters, I will arrive at a police substation!

Joachim blew my mind. In one short walk, he outlined a far bolder vision of what tech could do for him, without bogging down in the details. He wanted help with saving money, meeting new friends and keeping himself safe. He wanted abilities which not only equaled what people with normal vision had, but exceeded them. Above all, he wanted tools which knew him and his desires and needs.

We are nearing the point where we can build Joachim’s dreams. It won’t matter if the assistant whispers in your ear, or uses a direct neural implant to communicate. We will probably see both. But, the nexus of tech will move inside your head, and become a powerful instrument for equality of access. A new tech stack with perception as a service. Counter-measures to outsmart algorithmic discrimination. Tech personalization. Affordability.

That experience will be built on an ever more application rich and readily available technology stack in the cloud. As all that gets cheaper and cheaper to access, product designers can create and experiment faster than ever. At first, it will be expensive, but not for long as adoption – probably by far more than simply disabled people – drives down price. I started my career in tech for the blind by introducing a reading machine that was a big deal because it halved the price of that technology to $5,000. Today even better OCR is a free app on any smartphone.

We could dive into more details of how we build Joachim’s dreams and meet the needs of millions of others of individuals with vision disabilities. But it will be far more interesting to explore with the world’s top experts at Sight Tech Global on Dec. 2-3 how those tech tools will become enabled In Your Head!

Registration is free and open to all.

OrCam Technologies co-founder Amnon Shashua to speak at Sight Tech Global

Published September 3, 2020

If the measure of progress in technology is that devices should become ever smaller and more capable, then OrCam Technologies is on a roll. The Israeli firm’s OrCam MyEye, which fits on the arm of a pair of glasses, is far more powerful and much smaller than its predecessor. With new AI-based Smart Reading software released in July, the device not only “reads” text and labels but also identifies people by name and describes other important aspects of the visual world. It also interacts with the user, principally people who are blind or visually impaired, by means of an AI-based smart voice assistant.

At the upcoming Sight Tech Global virtual event, we’re pleased to announce that OrCam’s co-founder and co-CEO, Professor Amnon Shashua, will be a featured speaker. The event, which will take place virtually on December 2-3, is focused on how AI-related technologies will influence assistive technology and accessibility in the years ahead. Attendance is free and pre-registration is open now.

Shashua is a towering figure in the technology world. He is not only the co-founder of OrCam but also Mobileye, the company that provides the computer-vision sensors and systems for automotive safety and autonomous navigation. Intel acquired Mobileye for $15.3 billion in 2017, the single-largest acquisition of an Israeli company ever.

Shashua started OrCam at the prompting of his aunt, who was losing her sight and hoped that her technologist nephew could apply his prodigious talents as a scientist and AI expert to help. With that goal in mind, he started OrCam in 2010 with co-founder Ziv Aviram. The firm has gone on to raise $130.4 million dollars from investors, including Intel, and sell the OrCam MyEye device to tens of thousands of users in over 50 countries. At $3900 per device in the U.S., the OrCam MyEye is far from affordable for most people, but the firm says the device price will come down as production increases.

At the start of a new era for assistive technology, OrCam’s approach with the lightweight, offline-operating OrCam MyEye is nothing if not thought provoking (the device was recognized as a TIME Best Invention of 2019). Will miniaturization of sophisticated sensors and electronics lead to unobtrusive sensor arrays as the foundation of assistive tech? Will the AI-based natural-language processing lead to an all-purpose, customizable personal assistants that work with abilities as needed?

“In OrCam’s roadmap,” says Shashua, “the ultimate AT must have the right balance between computer vision and natural language processing. For example, the “smart reading” feature recently launched harnesses NLP (natural language processing) in order to guide the device to which text information to extract and communicate to the user. NLP allows the user to specify precisely what he/she needs to know. For example, the “orientation” feature recently launched allows the user to prompt the device to describe the objects in the scene and to provide audible guidance to those objects. We see the “orientation” feature growing with respect to vocabulary, with respect to search (e.g., “notify me when you see a Toilet sign”), and with respect to obstacle avoidance (where is the free-space in the scene). The technological challenge in bringing these desires into reality critically depends on the progress of compute and algorithms.

“By ‘compute,’” says Shashua, “I mean the ever-growing trend to miniaturize processing power enables more sophisticated algorithms to reside on smaller and battery-powered footprint. By “algorithms” I mean the ever-increasing sophistication of deep-tech to mimic human intelligence. Combining the two creates a powerful impact on the future of assistive tech for people who are blind and visually impaired.”

Shashua received a B.Sc in mathematics and computer science from Tel-Aviv University in 1985 and his M.Sc in computer science in 1989 from the Weizmann Institute of Science. He received a Ph.D in brain and cognitive sciences in 1993 from the Massachusetts Institute of Technology (MIT), while working at the Artificial Intelligence Laboratory.

Sight Tech Global is a virtual event on December 2-3 and attendance is free. Pre-registration is open now.

Sight Tech Global welcomes sponsors. Current sponsors include Verizon Media, Google, Waymo, Mojo Vision and Wells Fargo, The event is organized by volunteers and all proceeds from the event benefit The Vista Center for the Blind and Visually Impaired in Silicon Valley.