Instagram adds a captions option for Stories and soon, Reels

Published May 4, 2021

Instagram is making its video Stories and Reels more accessible with the launch of a new “captions sticker” that will allow users to watch without having the sound on. The addition will not only make it easier for users who are hard of hearing or deaf to engage with video content, it also offers a way for users to watch videos when they’re somewhere they don’t want to have their sound on — and either don’t want to wear or don’t have access to headphones or earbuds.

To use the feature, creators will first record a new video using the Stories or Reels Camera in the Instagram app, or select a video to upload from their phone’s gallery. Then, you’ll open the sticker tray and look for the new “Captions” sticker, which will convert your speech to text. You also can edit the style, position of the caption and the text and color so it matches your content. When you post, the captions will appear alongside your video for everyone to see.

At launch, the feature is only available in English and in English-speaking countries, but Instagram plans to roll it out to other countries and languages soon, it says. It’s also rolling out the captions sticker first to Stories and will then begin testing it in Reels, with a broader launch to follow.

The captions sticker had been spotted last year while in development, alongside other potential new additions, like a Collab sticker, Link sticker, Reshare sticker and others. Instagram parent Facebook also appears to have a captions sticker of its own in development. The sticker then began testing earlier this spring with some number of Instagram users.

The addition comes only weeks after TikTok announced its own captions feature, which it calls auto captions. The two products are somewhat different, however. Auto captions automatically translate the speech from a TikTok video in either American English and Japanese, to start, but the text itself isn’t customizable and can be turned on or off by the viewer from the app’s share panel. It also hasn’t yet been broadly adopted and many TikTok creators tend to still use captions they create themselves or via third-party apps.

Instagram notes it had previously launched support for captions across Threads and IGTV, but its expansion to Stories and Reels will make more of an impact, given that Instagram Stories alone is used by more than 500 million people every day.

TikTok adds auto captions to make videos accessible to hard of hearing and deaf

MIT professor wants to overhaul ‘The Hype Machine’ that powers social media

Live Caption, Google’s automatic captioning technology, is now available on Pixel 4

Published October 16, 2019

Live Caption, Google’s automatic captioning system first introduced at its I/O developer conference this May, is now officially available, alongside the launch of the new Pixel 4. But unlike some of the other technologies highlighted at the company’s Pixel hardware event yesterday, Live Caption won’t be limited to Google’s new smartphone alone. After the initial debut on Pixel 4, the automatic captioning technology will roll out to Pixel 3, Pixel 3 XL, Pixel 3a and Pixel 3a XL before year-end, says Google, and will become more broadly available in 2020.

The company has offered automatic captions on YouTube for a decade, but that same sort of experience isn’t available across the wider web and mobile devices. For example, Google explains, you can’t read captions for things like the audio messages sent by your friends, on trending videos published elsewhere on social media and on the content you record yourself.

There’s a significant accessibility issue with the lack of captions in all these places, but there’s a convenience issue, as well.

If you’re in a loud environment, like a commuter train, or trying to watch content privately and forgot your headphones, you may need to just use the captions. Or maybe you don’t want to blare the audio, which disturbs others around you. Or perhaps, you want to see the words appear because you’re having trouble understanding the audio, or just want to be sure to catch every word.

With the launch of the Pixel 4, Live Caption is also available for the first time to the general public.

The technology will capture and automatically caption videos and spoken audio on your device, except for phone and video calls. This captioning all happens in real time and on your device — not in the cloud. That means it works even if your device lacks a cell signal or access to Wi-Fi. The captions also stay private and don’t leave your phone.

This is similar to how the Pixel 4’s new Recorder app functions. It, too, will do its speech-to-text processing all on your device, in order to give you real-time transcriptions of your meetings, interviews, lectures or anything else you want to record, without compromising your privacy.

You can launch the Live Captions feature with a tap from the volume slider that appears, then reposition the caption box anywhere on your screen so it doesn’t get in the way of what you’re viewing.

Currently, the feature supports English only. But Google says it’s working to add more languages in the future.

After today’s launch on Pixel 4 and the rollout to the rest of the modern Pixel line of smartphones this year, it will start to show up in other new Android phones. Google says it’s working with other manufacturers to make the technology available to more people as soon as next year.