AR
Auto Added by WPeMatico
Apple’s RealityKit 2 allows developers to create 3D models for AR using iPhone photos
At its Worldwide Developers Conference, Apple announced a significant update to RealityKit, its suite of technologies that allow developers to get started building AR (augmented reality) experiences. With the launch of RealityKit 2, Apple says developers will have more visual, audio and animation control when working on their AR experiences. But the most notable part of the update is how Apple’s new Object Capture API will allow developers to create 3D models in minutes using only an iPhone.
Apple noted during its developer address that one of the most difficult parts of making great AR apps was the process of creating 3D models. These could take hours and thousands of dollars.
With Apple’s new tools, developers will be able take a series of pictures using just an iPhone (or iPad, DSLR or even a drone, if they prefer) to capture 2D images of an object from all angles, including the bottom.
Then, using the Object Capture API on macOS Monterey, it only takes a few lines of code to generate the 3D model, Apple explained.
Image Credits: Apple
To begin, developers would start a new photogrammetry session in RealityKit that points to the folder where they’ve captured the images. Then, they would call the process function to generate the 3D model at the desired level of detail. Object Capture allows developers to generate the USDZ files optimized for AR Quick Look — the system that lets developers add virtual, 3D objects in apps or websites on iPhone and iPad. The 3D models can also be added to AR scenes in Reality Composer in Xcode.
Apple said developers like Wayfair, Etsy and others are using Object Capture to create 3D models of real-world objects — an indication that online shopping is about to get a big AR upgrade.
Wayfair, for example, is using Object Capture to develop tools for their manufacturers so they can create a virtual representation of their merchandise. This will allow Wayfair customers to be able to preview more products in AR than they could today.
Image Credits: Apple (screenshot of Wayfair tool))
In addition, Apple noted developers including Maxon and Unity are using Object Capture for creating 3D content within 3D content creation apps, such as Cinema 4D and Unity MARS.
Other updates in RealityKit 2 include custom shaders that give developers more control over the rendering pipeline to fine tune the look and feel of AR objects; dynamic loading for assets; the ability to build your own Entity Component System to organize the assets in your AR scene; and the ability to create player-controlled characters so users can jump, scale and explore AR worlds in RealityKit-based games.
One developer, Mikko Haapoja of Shopify, has been trying out the new technology (see below) and shared some real-world tests where he shot objects using an iPhone 12 Max via Twitter.
Developers who want to test it for themselves can leverage Apple’s sample app and install Monterey on their Mac to try it out. They can use the Qlone camera app or any other image capturing application they want to download from the App Store to take the photos they need for Object Capture, Apple says. In the fall, the Qlone Mac companion app will leverage the Object Capture API as well.
Apple says there are over 14,000 ARKit apps on the App Store today, which have been built by over 9,000 different developers. With the more than 1 billion AR-enabled iPhones and iPads being used globally, it notes that Apple offers the world’s largest AR platform.
Apple’s Object Capture on a Pineapple. One of my fav things to test Photogrammetry against. This was processed using the RAW detail setting.
More info in thread
pic.twitter.com/2mICzbV8yY
— Mikko Haapoja (@MikkoH) June 8, 2021
Apple’s Object Capture is the real deal. I’m impressed. Excited to see where @Shopify merchants could take this
Allbirds Tree Dashers. More details in thread
— Mikko Haapoja (@MikkoH) June 8, 2021
Powered by WPeMatico
Snap acquires AR startup WaveOptics, which provides tech for Spectacles, for over $500M
Snap yesterday announced the latest iteration of its Spectacles augmented reality glasses, and today the company revealed a bit more news: it is also acquiring the startup that supplied the technology that helps power them. The Snapchat parent is snapping up WaveOptics, an AR startup that makes the waveguides and projectors used in AR glasses. These overlay virtual images on top of the views of the real world someone wearing the glasses can see, and Snap worked with WaveOptics to build its latest version of Spectacles.
The deal was first reported by The Verge, and a spokesperson for Snap directly confirmed the details to TechCrunch. Snap is paying over $500 million for the startup, in a cash-and-stock deal. The first half of that will be coming in the form of stock when the deal officially closes, and the remainder will be payable in cash or stock in two years.
This is a big leap for WaveOptics, which had raised around $65 million in funding from investors that included Bosch, Octopus Ventures and a host of individuals, from Stan Boland (veteran entrepreneur in the UK, most recently at FiveAI) and Ambarish Mitra (the co-founder of early AR startup Blippar). PitchBook estimates that its most recent valuation was only around $105 million.
WaveOptics was founded in Oxford, and from what we know it will continue to be based in the UK.
We have been covering the company since its earliest days, when it displayed some very interesting, early, and ahead-of-its-time technology: waveguides based on hologram physics and photonic crystals. The important and key thing is that its tech drastically compresses size and load of the hardware needed to process and display images, meaning a much wider and more flexible range of form factors for AR hardware based on WaveOptics tech.
It’s not clear whether WaveOptics will continue to work with other parties post-deal, but it seems that one obvious advantage for Snap would be making the startup’s technology exclusive to itself.
Snap has been on something of an acquisition march in recent times — it’s made at least three other purchases of startups since January, including Fit Analytics for an AR-fuelled move into e-commerce, as well as Pixel8Earth and StreetCred for its mapping tools.
This deal, however, marks Snap’s biggest acquisition to date in terms of valuation. That is not only a mark of the premium price that foundational artificial intelligence tech continues to command — in addition to the team of scientists that built WaveOptics, it also has 12 filed and in-progress patents — but also Snap’s financial and, frankly, existential commitment to having a seat at the table when it comes not just to social apps that use AR, but hardware, and being at the centre of not just using the tech, but setting the pace and agenda for how and where that will play out.
That’s been a tenacious and not always rewarding place for it to be, but the company — which has long described itself as a “camera company” — has kept hardware in the mix as an essential component for its future strategy.
Powered by WPeMatico
SightCall raises $42M for its AR-based visual assistance platform
Long before COVID-19 precipitated “digital transformation” across the world of work, customer services and support was built to run online and virtually. Yet it too is undergoing an evolution supercharged by technology.
Today, a startup called SightCall, which has built an augmented reality platform to help field service teams, the companies they work for, and their customers carry out technical and mechanical maintenance or repairs more effectively, is announcing $42 million in funding, money that it plans to use to invest in its tech stack with more artificial intelligence tools and expanding its client base.
The core of its service, explained CEO and co-founder Thomas Cottereau, is AR technology (which comes embedded in their apps or the service apps its customers use, with integrations into other standard software used in customer service environments including Microsoft, SAP, Salesforce and ServiceNow). The augmented reality experience overlays additional information, pointers and other tools over the video stream.
This is used by, say, field service engineers coordinating with central offices when servicing equipment; or by manufacturers to provide better assistance to customers in emergencies or situations where something is not working but might be repaired quicker by the customers themselves rather than engineers that have to be called out; or indeed by call centers, aided by AI, to diagnose whatever the problem might be. It’s a big leap ahead for scenarios that previously relied on work orders, hastily drawn diagrams, instruction manuals and voice-based descriptions to progress the work in question.
“We like to say that we break the barriers that exist between a field service organization and its customer,” Cottereau said.
The tech, meanwhile, is unique to SightCall, built over years and designed to be used by way of a basic smartphone, and over even a basic mobile network — essential in cases where reception is bad or the locations are remote. (More on how it works below.)
Originally founded in Paris, France before relocating to San Francisco, SightCall has already built up a sizable business across a pretty wide range of verticals, including insurance, telecoms, transportation, telehealth, manufacturing, utilities and life sciences/medical devices.
SightCall has some 200 big-name enterprise customers on its books, including the likes of Kraft-Heinz, Allianz, GE Healthcare and Lincoln Motor Company, providing services on a B2B basis as well as for teams that are out in the field working for consumer customers, too. After seeing 100% year-over-year growth in annual recurring revenue in 2019 and 2020, SightCall’s CEO says it’s looking like it will hit that rate this year as well, with a goal of $100 million in annual recurring revenue.
The funding is being led by InfraVia, a European private equity firm, with Bpifrance also participating. The valuation of this round is not being disclosed, but I should point out that an investor told me that PitchBook’s estimate of $122 million post-money is not accurate (we’re still digging on this and will update as and when we learn more).
For some further context on this investment, InfraVia invests in a number of industrial businesses, alongside investments in tech companies building services related to them such as recent investments in Jobandtalent, so this is in part a strategic investment. SightCall has raised $67 million to date.
There has been an interesting wave of startups emerging in recent years building out the tech stack used by people working in the front lines and in the field, a shift after years of knowledge workers getting most of the attention from startups building a new generation of apps.
Workiz and Jobber are building platforms for small business tradespeople to book jobs and manage them once they’re on the books; BigChange helps manage bigger fleets; and Hover has built a platform for builders to be able to assess and estimate costs for work by using AI to analyze images captured by their or their would-be customers’ smartphone cameras.
And there is Streem, which I discovered is a close enough competitor to SightCall that they’ve acquired AdWords ads based on SightCall searches in Google. Just ahead of the COVID-19 pandemic breaking wide open, General Catalyst-backed Streem was acquired by Frontdoor to help with the latter’s efforts to build out its home services business, another sign of how all of this is leaping ahead.
What’s interesting in part about SightCall and sets it apart is its technology. Co-founded in 2007 by Cottereau and Antoine Vervoort (currently SVP of product and engineering), the two are long-time telecoms industry vets who had both worked on the technical side of building next-generation networks.
SightCall started life as a company called Weemo that built video chat services that could run on WebRTC-based frameworks, which emerged at a time when we were seeing a wider effort to bring more rich media services into mobile web and SMS apps. For consumers and to a large extent businesses, mobile phone apps that work “over the top” (distributed not by your mobile network carrier but the companies that run your phone’s operating system, and thus partly controlled by them) really took the lead and continue to dominate the market for messaging and innovations in messaging.
After a time, Weemo pivoted and renamed itself as SightCall, focusing on packaging the tech that it built into whichever app (native or mobile web) where one of its enterprise customers wanted the tech to live.
The key to how it works comes by way of how SightCall was built, Cottereau explained. The company has spent 10 years building and optimizing a network across data centers close to where its customers are, which interconnects with Tier 1 telecoms carriers and has a lot of latency in the system to ensure uptime. “We work with companies where this connectivity is mission critical,” he said. “The video solution has to work.”
As he describes it, the hybrid system SightCall has built incorporates its own IP that works both with telecoms hardware and software, resulting in a video service that provides 10 different ways for streaming video and a system that automatically chooses the best in a particular environment, based on where you are, so that even if mobile data or broadband reception don’t work, video streaming will. “Telecoms and software are still very separate worlds,” Cottereau said. “They still don’t speak the same language, and so that is part of our secret sauce, a global roaming mechanism.”
The tech that the startup has built to date not only has given it a firm grounding against others who might be looking to build in this space, but has led to strong traction with customers. The next steps will be to continue building out that technology to tap deeper into the automation that is being adopted across the industries that already use SightCall’s technology.
“SightCall pioneered the market for AR-powered visual assistance, and they’re in the best position to drive the digital transformation of remote service,” said Alban Wyniecki, partner at InfraVia Capital Partners, in a statement. “As a global leader, they can now expand their capabilities, making their interactions more intelligent and also bringing more automation to help humans work at their best.”
“SightCall’s $42M Series B marks the largest funding round yet in this sector, and SightCall emerges as the undisputed leader in capital, R&D resources and partnerships with leading technology companies enabling its solutions to be embedded into complex enterprise IT,” added Antoine Izsak of Bpifrance. “Businesses are looking for solutions like SightCall to enable customer-centricity at a greater scale while augmenting technicians with knowledge and expertise that unlocks efficiencies and drives continuous performance and profit.”
Cottereau said that the company has had a number of acquisition offers over the years — not a surprise when you consider the foundational technology it has built for how to architect video networks across different carriers and data centers that work even in the most unreliable of network environments.
“We want to stay independent, though,” he said. “I see a huge market here, and I want us to continue the story and lead it. Plus, I can see a way where we can stay independent and continue to work with everyone.”
Powered by WPeMatico
Extra Crunch roundup: Clubhouse UX teardown, YC Demo Day favorites, proptech VC survey, more
Since the pandemic began, I have been pushing the limits of my imagination to try to picture what cities will look and feel like in the coming years.
If your town looks like San Francisco, where I live, it’s a pressing question: Our once-bustling financial district is a ghost town, but even in outer neighborhoods, the number of vacant storefronts is unsettling. People are starting to emerge after sheltering in place for a year, but we are a long way from fully restoring our shared spaces.
What’s going to happen to those semi-vacant office towers, some of which are still under construction? There’s been renewed talk of converting some skyscrapers into residential housing, but there are real economic/logistic hurdles to clear before that can be broadly applied. Scores of restaurants have closed in recent months; who will take over those spaces? I spend a lot of time walking around, and it’s been a long time since I’ve noticed a “Grand Opening” sign.
Seeking answers, Managing Editor Eric Eldon interviewed 10 VCs who are active in proptech and found that most were generally “optimistic.”
Several expressed genuine uncertainty about the future of offices, but most were bullish about prospects for remote work, the rebirth of physical retail and the emergence of “third spaces” that will fill the gap between work and home.
In a companion article on TechCrunch, Eric explores these broader shifts, concluding, “you can start to see a world emerging that sounds a lot more like the fantasies of a New Urbanist than the world before the pandemic.”
Here’s who he interviewed:
- Clelia Warburg Peters, venture partner, Bain Capital Ventures
- Christopher Yip, partner and managing director, RET Ventures
- Zach Aarons, co-founder and general partner, MetaProp
- Casey Berman, general partner, Camber Creek
- Vik Chawla, partner, Fifth Wall
- Adam Demuyakor, co-founder and managing partner, Wilshire Lane Partners
- Robin Godenrath and Julian Roeoes, partners, Picus Capital
- Stonly Baptiste, founding partner, and Shaun Abrahamson, managing partner, Urban Us
- Andrew Ackerman, managing director, Dreamit
Thanks very much for reading Extra Crunch this week. Have a great weekend!
Walter Thompson
Senior Editor, TechCrunch
@yourprotagonist
Full Extra Crunch articles are only available to members.
Use discount code ECFriday to save 20% off a one- or two-year subscription.
It’s time to abandon business intelligence tools
Image Credits: Jon Feingersh Photography Inc / Getty Images
Ideally, BI transforms raw data into actionable information, but according to Charles Caldwell, VP of product management at Logi Analytics, “a gap exists between the functionalities provided by current BI and data discovery tools and what users want and need.”
Few BI tools actually integrate with existing workflows and most offer clunky user experiences, “leaving many individuals feeling like they need an advanced computer science degree to actually be able to pull insights out.”
Instead of requiring workers to abandon workflow applications to access data, embedded analytics are more efficient and easier to use, says Caldwell.
In short, “it’s time to abandon BI — at least as we currently know it.”
Pre-seed round funding is under scrutiny: Is VC pandemic posturing here to stay?
Image Credits: nadia_bormotova / Getty Images
Amid the pandemic, investors became laser-focused on sections of the pitch deck that address monetization and business viability — signs that founders need to come to the table with better-defined businesses in order to succeed.
Investors’ heightened expectations for monetization potential and a company’s positioning within its competitive landscape are unlikely to lessen in the years to come, even in a post-COVID economy.
Clubhouse UX teardown: A closer look at homepage curation, follow hooks and other features
Image Credits: Rafael Henrique/SOPA Images/LightRocket via Getty Images
Clubhouse’s hockey-stick growth is something most startups would kill for.
However, it also means that UX problems can only be addressed while in “full flight” — and that changes to the user experience will be felt at scale rather under the cover of a small, loyal and (usually) forgiving user base.
Our favorite companies from Y Combinator’s W21 Demo Day
We’re not investors, so we’re not pretending to sort the unicorns from the goats.
But TechCrunch reporters spend a lot of time talking with startups, hearing pitches and telling their stories; if you’re curious about which companies stood out from Y Combinator’s W21 Demo Day, read on.
A look at 4 IPO updates and 2 late-stage funding rounds
Image Credits: Nigel Sussman (opens in a new window)
There’s a lot going on: The venture capital market is redlining its engines while public markets remain sympathetic to growing, unprofitable companies.
Let’s round up IPO news from DigitalOcean, Kaltura, Robinhood and Zymergen, and big rounds for Lattice and goPuff.
Dear Sophie: When can I finally come to Silicon Valley?
Image Credits: Bryce Durbin/TechCrunch
Dear Sophie:
I’m a startup founder looking to expand in the U.S. I was originally looking at opening an office in Silicon Valley to be close to software engineers and investors, but then … COVID-19 🙂
A lot has changed over the last year — can I still come?
— Hopeful in Hungary
Staying ahead of the curve on Google’s Core Web Vitals
Image Credits: Aleksei Naumov / Getty Images
Aside from improved SEO, small business websites optimizing for Google’s new Core Web Vitals will reap the rewards of an improved user experience for their site visitors.
While many are looking at the Core Web Vitals as a big hoop to jump through to please the search powers that be, others are seeing — and seizing — the opportunities that come along with this change.
Steady’s Adam Roseman and investor Emmalyn Shaw outline what worked (and what was missing) in the Series A deck
Image Credits: Steady
When it comes to Steady — the platform that helps hourly workers manage and maximize their income and access deals on things like benefits and financial services — the strengths of the business are clear.
But it took time for founder and CEO Adam Roseman to clearly define and communicate each of them in his quest for fundraising.
Discord’s reported $10B exit; Compass and Intermedia Cloud Communications set IPO price ranges
Image Credits: Nigel Sussman (opens in a new window)
Alex Wilhelm dug into Discord’s possible $10 billion exit to Microsoft and explored IPO price ranges for real estate tech company Compass and Intermedia Cloud Communications, a unified-communications-as-a-service company.
“It’s a lot,” he noted, “but if we don’t get through it all now, we’ll fall behind and feel silly later.”
Will fading YOLO sentiment impact Robinhood, Coinbase and other trading platforms?
Image Credits: Nigel Sussman (opens in a new window)
The consumer trading frenzy could be slowing.
What would happen to Robinhood and its cohorts if the apparent cooling in consumer trading demand continues?
How VC and private equity funds can launch portfolio-acceleration platforms
Image Credits: Miguel Navarro (opens in a new window) / Getty Images (Image has been modified)
Almost every private equity and venture capital investor now advertises that they have a platform to support their portfolio companies, “however, most of us don’t have the budget of an Andreessen Horowitz to support almost every major need” for each startup they’ve bet on, says Versatile VC founder David Teten.
If you’re prioritizing a platform buildout for your firm, consider using the framework he’s outlined.
Automakers, suppliers and startups see growing market for in-vehicle AR/VR applications
Image Credits: Bryce Durbin
Despite all of the pomp and promises about the potential for AR and VR, there isn’t a clear understanding of market demand for bringing the technology to cars, trucks and passenger vans.
Estimates of the global market range from $14 billion by 2027 to as much as $673 billion by 2025, showing just how nascent the market currently is and how much opportunity is present.
Amid pandemic, Middle East adtech startups play essential role in business growth
Image Credits: phototechno / Getty Images
The Middle East is a promising region with growing digital advertising solutions despite locals’ attachment to traditional means of advertising.
In recent years, there has been a shift to the active use of social media and online shopping, meaning the Middle East embodies great potential for adtech startups.
Social+ payments: Why fintechs need social features
Image Credits: Getty Images
Social+ products are seeing mass adoption because they marry community with functionality.
This applies even to fintech companies as taboos around money fall away.
The lightning-fast Series A that was 3 years in the making
Image Credits: Mironov Konstantin / Getty Images
It took Christine Tao, founder of Sounding Board, just over three years to recognize the value of executive coaching and get her company to a Series A.
Here’s how she did it.
NFTs could bridge video games and the fashion industry
Image Credits: Amber J. Dickinson (opens in a new window)
Music companies, celebrities and fashion brands are some of the latest entities to dip a toe into the burgeoning NFT market.
In part two of a three-part series, we take a look at why NFTs are “the next chapter of digital art history.”
Where is the e-commerce app ecosystem headed in 2021?
Image Credits: Charday Penn (opens in a new window) / Getty Images
The pandemic-induced growth of e-commerce is, by now, well documented.
What is happening in the app ecosystem that supports e-commerce? Is it growing, or are we more likely to see consolidations and IPOs?
Let’s explore.
ironSource is going public via a SPAC and its numbers are pretty good
Image Credits: Nigel Sussman (opens in a new window)
You’ll want to pay attention to this one: Israel’s ironSource, an app-monetization startup, is going public via a SPAC.
It’s the second SPAC-led debut from an Israeli company in recent weeks worth more than $10 billion, and ironSource is actually a pretty darn interesting company from a financial perspective.
Coursera set to roughly double its private valuation in impending IPO
Image Credits: Bryce Durbin / TechCrunch
The market views Coursera’s edtech business warmly ahead of its impending public offering.
Coursera is being valued as a software company, likely a breathe-easy moment for still-private edtech companies, since the debut could be an industry bellwether.
Powered by WPeMatico
7 investors discuss augmented reality and VR startup opportunities in 2020
For all of the investors preaching that augmented reality technology will likely be the successor to the modern smartphone, today, most venture capitalists are still quite wary to back AR plays.
The reasons are plentiful, but all tend to circle around the idea that it’s too early for software and too expensive to try to take on Apple or Facebook on the hardware front.
Meanwhile, few spaces were frothier in 2016 than virtual reality, but most VCs who gambled on VR following Facebook’s Oculus acquisition failed to strike it rich. In 2020, VR did not get the shelter-in-place usage bump many had hoped for largely due to supply chain issues at Facebook, but VCs hope their new cheaper device will spell good things for the startup ecosystem.
To get a better sense of how VCs are looking at augmented reality and virtual reality in 2020, I reached out to a handful of investors who are keeping a close watch on the industry:
- Niko Bonatsos, General Catalyst
- Tipatat Chennavasin, The Venture Reality Fund
- Brianne Kimmel, Work Life Ventures
- Jacob Mullins, Shasta Ventures
- Gigi Levy-Weiss, NFX
- Brayton Williams, Boost VC
- Greg Castle, Anorak Ventures
Some investors who are bullish on AR have opted to focus on virtual reality for now, believing that there’s a good amount of crossover between AR and VR software, and that they can make safer bets on VR startups today that will be able to take advantage of AR hardware when it’s introduced.
“Besides Pokémon Go I don’t think we have seen the engagement numbers needed for AR,” Boost VC investor Brayton Williams tells TechCrunch. “We believe VR is still the largest long-term opportunity of the two. AR complements the real world, VR creates endless new worlds.”
Most of the investors I got in contact with were still fairly active in the AR/VR world, but many still disagreed whether the time was right for VR startups. For Jacob Mullins of Shasta Ventures, “It’s still early, but it’s no longer too early.” While Gigi Levy-Weiss of NFX says that the market is “sadly not happening yet,” Facebook’s Quest headsets have shown promise.
On the hardware side, the ghost of Magic Leap’s formerly hyped glory still looms large. Few investors are interested in making a hardware play in the AR/VR world, noting that startups don’t have the resources to compete with Facebook or Microsoft on a large-scale rollout. “Hardware is so capital intensive and this entire industry is dependent on the big players continuing to invest in hardware innovation,” General Catalyst’s Niko Bonatsos tells us.
Even those that are still bullish on startups making hardware plays for more niche audiences acknowledge that life had gotten harder for ambitious founders in these spaces, “the spectacular flare-outs do make it harder for companies to raise large amounts with long product release horizons,” investor Tipatat Chennavasin notes.
Responses have been edited for length and clarity.
Niko Bonatsos, General Catalyst
What are your general impressions on the health of the AR/VR market today?
We’re seeing some progress in VR and some of that is happening because of the Oculus ecosystem. They continue to improve the hardware and have a growing catalog of content. I think their onboarding and consumption experience is very consumer-friendly and that’s going to continue to help with adoption. On the consumer side, we’re seeing some companies across gaming, fitness and productivity that are earning and retaining their audiences at a respectable rate. That wasn’t happening even a year ago so it may be partially a COVID lift but habits are forming.
The VR bets of several years ago have largely struggled to pan out, if you were to make a startup investment in this space today what would you need to see?
Companies to watch are the ones that are creating cool experiences with mobile as the first entry point. Wave VR, Rec Room, VRChat are making it really easy for consumers to get a taste of VR with devices they already own. They’re not treating VR as just another gaming peripheral but as a way to create very cool, often celebrity-driven, content. These are the kinds of innovations that makes me optimistic about the VR category in general.
Most investors I chat with seem to be long-term bullish on AR, but are reticent to invest in an explicitly AR-focused startup today. What do you want to see before you make a play here?
In both AR/VR, a founder needs to be both super ambitious but patient. They’ll need to be flexible in thinking and open to pivoting a few times along the way. Product-market fit is always important but I want to see that they have a plan for customer retention. Fun to try is great, habit-forming is much better. Gaming continues to do pretty well as a category for VC dollars but it’d be interesting to see more founders look at making IRL sports experiences more immersive or figuring out how to enhance remote meeting experiences with VR to fix Zoom fatigue.
There have been a few spectacular flare-outs when it comes to AR/VR hardware investments, is there still a startup opportunity in AR/VR hardware?
Hardware is so capital intensive and this entire industry is dependent on the big players continuing to invest in hardware innovation. Facebook and Microsoft seem to be the main companies willing to spend here while others have backed away. If we expand our thinking for a minute, maybe the first real mainstream breakthrough AR/VR consumer experience isn’t visual. For VR, it might be the mobile experiences. For AR maybe AirPods or AirPod-like devices are the right entry point for consumers. They’re in millions of people’s ears already and who doesn’t want their own special-agent-like earpiece? That’s where founders might find some opportunity.
Tipatat Chennavasin, The Venture Reality Fund
Powered by WPeMatico
Report: Apple quietly acquired Israel’s Camerai, formerly Tipit, a specialist in AR and camera tech
Apple is well known for picking up smaller startups on the hush-hush to augment its business, and today news leaked out about the latest of these… nearly two years after the fact. Sometime between 2018 and 2019, the iPhone giant reportedly acquired and shut down Camerai, an augmented reality and computer vision company based out of Israel, which used to be called Tipit.
The news was first reported earlier today by Israeli newspaper Calcalist, and we have reached out to ask Apple directly about it. In the meantime, Jonathan (Yehonatan) Rimon, who had been Camerai’s CEO and co-founded the company with Moty Kosharovsky, Erez Tal and Aaron Wetzler, declined to comment one way or the other on the report when we contacted him directly about it. A separate source confirmed the story to us. We’ll update as we learn more.
Calcalist said that the startup sold for several tens of millions of dollars. From being founded in 2015, Camerai had raised around $5 million — including a $2.5 million round in 2017 and another unreported $2.5 million in 2018 — with investors including the Atooro Fund and another called the SKO Fund.
It seems that the acquisition came on the heels of multiple approaches from a number of companies at a time when AR was arguably at a peak of hype and many big tech companies wanted a piece of the action. (Recall that 2018 was the year when Magic Leap raised nearly $1 billion in a single round of funding.) Back in 2018, we heard rumors that those approaching and looking at the startup included Apple, Samsung and Alibaba.
The Calcalist report said that Camerai employees joined Apple’s computer vision team, and that the company’s technology has been incorporated into Apple products already. It’s not clear specifically where and when, but recall that both iOS 13 and iOS 14 have featured big software updates to the camera.
Camerai had built an SDK and specifically a range of software-based AR tools to help edit and use camera-made images in more sophisticated ways,
Its tech included the ability to detect different objects in the picture, and outline them with precision to alter them cosmetically; the ability to outline and apply filters across the whole image; a “skeleton tracking” neural network API that could detect and draw body joints in real time overlaid on a picture of a human; and its own version of selective focus for enhanced portrait modes (remember this was 2018 and this was not standard on phones at the time). Camerai’s site is shut down, but here are some screenshots of how it all looked, pulled from the Internet Archive:
Camerai’s acquisition underscores a couple of interesting, and ongoing, trends.
The first of these is in the development of smartphone technology, particularly around cameras. Some of the more interesting innovations in smartphone camera technology have come not out of improvements in hardware, but software, where the application of breakthroughs in artificial intelligence can mean that an existing combination of sensor, lens and on-phone and cloud processors produce a better and more technically dynamic picture than before.
At a time when smartphone replacement cycles have really slowed down and we are seeing also slower innovation on hardware, bolting on talent and tech created outside the phone companies is one way to gain a competitive edge.
(Separately, I wonder if making cutting-edge technology software-based also means that there could be scope in the future for paid updates to older phone models, which could mean more incremental revenues from consumers that don’t want to invest incompletely new devices.)
The second trend that this deal underscores is how Israel remains fertile ground for bigger companies on the hunt to pick up and bolt on technology, and that the secretive approach is likely to remain for some time to come.
“In Israel there are over 350 global corporate companies, from 30 countries, who search for local innovation. Some of them like Apple, MS, Google, even have local R&D [operations],” said Avihai Michaeli, a Tel Aviv-based senior investment banker and startup advisor. “Those global companies look mainly for tech which could serve as its competitive edge. It is not the first time that an acquired startup is asked not to publish it was acquired, nor talk about it.”
Other acquisitions that Apple has made in Israel have included camera module maker LinX, semiconductor startup Anobit and 3D sensor company PrimeSense.
We’ll update this post as we learn more.
Powered by WPeMatico
Here’s where top gaming VCs are looking for startup opportunities
With cross-platform experiences like Fortnite and PUBG, in-game socializing environments, and subscription-based cloud gaming services from Playstation, Google, Amazon, and others, the gaming industry is entering a new era beyond mobile.
These days, the industry is at the center of social media and entertainment trends; gaming is expected to earn $152 billion in global revenue this year, up 9.6% year over year.
Given my recent writing on Unity, the most-used game engine, and ongoing research into interactive media trends, I wanted to find out how top gaming-focused VCs are assessing the market right now. I asked ten of them to share which trends they are most excited about when it comes to finding investment opportunities:
- David Gardner, Partner at London Venture Partners
- Henric Suuronen, Partner at Play Ventures
- Samuli Syvähuoko, Partner at Sisu Game Ventures
- Jay Chi, Partner at Makers Fund
- Peter Levin, Managing Director at Griffin Gaming Partners
- Gigi Levy-Weiss, Partner at NFX
- Ethan Kurzweil, Partner at Bessemer Venture Partners
- Jonathan Lai, Partner at Andreessen Horowitz
- Blake Robbins, Partner at Ludlow Ventures
- Jon Goldman, General Partner at GC Tracker & Board Partner at Greycroft Partners
Amid the mix of predictions, there were several common threads, such as optimism about the rise of games as broader social platforms, opportunities to invest directly in new studios, and skepticism about near-term investments in augmented or virtual reality and blockchain.
Here are their responses.
David Gardner, Partner at London Venture Partners
“PC Games are back. Great place to start new IP to then migrate a success to multiple platforms. There is more innovation in business models and more open distribution on PC to facilitate audience growth without the punishment of mobile CPIs.
VR & AR remain out. We stood away from VR in the beginning and extend that to AR while the user experience for games remains a disappointment. Let’s hope those new Apple glasses do the trick!
Crypto remain a theological war zone, but honestly everything on offer has been available in the cloud world, but the real consumer benefit isn’t showing up.
We love games that are expanding audience demographics and are sensitive to less hardcore audiences. For example, women players are estimated to account for 1 billion gamers.”
Henric Suuronen, Partner at Play Ventures
“At Play Ventures, we believe we have just entered the golden era of mobile gaming. Who would have believed 10 years ago that Nintendo and games like Fortnite and Call of Duty would all be on mobile. Mobile is not just a games platform anymore, it is THE games platform of choice for casual and core players alike. Consequently, in the next 2-3 years we will invest in 30-40 mobile games studios across the globe.”
Samuli Syvähuoko, Partner at Sisu Game Ventures
“We at Sisu Game Ventures have been investing in many sectors since 2015 including free-to-play mobile games (especially big here in Finland), VR, AR, PC, console, instant messenger, hypercasual, audio and most recently cloud-native games as well. In addition to game studios, around a third of our investments are into games related tech/infrastructure.
We’ve so far not dipped our toes into blockchain or eSports and our appetite for doing more investments in VR and AR is nil. To me, the most interesting mega trends lie with the promise of cloud gaming when utilized to its full potential. Another term that encapsulates my excitement is games-as-a-social-hobby. Put this and the extreme accessibility of the cloud together and you’ll have a game with revolutionary potential.”
Jay Chi, Partner at Makers Fund
“We are looking closely at ‘Gaming as Media’ related content and platforms — the emergence of new interactive experience centered on ‘viewers as participants.’ Gaming as social media falls under this thesis. We are also looking for MMO and Metaverse enablers given increased demand for specialized, scalable and affordable technologies that empower lean startup teams to create and operate large-scale worlds and novel gameplays.
We also see potential for new start-ups to emerge in hypercasual games with midcore/social meta — no one has truly cracked this genre yet.”
Powered by WPeMatico
Another high-flying, heavily funded AR headset startup is shutting down
While Apple and Microsoft strain to sell augmented reality as the next major computing platform, many of the startups aiming to beat them to the punch are crashing and burning.
Daqri, which built enterprise-grade AR headsets, has shuttered its HQ, laid off many of its employees and is selling off assets ahead of a shutdown, former employees and sources close to the company tell TechCrunch.
In an email obtained by TechCrunch, the nearly 10-year-old company told its customers that it was pursuing an asset sale and was shutting down its cloud and smart-glasses hardware platforms by the end of September.
“I think the large majority of people who worked [at Daqri] are sad to see it closing down,” a former employee told TechCrunch. “[I] wish the end result was different.”
The company’s 18,000+ square foot Los Angeles headquarters (above) is currently listed as “available” by real estate firm Newmark Knight Frank. The company’s Sunnyvale offices appear to have been shuttered sometime prior to 2019.
Daqri’s shutdown is only the latest among heavily funded augmented reality startups seeking to court enterprise customers.
Earlier this year, Osterhout Design Group unloaded its AR glasses patents after acquisition talks with Magic Leap, Facebook and others stalled. Meta, an AR headset startup that raised $73 million from VCs, including Tencent, also sold its assets earlier this year after the company ran out of cash.
Daqri faced substantial challenges from competing headset makers, including Magic Leap and Microsoft, which were backed by more expansive war chests and institutional partnerships. While the headset company struggled to compete for enterprise customers, Daqri benefited from investor excitement surrounding the broader space. That is, until the investment climate for AR startups cooled.
Daqri was, at one point, speaking with a large private-equity firm about financing ahead of a potential IPO, but as the technical realities facing other AR companies came to light, the firm backed out and the deal crumbled, we are told.
As of mid-2017, a Wall Street Journal report detailed that Daqri had raised $275 million in funding. You won’t find many details on the sources of that funding, other than references to Tarsadia Investments, a private-equity firm in Los Angeles that took part in the company’s sole disclosed funding round. We’re told Tarsadia had taken controlling ownership of the firm after subsequent investments.
In early 2016, Daqri acquired Two Trees Photonics, a small U.K. startup that was building holographic display technologies for automotive customers. The U.K. division soon comprised a substantial portion of the entire company’s revenues, sources tell us. By early 2018, the division was spun out from Daqri as a separate company called Envisics, leaving the Daqri team to focus wholly on bringing augmented reality to enterprise customers.
The remaining head-worn AR division failed to gain momentum after prolonged setbacks in adoption of its AR smart glasses, including difficulties in training workers to use the futuristic hardware, a source told TechCrunch.
All the while, the company’s leadership put on a brave face as the startup sputtered. In an interview this year with Cornell Enterprise Magazine, Daqri CEO Roy Ashok told the publication that the startup was forecasting shipments of “tens of thousands” of pairs of its AR glasses in 2020.
Daqri, its founder and several executives did not respond to requests for comment.
Powered by WPeMatico
Reality Check: The marvel of computer vision technology in today’s camera-based AR systems
Alex Chuang
Contributor
Contributor
Alex Chuang is the Managing Partner of Shape Immersive, a boutique studio that helps enterprise and brands transform their businesses by incorporating VR/AR solutions into their strategies.
More posts by this contributor
British science fiction writer, Sir Arther C. Clark, once said, “Any sufficiently advanced technology is indistinguishable from magic.”
Augmented reality has the potential to instill awe and wonder in us just as magic would. For the very first time in the history of computing, we now have the ability to blur the line between the physical world and the virtual world. AR promises to bring forth the dawn of a new creative economy, where digital media can be brought to life and given the ability to interact with the real world.
AR experiences can seem magical but what exactly is happening behind the curtain? To answer this, we must look at the three basic foundations of a camera-based AR system like our smartphone.
- How do computers know where it is in the world? (Localization + Mapping)
- How do computers understand what the world looks like? (Geometry)
- How do computers understand the world as we do? (Semantics)
Part 1: How do computers know where it is in the world? (Localization)
Mars Rover Curiosity taking a selfie on Mars. Source: https://www.nasa.gov/jpl/msl/pia19808/looking-up-at-mars-rover-curiosity-in-buckskin-selfie/
When NASA scientists put the rover onto Mars, they needed a way for the robot to navigate itself on a different planet without the use of a global positioning system (GPS). They came up with a technique called Visual Inertial Odometry (VIO) to track the rover’s movement over time without GPS. This is the same technique that our smartphones use to track their spatial position and orientation.
A VIO system is made out of two parts.
Powered by WPeMatico
Harry Potter, the Platform, and the Future of Niantic
What is Niantic? If they recognize the name, most people would rightly tell you it’s a company that makes mobile games, like Pokémon GO, or Ingress, or Harry Potter: Wizards Unite.
But no one at Niantic really seems to box it up as a mobile gaming company. Making these games is a big part of what the company does, yes, but the games are part of a bigger picture: they are a springboard, a place to figure out the constraints of what they can do with augmented reality today, and to figure out how to build the tech that moves it forward. Niantic wants to wrap their learnings back into a platform upon which others can build their own AR products, be it games or something else. And they want to be ready for whatever comes after smartphones.
Niantic is a bet on augmented reality becoming more and more a part of our lives; when that happens, they want to be the company that powers it.
This is Part 3 of our EC-1 series on Niantic, looking at its past, present, and potential future. You can find Part 1 here and Part 2 here. The reading time for this article is 24 minutes (6,050 words)
The platform play
After the absurd launch of Pokémon GO, everyone wanted a piece of the AR pie. Niantic got more pitches than they could take on, I’m told, as rights holders big and small reached out to see if the company might build something with their IP or franchise.
But Niantic couldn’t build it all. From art, to audio, to even just thinking up new gameplay mechanics, each game or project they took on would require a mountain of resources. What if they focused on letting these other companies build these sorts of things themselves?
That’s the idea behind Niantic’s Real World Platform. This platform is a key part of Niantic’s game plan moving forward, with the company having as many people working on the platform as it has on its marquee money maker, Pokémon GO.
There are tons of pieces that go into making things like GO or Ingress, and Niantic has spent the better part of the last decade figuring out how to make them all fit together. They’ve built the core engine that powers the games and, after a bumpy start with Pokémon GO’s launch, figured out how to scale it to hundreds of millions of users around the world. They’ve put considerable work into figuring out how to detect cheaters and spoofers and give them the boot. They’ve built a social layer, with systems like friendships and trade. They’ve already amassed that real-world location data that proved so challenging back when it was building Field Trip, with all of those real-world points of interest that now serve as portals and Pokéstops.
Niantic could help other companies with real-world events, too. That might seem funny after the mess that was the first Pokémon GO Fest (as detailed in Part II). But Niantic turned around, went back to the same city the next year, and pulled it off. That experience — that battle-testing — is valuable. Meanwhile, the company has pulled off countless huge Ingress events, and a number of Pokémon GO side events called “Safari Zones.” CTO Phil Keslin confirmed to me that event management is planned as part of the platform offering.
As Niantic builds new tech — like, say, more advanced AR or faster ways to sync AR experiences between devices — it’ll all get rolled into the platform. With each problem they solve, the platform offering would grow.
But first they need to prove that there’s a platform to stand on.
Harry Potter: Wizards Unite
Niantic’s platform, as it exists today, is the result of years of building their own games. It’s the collection of tools they’ve built and rebuilt along the way, and that already powers Ingress Prime and Pokémon GO. But to prove itself as a platform company, Niantic needs to show that they can do it again. That they can take these engines, these tools, and, working with another team, use them for something new.
Powered by WPeMatico