Determined AI
Auto Added by WPeMatico
Determined AI makes its machine learning infrastructure free and open source
Machine learning has quickly gone from niche field to crucial component of innumerable software stacks, but that doesn’t mean it’s easy. The tools needed to create and manage it are enterprise-grade and often enterprise-only — but Determined AI aims to make them more accessible than ever by open-sourcing its entire AI infrastructure product.
The company created its Determined Training Platform for developing AI in an organized, reliable way — the kind of thing that large companies have created (and kept) for themselves, the team explained when they raised an $11 million Series A last year.
“Machine learning is going to be a big part of how software is developed going forward. But in order for companies like Google and Amazon to be productive, they had to build all this software infrastructure,” said CEO Evan Sparks. “One company we worked for had 70 people building their internal tools for AI. There just aren’t that many companies on the planet that can withstand an effort like that.”
At smaller companies, ML is being experimented with by small teams using tools intended for academic work and individual research. To scale that up to dozens of engineers developing a real product… there aren’t a lot of options.
“They’re using things like TensorFlow and PyTorch,” said Chief Scientist Ameet Talwalkar. “A lot of the way that work is done is just conventions: How do the models get trained? Where do I write down the data on which is best? How do I transform data to a good format? All these are bread and butter tasks. There’s tech to do it, but it’s really the Wild West. And the amount of work you have to do to get it set up… there’s a reason big tech companies build out these internal infrastructures.”
Determined AI, whose founders started out at UC Berkeley’s AmpLab (home of Apache Spark), has been developing its platform for a few years, with feedback and validation from some paying customers. Now, they say, it’s ready for its open source debut — with an Apache 2.0 license, of course.
“We have confidence people can pick it up and use it on their own without a lot of hand-holding,” said Sparks.
You can spin up your own self-hosted installation of the platform using local or cloud hardware, but the easiest way to go about it is probably the cloud-managed version that automatically provisions resources from AWS or wherever you prefer and tears them down when they’re no longer needed.
The hope is that the Determined AI platform becomes something of a base layer that lots of small companies can agree on, providing portability to results and standards so you’re not starting from scratch at every company or project.
With machine learning development expected to expand by orders of magnitude in the coming years, even a small piece of the pie is worth claiming, but with luck, Determined AI may grow to be the new de facto standard for AI development in small and medium businesses.
You can check out the platform on GitHub or at Determined AI’s developer site.
Powered by WPeMatico
Determined AI nabs $11M Series A to democratize AI development
Deep learning involves a highly iterative process where data scientists build models and test them on GPU-powered systems until they get something they can work with. It can be expensive and time-consuming, often taking weeks to fashion the right model. New startup Determined AI wants to change that by making the process faster, cheaper and more efficient. It emerged from stealth today with $11 million in Series A funding.
The round was led by GV (formerly Google Ventures) with help from Amplify Partners, Haystack and SV Angel. The company also announced an earlier $2.6 million seed round from 2017, for a total $13.6 million raised to date.
Evan Sparks, co-founder and CEO at Determined AI, says that up until now, only the largest companies like Facebook, Google, Apple and Microsoft could set up the infrastructure and systems to produce sophisticated AI like self-driving cars and voice recognition technologies. “Our view is that a big reason why [these big companies] can do that is that they all have internal software infrastructure that enables their teams of machine learning engineers and data scientists to be effective and produce applications quickly,” Sparks told TechCrunch.
Determined’s idea is to create software to handle everything from managing cluster compute resources to automating workflows, thereby putting some of that big-company technology within reach of any organization. “What we exist to do is to build that software for everyone else,” he said. The target market is Fortune 500 and Global 2000 companies.
The company’s solution is based on research conducted over the last several years at AmpLab at the University of California, Berkeley (which is probably best known for developing Apache Spark). It used the knowledge generated in the lab to build sophisticated solutions that help make better use of a customer’s GPU resources.
“We are offering kind of a base layer that is scheduling and resource sharing for these highly expensive resources, and then on top of that we’ve layered some services around workflow automation.” Sparks said the team has generated state of the art results that are somewhere between five and 50 times faster than the results from tools that are available to most companies today.
For now, the startup is trying to help customers move away from generic kinds of solutions currently available to more customized approaches, using Determined AI tools to help speed up the AI production process. The money from today’s round should help fuel growth, add engineers and continue building the solution.
Powered by WPeMatico