cloud computing
Auto Added by WPeMatico
AWS launches its next-gen GPU instances
AWS today announced the launch of its newest GPU-equipped instances. Dubbed P4, these new instances are launching a decade after AWS launched its first set of Cluster GPU instances. This new generation is powered by Intel Cascade Lake processors and eight of Nvidia’s A100 Tensor Core GPUs. These instances, AWS promises, offer up to 2.5x the deep learning performance of the previous generation — and training a comparable model should be about 60% cheaper with these new instances.
Image Credits: AWS
For now, there is only one size available, the p4d.12xlarge instance, in AWS slang, and the eight A100 GPUs are connected over Nvidia’s NVLink communication interface and offer support for the company’s GPUDirect interface as well.
With 320 GB of high-bandwidth GPU memory and 400 Gbps networking, this is obviously a very powerful machine. Add to that the 96 CPU cores, 1.1 TB of system memory and 8 TB of SSD storage and it’s maybe no surprise that the on-demand price is $32.77 per hour (though that price goes down to less than $20/hour for one-year reserved instances and $11.57 for three-year reserved instances.
Image Credits: AWS
On the extreme end, you can combine 4,000 or more GPUs into an EC2 UltraCluster, as AWS calls these machines, for high-performance computing workloads at what is essentially a supercomputer-scale machine. Given the price, you’re not likely to spin up one of these clusters to train your model for your toy app anytime soon, but AWS has already been working with a number of enterprise customers to test these instances and clusters, including Toyota Research Institute, GE Healthcare and Aon.
“At [Toyota Research Institute], we’re working to build a future where everyone has the freedom to move,” said Mike Garrison, Technical Lead, Infrastructure Engineering at TRI. “The previous generation P3 instances helped us reduce our time to train machine learning models from days to hours and we are looking forward to utilizing P4d instances, as the additional GPU memory and more efficient float formats will allow our machine learning team to train with more complex models at an even faster speed.”
Powered by WPeMatico
Warren gets $1.4 million to help local cloud infrastructure providers compete against Amazon and other giants
Started as a side project by its founders, Warren is now helping regional cloud infrastructure service providers compete against Amazon, Microsoft, IBM, Google and other tech giants. Based in Tallinn, Estonia, Warren’s self-service distributed cloud platform is gaining traction in Southeast Asia, one of the world’s fastest-growing cloud service markets, and Europe. It recently closed a $1.4 million seed round led by Passion Capital, with plans to expand in South America, where it recently launched in Brazil.
Warren’s seed funding also included participation from Lemonade Stand and angel investors like former Nokia vice president Paul Melin and Marek Kiisa, co-founder of funds Superangel and NordicNinja.
The leading global cloud providers are aggressively expanding their international businesses by growing their marketing teams and data centers around the world (for example, over the past few months, Microsoft has launched a new data center region in Austria, expanded in Brazil and announced it will build a new region in Taiwan as it competes against Amazon Web Services).
But demand for customized service and control over data still prompt many companies, especially smaller ones, to pick local cloud infrastructure providers instead, Warren co-founder and chief executive officer Tarmo Tael told TechCrunch.
“Local providers pay more attention to personal sales and support, in local language, to all clients in general, and more importantly, take the time to focus on SME clients to provide flexibility and address their custom needs,” he said. “Whereas global providers give a personal touch maybe only to a few big clients in the enterprise sectors.” Many local providers also offer lower prices and give a large amount of bandwidth for free, attracting SMEs.
He added that “the data sovereignty aspect that plays an important role in choosing their cloud platform for many of the clients.”
In 2015, Tael and co-founder Henry Vaaderpass began working on the project that eventually became Warren while running a development agency for e-commerce sites. From the beginning, the two wanted to develop a product of their own and tested several ideas out, but weren’t really excited by any of them, he said. At the same time, the agency’s e-commerce clients were running into challenges as their businesses grew.
Tael and Vaaderpass’s clients tended to pick local cloud infrastructure providers because of lower costs and more personalized support. But setting up new e-commerce projects with scalable infrastructure was costly because many local cloud infrastructure providers use different platforms.
“So we started looking for tools to use for managing our e-commerce projects better and more efficiently,” Tael said. “As we didn’t find what we were looking for, we saw this as an opportunity to build our own.”
After creating their first prototype, Tael and Vaaderpass realized that it could be used by other development teams, and decided to seek angel funding from investors, like Kiisa, who have experience working with cloud data centers or infrastructure providers.
Southeast Asia, one of the world’s fastest-growing cloud markets, is an important part of Warren’s business. Warren will continue to expand in Southeast Asia, while focusing on other developing regions with large domestic markets, like South America (starting with Brazil). Tael said the startup is also in discussion with potential partners in other markets, including Russia, Turkey and China.
Warren’s current clients include Estonian cloud provider Pilw.io and Indonesian cloud provider IdCloudHost. Tael said working with Warren means its customers spend less time dealing with technical issues related to infrastructure software, so their teams, including developers, can instead focus on supporting clients and managing other services they sell.
The company’s goal is to give local cloud infrastructure providers the ability to meet increasing demand, and eventually expand internationally, with tools to handle more installations and end users. These include features like automated maintenance and DevOps processes that streamline feature testing and handling different platforms.
Ultimately, Warren wants to connect providers in a network that end users can access through a single API and user interface. It also envisions the network as a community where Warren’s clients can share resources and, eventually, have a marketplace for their apps and services.
In terms of competition, Tael said local cloud infrastructure providers often turn to OpenStack, Virtuozzo, Stratoscale or Mirantis. The advantage these companies currently have over Warren is a wider network, but Warren is busy building out its own. The company will be able to connect several locations to one provider by the first quarter of 2021. After that, Tael said, it will “gradually connect providers to each other, upgrading our user management and billing services to handle all that complexity.”
Powered by WPeMatico
Pulumi raises $37.5M Series B for its cloud engineering platform
Seattle-based Pulumi, one of the newer startups in the ”infrastructure-as-code” space, today announced that it has raised a $37.5 million Series B funding round led by NEA. Previous investors Madrona Venture Group and Tola Capital also participated in this round, which brings the total investment in the company to $57.5 million.
The new investment follows the launch of Pulumi 2.0, which got the company closer to its vision of becoming what the team calls a “cloud engineering platform” and impressive growth over the last year, with a 10x growth in adoption in the last 12 months.
“We started with infrastructure as code, because we felt like that was a foundational piece that gave us the programming model, along with the cloud resource model,” Pulumi co-founder and CEO Joe Duffy told me. “That was an important place to start. With [Pulumi] 2.0, we launched support for testing, for policy as code — so that you could actually apply governance and compliance as part of your infrastructure management — and really helping more of the team work together.”
Indeed, after starting with a focus on infrastructure teams, Pulumi is now looking to expand across teams.
“The infrastructure team is becoming the nucleus that pulls the whole team together. We’re actually calling this cloud engineering,” Duffy explained. “What we’re calling cloud engineering is developers using the cloud in a first-class way, infrastructure teams helping them do that and increasingly pulling in security engineers to make sure that governance is part of the story as well. The 2.0 release was our first time exploring those adjacencies and trying to paint a path to realizing the full Pulumi vision.”
Infrastructure as code isn’t necessarily new, of course. The promise of Pulumi is that it isn’t hobbled by any legacy products but that the team designed it as a cloud-native product from the ground up. That’s something NEA’s Aaron Jacobson, who will join the company’s board, also stressed.
More on Pulumi
“If you think about how fast the cloud has evolved just in 10 years, Pulumi is built in a place of multi-cloud, of Kubernetes, of serverless, Jacobson said. “And much of the original infrastructure-as-code constructs didn’t even have those in mind. Since Pulumi is newer to market and has come after all those constructs, it just has better integration, it’s just a more delightful experience to developers.”
NEA’s Scott Sandell is actually taking this a bit further. “Venture capitalists are in the business of pattern recognition,” he said. “And the pattern that I recognized actually goes all the way back to when I was a product manager in the windows group. And I saw that developers don’t want to have to deal with complexity — they want to have the complexity managed for them.” That, he argues, is what Pulumi does for developers — and it surely helped both Duffy and his co-founder and Pulumi executive chairman Eric Rudder, who left successful careers at Microsoft to build this company.
In addition to the new funding, Pulumi also today announced that it brought in a number of new executives, including industry veterans Jay Wampold as CMO, Lindsay Marolich as senior director of demand generation, Kevin Kotecki as VP of sales and Lee-Ming Zen as VP of engineering.
Powered by WPeMatico
Freshworks (re-)launches its CRM service
Freshworks, the customer and employee engagement company that offers a range of products, from call center and customer support software to HR tools and marketing automation services, today announced the launch of its newest product: Freshworks CRM. The new service, which the company built on top of its new Freshworks Neo platform, is meant to give sales and marketing teams all of the tools they need to get a better view of their customers — with a bit of machine learning thrown in for better predictions.
Freshworks CRM is essentially a rebrand of the company’s Freshsales service, combined with the company’s capabilities of its Freshmarketer marketing automation tool.
“Freshworks CRM unites Freshsales and Freshmarketer capabilities into one solution, which leverages an embedded customer data platform for an unprecedented and 360-degree view of the customer throughout their entire journey,” a company spokesperson told me.
The promise here is that this improved CRM solution is able to provide teams with a more complete view of their (potential) customers thanks to the unified view — and aggregated data — that the company’s Neo platform provides.
The company argues that the majority of CRM users quickly become disillusioned with their CRM service of choice — and the reason for that is because the data is poor. That’s where Freshworks thinks it can make a difference.
“Freshworks CRM delivers upon the original promise of CRM: a single solution that combines AI-driven data, insights and intelligence and puts the customer front and center of business goals,” said Prakash Ramamurthy, the company’s chief product officer. “We built Freshworks CRM to harness the power of data and create immediate value, challenging legacy CRM solutions that have failed sales teams with clunky interfaces and incomplete data.”
The idea here is to provide teams with all of their marketing and sales data in a single dashboard and provide AI-assisted insights to them to help drive their decision making, which in turn should lead to a better customer experience — and more sales. The service offers predictive lead scoring and qualification, based on a host of signals users can customize to their needs, as well as Slack and Teams integrations, built-in telephony with call recording to reach out to prospects and more. A lot of these features were already available in Freshsales, too.
“The challenge for online education is the ‘completion rate’. To increase this, we need to understand the ‘Why’ aspect for a student to attend a course and design ‘What’ & ‘How’ to meet the personalized needs of our students so they can achieve their individual goals,” said Mamnoon Hadi Khan, the chief analytics officer at Shaw Academy. “With Freshworks CRM, Shaw Academy can track the entire student customer journey to better engage with them through our dedicated Student Success Managers and leverage AI to personalize their learning experience — meeting their objectives.”
Pricing for Freshworks CRM starts at $29 per user/month and goes up to $125 per user/month for the full enterprise plan with more advanced features.
Powered by WPeMatico
Contrast launches its security observability platform
Contrast, a developer-centric application security company with customers that include Liberty Mutual Insurance, NTT Data, AXA and Bandwidth, today announced the launch of its security observability platform. The idea here is to offer developers a single pane of glass to manage an application’s security across its lifecycle, combined with real-time analysis and reporting, as well as remediation tools.
“Every line of code that’s happening increases the risk to a business if it’s not secure,” said Contrast CEO and chairman Alan Naumann. “We’re focused on securing all that code that businesses are writing for both automation and digital transformation.”
Over the course of the last few years, the well-funded company, which raised a $65 million Series D round last year, launched numerous security tools that cover a wide range of use cases, from automated penetration testing to cloud application security and now DevOps — and this new platform is meant to tie them all together.
DevOps, the company argues, is really what necessitates a platform like this, given that developers now push more code into production than ever — and the onus of ensuring that this code is secure is now also often on that.
Image Credits: Contrast
Traditionally, Naumann argues, security services focused on the code itself and looking at traffic.
“We think at the application layer, the same principles of observability apply that have been used in the IT infrastructure space,” he said. “Specifically, we do instrumentation of the code and we weave security sensors into the code as it’s being developed and are looking for vulnerabilities and observing running code. […] Our view is: the world’s most complex systems are best when instrumented, whether it’s an airplane, a spacecraft, an IT infrastructure. We think the same is true for code. So our breakthrough is applying instrumentation to code and observing for security vulnerabilities.”
With this new platform, Contrast is aggregating information from its existing systems into a single dashboard. And while Contrast observes the code throughout its lifecycle, it also scans for vulnerabilities whenever a developers check code into the CI/CD pipeline, thanks to integrations with most of the standard tools like Jenkins. It’s worth noting that the service also scans for vulnerabilities in open-source libraries. Once deployed, Contrast’s new platform keeps an eye on the data that runs through the various APIs and systems the application connects to and scans for potential security issues there as well.
The platform currently supports all of the large cloud providers, like AWS, Azure and Google Cloud, and languages and frameworks, like Java, Python, .NET and Ruby.
Image Credits: Contrast
Powered by WPeMatico
The OpenStack Foundation becomes the Open Infrastructure Foundation
This has been a long time coming, but the OpenStack Foundation today announced that it is changing its name to “Open Infrastructure Foundation,” starting in 2021.
The announcement, which the foundation made at its virtual developer conference, doesn’t exactly come as a surprise. Over the course of the last few years, the organization started adding new projects that went well beyond the core OpenStack project, and renamed its conference to the “Open Infrastructure Summit.” The organization actually filed for the “Open Infrastructure Foundation” trademark back in April.
Image Credits: OpenStack Foundation
After years of hype, the open-source OpenStack project hit a bit of a wall in 2016, as the market started to consolidate. The project itself, which helps enterprises run their private cloud, found its niche in the telecom space, though, and continues to thrive as one of the world’s most active open-source projects. Indeed, I regularly hear from OpenStack vendors that they are now seeing record sales numbers — despite the lack of hype. With the project being stable, though, the Foundation started casting a wider net and added additional projects like the popular Kata Containers runtime and CI/CD platform Zuul.
“We are officially transitioning and becoming the Open Infrastructure Foundation,” long-term OpenStack Foundation executive president Jonathan Bryce told me. “That is something that I think is an awesome step that’s built on the success that our community has spawned both within projects like OpenStack, but also as a movement […], which is [about] how do you give people choice and control as they build out digital infrastructure? And that is, I think, an awesome mission to have. And that’s what we are recognizing and acknowledging and setting up for another decade of doing that together with our great community.”
In many ways, it’s been more of a surprise that the organization waited as long as it did. As the foundation’s COO Mark Collier told me, the team waited because it wanted to be sure that it did this right.
“We really just wanted to make sure that all the stuff we learned when we were building the OpenStack community and with the community — that started with a simple idea of ‘open source should be part of cloud, for infrastructure.’ That idea has just spawned so much more open source than we could have imagined. Of course, OpenStack itself has gotten bigger and more diverse than we could have imagined,” Collier said.
As part of today’s announcement, the group also announced that its board approved four new members at its Platinum tier, its highest membership level: Ant Group, the Alibaba affiliate behind Alipay, embedded systems specialist Wind River, China’s FiberHome (which was previously a Gold member) and Facebook Connectivity. These companies will join the new foundation in January. To become a Platinum member, companies must contribute $350,000 per year to the foundation and have at least two full-time employees contributing to its projects.
“If you look at those companies that we have as Platinum members, it’s a pretty broad set of organizations,” Bryce noted. “AT&T, the largest carrier in the world. And then you also have a company Ant, who’s the largest payment processor in the world and a massive financial services company overall — over to Ericsson, that does telco, Wind River, that does defense and manufacturing. And I think that speaks to that everybody needs infrastructure. If we build a community — and we successfully structure these communities to write software with a goal of getting all of that software out into production, I think that creates so much value for so many people: for an ecosystem of vendors and for a great group of users and a lot of developers love working in open source because we work with smart people from all over the world.”
The OpenStack Foundation’s existing members are also on board and Bryce and Collier hinted at several new members who will join soon but didn’t quite get everything in place for today’s announcement.
We can probably expect the new foundation to start adding new projects next year, but it’s worth noting that the OpenStack project continues apace. The latest of the project’s bi-annual releases, dubbed “Victoria,” launched last week, with additional Kubernetes integrations, improved support for various accelerators and more. Nothing will really change for the project now that the foundation is changing its name — though it may end up benefitting from a reenergized and more diverse community that will build out projects at its periphery.
Powered by WPeMatico
Temporal raises $18.75M for its microservices orchestration platform
Temporal, a Seattle-based startup that is building an open-source, stateful microservices orchestration platform, today announced that it has raised an $18.75 million Series A round led by Sequoia Capital. Existing investors Addition Ventures and Amplify Partners also joined, together with new investor Madrona Venture Group. With this, the company has now raised a total of $25.5 million.
Founded by Maxim Fateev (CEO) and Samar Abbas (CTO), who created the open-source Cadence orchestration engine during their time at Uber, Temporal aims to make it easier for developers and operators to run microservices in production. Current users include the likes of Box and Snap.
“Before microservices, coding applications was much simpler,” Temporal’s Fateev told me. “Resources were always located in the same place — the monolith server with a single DB — which meant developers didn’t have to codify a bunch of guessing about where things were. Microservices, on the other hand, are highly distributed, which means developers need to coordinate changes across a number of servers in different physical locations.”
Those servers could go down at any time, so engineers often spend a lot of time building custom reliability code to make calls to these services. As Fateev argues, that’s table stakes and doesn’t help these developers create something that builds real business value. Temporal gives these developers access to a set of what the team calls “reliability primitives” that handle these use cases. “This means developers spend far more time writing differentiated code for their business and end up with a more reliable application than they could have built themselves,” said Fateev.
Temporal’s target use is virtually any developer who works with microservices — and wants them to be reliable. Because of this, the company’s tool — despite offering a read-only web-based user interface for administering and monitoring the system — isn’t the main focus here. The company also doesn’t have any plans to create a no-code/low-code workflow builder, Fateev tells me. However, since it is open-source, quite a few Temporal users build their own solutions on top of it.
The company itself plans to offer a cloud-based Temporal-as-a-Service offering soon. Interestingly, Fateev tells me that the team isn’t looking at offering enterprise support or licensing in the near future. “After spending a lot of time thinking it over, we decided a hosted offering was best for the open-source community and long-term growth of the business,” he said.
Unsurprisingly, the company plans to use the new funding to improve its existing tool and build out this cloud service, with plans to launch it into general availability next year. At the same time, the team plans to say true to its open-source roots and host events and provide more resources to its community.
“Temporal enables Snapchat to focus on building the business logic of a robust asynchronous API system without requiring a complex state management infrastructure,” said Steven Sun, Snap Tech Lead, Staff Software Engineer. “This has improved the efficiency of launching our services for the Snapchat community.”
Powered by WPeMatico
Edge computing startup Edgify secures $6.5M seed from Octopus, Mangrove and semiconductor
Edgify, which builds AI for edge computing, has secured a $6.5 million seed funding round backed by Octopus Ventures, Mangrove Capital Partners and an unnamed semiconductor giant. The name was not released but TechCrunch understands it may be Intel Corp. or Qualcomm Inc.
Edgify’s technology allows “edge devices” (devices at the edge of the internet) to interpret vast amounts of data, train an AI model locally and then share that learning across its network of similar devices. This then trains all the other devices in anything from computer vision, NLP, voice recognition or any other form of AI.
The technology can be applied to anything from MRI machines, connected cars, checkout lanes, mobile devices and anything that has a CPU, GPU or NPU. Edgify’s technology is already being used in supermarkets, for instance.
Ofri Ben-Porat, CEO and co-founder of Edgify, commented in a statement: “Edgify allows companies, from any industry, to train complete deep learning and machine learning models, directly on their own edge devices. This mitigates the need for any data transfer to the Cloud and also grants them close to perfect accuracy every time, and without the need to retrain centrally.”
Mangrove partner Hans-Jürgen Schmitz, who will join Edgify’s Board comments: “We expect a surge in AI adoption across multiple industries with significant long-term potential for Edgify in medical and manufacturing, just to name a few.”
Simon King, partner and Deep Tech Investor at Octopus Ventures added: “As the interconnected world we live in produces more and more data, AI at the edge is becoming increasingly important to process large volumes of information.”
So-called “edge computing” is seen as being one of the forefronts of deep tech right now.
Powered by WPeMatico
How Roblox completely transformed its tech stack
Picture yourself in the role of CIO at Roblox in 2017.
At that point, the gaming platform and publishing system that launched in 2005 was growing fast, but its underlying technology was aging, consisting of a single data center in Chicago and a bunch of third-party partners, including AWS, all running bare metal (nonvirtualized) servers. At a time when users have precious little patience for outages, your uptime was just two nines, or less than 99% (five nines is considered optimal).
Unbelievably, Roblox was popular in spite of this, but the company’s leadership knew it couldn’t continue with performance like that, especially as it was rapidly gaining in popularity. The company needed to call in the technology cavalry, which is essentially what it did when it hired Dan Williams in 2017.
Williams has a history of solving these kinds of intractable infrastructure issues, with a background that includes a gig at Facebook between 2007 and 2011, where he worked on the technology to help the young social network scale to millions of users. Later, he worked at Dropbox, where he helped build a new internal network, leading the company’s move away from AWS, a major undertaking involving moving more than 500 petabytes of data.
When Roblox approached him in mid-2017, he jumped at the chance to take on another major infrastructure challenge. While they are still in the midst of the transition to a new modern tech stack today, we sat down with Williams to learn how he put the company on the road to a cloud-native, microservices-focused system with its own network of worldwide edge data centers.
Scoping the problem
Powered by WPeMatico
Kong launches Kong Konnect, its cloud-native connectivity platform
At its (virtual) Kong Summit 2020, API platform Kong today announced the launch of Kong Konnect, its managed end-to-end cloud-native connectivity platform. The idea here is to give businesses a single service that allows them to manage the connectivity between their APIs and microservices and help developers and operators manage their workflows across Kong’s API Gateway, Kubernetes Ingress and Kong Service Mesh runtimes.
“It’s a universal control plane delivery cloud that’s consumption-based, where you can manage and orchestrate API gateway runtime, service mesh runtime, and Kubernetes Ingress controller runtime — and even Insomnia for design — all from one platform,” Kong CEO and co-founder Augusto “Aghi” Marietti told me.
The new service is now in private beta and will become generally available in early 2021.
Image Credits: Kong
At the core of the platform is Kong’s new so-called ServiceHub, which provides that single pane of glass for managing a company’s services across the organization (and make them accessible across teams, too).
As Marietti noted, organizations can choose which runtime they want to use and purchase only those capabilities of the service that they currently need. The platform also includes built-in monitoring tools and supports any cloud, Kubernetes provider or on-premises environment, as long as they are Kubernetes-based.
The idea here, too, is to make all these tools accessible to developers and not just architects and operators. “I think that’s a key advantage, too,” Marietti said. “We are lowering the barrier by making a connectivity technology easier to be used by the 50 million developers — not just by the architects that were doing big grand plans at a large company.”
To do this, Konnect will be available as a self-service platform, reducing the friction of adopting the service.
Image Credits: Kong
This is also part of the company’s grander plan to go beyond its core API management services. Those services aren’t going away, but they are now part of the larger Kong platform. With its open-source Kong API Gateway, the company built the pathway to get to this point, but that’s a stable product now and it’s now clearly expanding beyond that with this cloud connectivity play that takes the company’s existing runtimes and combines them to provide a more comprehensive service.
“We have upgraded the vision of really becoming an end-to-end cloud connectivity company,” Marietti said. “Whether that’s API management or Kubernetes Ingress, […] or Kuma Service Mesh. It’s about connectivity problems. And so the company uplifted that solution to the enterprise.”
Powered by WPeMatico