automated testing
Auto Added by WPeMatico
Auto Added by WPeMatico
Reflect, a member of the Y Combinator Summer 2020 class, is building a tool to automate website and web application testing, making it faster to get your site up and running without waiting for engineers to write testing code, or for human testers to run the site through its paces.
Company CEO and co-founder Fitz Nowlan says his startup’s goal is to allow companies to have the ease of use and convenience of manual testing, but the speed of execution of automated or code-based testing.
“Reflect is a no-code tool for creating automated tests. Typically when you change your website, or your web application, you have to test it, and you have the choice of either having your engineers build coded tests to run through and ensure the correctness of your application, or you can hire human testers to do it manually,” he said.
With Reflect, you simply teach the tool how to test your site or application by running through it once, and based on those actions, Reflect can create a test suite for you. “You enter your URL, and we load it in a browser in a virtual machine in the cloud. From there, you just use your application just like a normal user would, and by using your application, you’re telling us what is important to test,” Nowlan explained.
He adds, “Reflect will observe all of your actions throughout that whole interaction with that whole browser session. And then from those actions, it will distill that down into a repeatable machine executable test.”
Nowlan and co-founder Todd McNeal started the company in September 2019 after spending five years together at a digital marketing startup near Philadelphia, where they experienced problems with web testing first-hand.
They launched a free version of this product in April, just as we were beginning to feel the full force of the pandemic in the U.S, a point that was not lost on him. “We didn’t want to delay any longer and we just felt like, you know you got to get up there and swing the bat,” he said.
Today, the company has 20 paying customers, and he has found that the pandemic has helped speed up sales in some instances, while slowing it down in others.
He says the remote YC experience has been a positive one, and in fact he couldn’t have participated had they had to show up in California as they have families and homes in Pennsylvania. He says that the remote nature of the current program forces you to be fully engaged mentally to get the most out of the program.
“It’s just a little more mental work to prepare yourself and to have the mental energy to stay locked in for a remote batch. But I think if you can get over that initial hump, the information flow and the knowledge sharing is all the same,” he said.
He says as technical founders, the program has helped them focus on the sales and marketing side of the equation, and taught them that it’s more than building a good product. You still have to go out there and sell it to build a company.
He says his short-term goal is to get as many people as he can using the platform, which will help them refine their ability to automate the test building. For starters, that involves recording activities on-screen, but over time they plan to layer on machine learning and that requires more data.
“We’re going to focus primarily over the next six to 12 months on growing our customer base — both paid and unpaid — and I really mean that we want people to come in and create tests. Even if they [use the free product], we’re benefiting from that creation of that test,” he said.
Powered by WPeMatico
Meet Waldo, a new product that wants to make mobile testing both faster and easier. The New York-based startup lets you record tests in your browser by interacting with your app like you’d normally do. Every time you compile a new build, Waldo runs the same tests you previously recorded on multiple software and hardware models to tell you if everything works fine.
If you’re an app developer, you currently have two possibilities. You can keep a bunch of smartphones and run your current build on these devices to see if there’s anything wrong, but it takes a ton of time. Or you can develop testing scripts that validate the core features of your app — but that requires additional development and creates a whole new set of headaches when you need to update your scripts.
“It’s always a bit weird that we can create incredible experiences when it comes to UX, but that the way we test those apps is outdated,” co-founder and CEO Amine Bellakrid told me.
Waldo wants to lower the barrier to entry and let smaller mobile development teams take advantage of automated functional and UI testing. It is part of a bigger trend of “no code” startups — no technical skills required.
The company raised a $6.5 million round led by First Round Capital (with Josh Kopelman), with existing investor Matrix Partners and business angels also participating.
Creating tests on Waldo is pretty straightforward. The product runs your app directly (.app / .ipa / .apk), which means you don’t have to create a special version of your app to take advantage of the platform.
After uploading your app, you see your app running in your browser window. Waldo records every screen and every action you take. For instance, you can record the signup flow or a feature that lets you upload content.
Image Credits: Waldo
When you’re done recording your tests, Waldo keeps them for future versions. Every time you have a new build of your mobile app, Waldo runs the same tests on that new version. In addition to that, Waldo can run those tests on other devices with different screen sizes, older versions of mobile operating systems and in different languages.
If a test fails, users get notified and can browse the replay of the test. You can see exactly what went wrong to spot the problematic step more easily.
The idea is that you set up Waldo once and let it run in the background. It integrates with popular continuous integration (CI) tools, such as Fastlane, Bitrise and CircleCI. You can receive alerts in Slack or see the status of your test results in GitHub directly.
“We have customers that run 500 tests at once every week or we have customers that run 10 to 15 tests multiple times a day,” Bellakrid said.
Waldo is launching a free plan today to kick the tires, and you can then pay a subscription to run more tests. Some companies have started using Waldo already, such as AllTrails, Jumprope, KeepSafe and Elevate. Right now, Waldo only works with iOS apps, but the team is already working on adding Android support in the future.
Image Credits: Waldo
Powered by WPeMatico