Testim

Self healing, end-to-end test automation platform

4.7 /5 (24 reviews) Write a Review!

Testim Overview

What is Testim?

Testim is an end-to-end agile testing automation solution which utilizes machine learning for test authoring, execution, and maintenance. Users can create tests in minutes, run thousands of tests in parallel across different browsers, integrate with their existing CI/CD and collaboration tools, and more.

With Testim, users can create tests either by recording or by code, or utilize both in any combination. Test steps can be reused for any other tests users may be running. Thousands of parameters are analyzed for each element, with Testim weighing their overall reliability before ranking them accordingly. Tests can be run with different data sets and conditions, and full customization capabilities are offered, allowing users to run tests on different browsers, operating systems, starting URLs, and more. Visual validations, through native integration with Aplitools Eyes allow users to check pixels, fonts, and other visuals through a screenshot.

Testim enables the running of thousands of tests in parallel across multiple browsers to provide results in minutes. Tests can be run on-premise, on users’ private clouds, or on the Testim cloud. Through integration with CI/CD systems, apps can be deployed automatically when all tests are passed, and feedback on issues can be relayed quickly to developers. All information for failed tests is accessible, and bugs can be reported to bug trackers with a single click. Video and screenshots of bugs can be captured, and users can add annotations to highlight what is wrong. Automated tests can also reproduce the bug locally in the browser for developers to view.

Testim Overview

Pricing

Starting from
N/A

Pricing options

Free Trial
Free
Subscription
Value for money

Basic: free
Pro: customizable plans available, contact Testim for details.


Testim Features

Devices
Business size
S M L
Markets
United States, Canada, United Kingdom, Australia, Germany
Supported Languages
English

Media

Extremely stable tests
Detailed bug reports
Capture & report bugs
Run on multiple browsers
Capture & report bugs
Testim video Testim screenshot: Extremely stable tests Testim screenshot: Detailed bug reports Testim screenshot: Capture & report bugs Testim screenshot: Run on multiple browsers Testim screenshot: Capture & report bugs

Testim Reviews

Testim Reviews

Overall rating
4.7
/
5
Excellent
17

Very good
6

Average
1

Poor
0

Terrible
0

Value for Money
4.6
Features
4.4
Ease of Use
4.5
Customer Support
4.8
96% recommended this app
Noam R.

It's an amazing product. Stable tests created in minutes & results are easily analyzed.

We are very satisfied with Testim.
It easy to use & Provides great results in minimum time.
We definitely recommend it as a main testing platform!


Katya A.

I believe that Testim.io is present and future of automation

From my experience with different automation tools in the past I wholeheartedly believe that "Automation is not an auto-magic". To be efficient, it requires investment. And open source automation tools are not that free as it might seem.
I have been dealing for months with all these "around automation" issues - setups, configurations, environment maintenance, and other technical infrastructure which is important because automation won't work if I don't handle that, but the time that was left for really authoring tests which could show actual value was about 20% of my time (not even talking about dealing with locators and other ongoing maintenance).
This is why I truly believe that to bring real value to my company it would be most effective if we hand over this "side-effect headache" to external professionals who will take care of everything but the business flows and we will add coverage much faster.
Testim gives great value for money allowing to deliver high quality software in a shorter time.

Additionally, Testim is more than just software. It is also a community, shared by Testim staff and customers, where we have the opportunity to exchange customers experiences, participate in road map reviews, join various automation expert panels being held on an ongoing basis and this whole thing increases our level of expertise providing the opportunity to share and learn. This professional growth of employees is definitely a gift companies gain from their cooperation with Testim.


Verified Reviewer

Is Testim customizable?


Anton S.

Best automation tool I worked with

Really best solution that I worked with.
We just ran a successful automation infra in 1/4 time that we could do with Selenium


Verified Reviewer

Testim filled in the automation gaps for our teams

The customer support and training met all of our needs. They are responsive and are quick to guide the team to solutions to our issues and concerns. Providing a view of the run reports is very helpful to our management team and Testim provides us a way to share updates and needs.


Noam R.
Industry: Farming
Company size: 11-50 Employees

It's an amazing product. Stable tests created in minutes & results are easily analyzed.

Used Daily for 2+ years
Reviewed on 8/14/2018
Review Source: Capterra

We are very satisfied with Testim.
It easy to use & Provides great results in minimum time.
We definitely recommend it as a main testing platform!

Pros

With Testim, our time from development to Production has decreased to minutes.

It allows us to test new features in no time with full regression test coverage & CI integration.

Test stability is very high, the results are easy to read and diagnose.

Cons

we still have some difficult with image verification (on dynamic map).

Response from Testim

Hi Naom, thank you so much for your feedback. We are proud to serve customers like you and your team. We strive on making automation simpler and reliable and glad that you are seeing the results of that.

We do use a 3rd party vendor for image verification specifically, it is not part of Testim but we could still ensure we make that integration seamless for you so that, you do not face any problems. We have noted your feedback.

Meanwhile, if you are not specifically looking for pixel level validation (for which we use our 3rd party vendor), what you could do is you could use other types of validations available to you within Testim like element visible, element not visible etc to check whether the right element is getting displayed. Check out this help document for more info - http://docs.testim.io/getting-started/validations.
We value your business and we are always there to support your team 24/7.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Katya A.
Industry: Retail
Company size: 501-1,000 Employees

I believe that Testim.io is present and future of automation

Used Daily for 6-12 months
Reviewed on 8/30/2020
Review Source: Capterra

From my experience with different automation tools in the past I wholeheartedly believe that "Automation is not an auto-magic". To be efficient, it requires investment. And open source automation tools are not that free as it might seem.
I have been dealing for months with all these "around automation" issues - setups, configurations, environment maintenance, and other technical infrastructure which is important because automation won't work if I don't handle that, but the time that was left for really authoring tests which could show actual value was about 20% of my time (not even talking about dealing with locators and other ongoing maintenance).
This is why I truly believe that to bring real value to my company it would be most effective if we hand over this "side-effect headache" to external professionals who will take care of everything but the business flows and we will add coverage much faster.
Testim gives great value for money allowing to deliver high quality software in a shorter time.

Additionally, Testim is more than just software. It is also a community, shared by Testim staff and customers, where we have the opportunity to exchange customers experiences, participate in road map reviews, join various automation expert panels being held on an ongoing basis and this whole thing increases our level of expertise providing the opportunity to share and learn. This professional growth of employees is definitely a gift companies gain from their cooperation with Testim.

Pros

Testim did great job investigating and addressing all famous automation pain points.
First, they take care of all the "side work" (environments, code libraries, setups, versions, etc.) allowing companies to fully concentrate on increasing testing coverage of their business flows.
Second, being stable, reliable and intuitive solution, it allows achieving impressive outcome quite fast. Following best practices, it is quite easy to build very scalable automation project. There was nothing I couldn't achieve with Testim using it for almost a year by now.
Next, the Smart Locators mechanism proves itself de-facto: UI changes but tests keeps running identifying the elements by alternative identifiers.
Last but not least, reporting tools are highly self explanatory allowing developers to easily analyze failures and release QA bottle neck.

To summarize, Testim.io is quite a robust tool allowing to establish and maintain effective automation using both codeless and coded techniques. It is important to understand, that technical background is required to achieve success in automation project. Record&Play is a great start, however in order to be scalable, following the concepts of programming basics (such as reusable components, parameters, loops and conditions) is essential in order to be able to always extend the coverage rather than spending time on tests' maintenance upon application changes.
Having the availability (and passion 🙂) is all you need in order to succeed with Testim.

Cons

There are always things to improve to any software and I have a list of my "nice to have" enhancement requests which is being addressed in our Product-Customers channel. None of them is a showstopper.

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Verified Reviewer
Industry: Computer Software
Company size: 1,001-5,000 Employees

Is Testim customizable?

Used Other for Free Trial
Reviewed on 2/26/2019
Review Source: GetApp

Pros

Easily usable and can be used by anyone.

Cons

It doesnt look customizable. Suppose I need to add certain if else or loops to it, i cant find a way to do so

Response from Testim

First of all, we are glad that you found Testim easy to use. We try to abstract all the features within their specific sections to provide a minimalistic approach with our UI design. Secondly, Yes, Testim is customizable. It is one of the primary features of our platform, where teams can add their own custom code using javaScript and also can make use of Configuration files and run hooks to talk to any external databases such as excel, SQL etc. You will find information about this in these 2 documents. https://docs.testim.io/en/articles/371899-custom-validations-and-actions and https://docs.testim.io/en/articles/371984-configuration-file-run-hooks. In summary, if there is something the tool does not provide, you can add your own code for additional functionalities.

Rating breakdown

Ease of Use

Likelihood to recommend: 3.0/10

Anton S.
Industry: Internet
Company size: 51-200 Employees

Best automation tool I worked with

Used Daily for 1+ year
Reviewed on 9/9/2020
Review Source: Capterra

Really best solution that I worked with.
We just ran a successful automation infra in 1/4 time that we could do with Selenium

Pros

It's very quick and easy to build a successful automation infrastructure that finds bugs in our product

Cons

1. For me missing the option to see the overall network logs per all tests that ran. It can be a very good feature for testing. Even if test passed, sometimes there are some bad network responses that can be good to examine them
2. Missing option to see the failed test that passed in rerun

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 10.0/10

Verified Reviewer
Industry: Hospital & Health Care
Company size: 201-500 Employees

Testim filled in the automation gaps for our teams

Used Daily for 1-5 months
Reviewed on 9/28/2018
Review Source: Capterra

The customer support and training met all of our needs. They are responsive and are quick to guide the team to solutions to our issues and concerns. Providing a view of the run reports is very helpful to our management team and Testim provides us a way to share updates and needs.

Pros

Automating web apps with a fast start up and little training was the draw for my team. We were able to onboard others that normally would not automate tests to assist us once trained on Testim and our standards. Everyone was excited about the use of Testim with our API integrations for the UI, and the flexibility of using variables and shared steps make an important part of our automation tool set.

Cons

The step comments are on the far right and we would like to see them as hover tips. Drag and drop could be included. Once a test fails in the grid, no email alerts are provided until the suite passes again. Scrolling in the app under test has to be worked around.

Response from Testim

We really appreciate your feedback. We strive hard to make our tool really easy to use for people coming from any background and glad your team felt the same way as well.

We have made note of your request regarding your comments preferences. As for Drag and Drop, they automatically get recorded when you perform that action. If you check out this help document - http://docs.testim.io/advanced-steps/drag-drop-step, we give more details about it.
In order to get notified when a test fails on the grid, you can use our scheduler feature and add your email address to the scheduled run to get notified - http://docs.testim.io/run-and-understand-your-test-results/scheduler. If you use a build tool like Jenkins, Travis CI, Team City you can configure the job to get email notifications as well. Let us know if this helps, if not you can always reach out to us to better help you out

Rating breakdown

Value for Money
Ease of Use
Customer Support

Likelihood to recommend: 8.0/10

User recommendation
8.6/10
Based on 24 user ratings
Compare user recommendation rating with alternatives
Compare with alternatives

Testim Pricing

Testim Pricing

Starting from
N/A
Free Trial
Free
Subscription
Value for money

Basic: free
Pro: customizable plans available, contact Testim for details.

Basic: free
Pro: customizable plans available, contact Testim for details.

Value for Money
4.6/5
Based on 24 user ratings
Compare value for money rating with alternatives
Compare with alternatives

Testim Features

Testim Features

API
Access Control
Activity Dashboard
Activity Tracking
Alerts / Escalation
Auditing
Automatic Notifications
Collaboration Tools
Compliance Management
Data Import/Export
Data Visualization
Drag & Drop Interface
Monitoring
Real Time Data
Real Time Monitoring
Reporting & Statistics
Search Functionality
Third Party Integration
User Management
Workflow Management
Features
4.4/5
Based on 24 user ratings
Compare features rating with alternatives
Compare with alternatives

Categories

Additional information for Testim

Additional information for Testim

Key features of Testim

  • Advanced reporting
  • Annotations & mark-ups
  • Auto-create tests
  • Branches
  • Bug tracker
  • CI/CD connection
  • Drill down analysis
  • Errors & logs
  • Export to code
  • Local debugging
  • Multiple projects
  • Parallel execution support
  • Parameterized testing
  • Requirements-based testing
  • SDK (JAVA, JS, RUBY, PYTHON, C#)
  • Screenshot capture
  • Steps to reproduce
  • Test conditions
  • Test editor
  • Test script reviews
  • Video capture
  • Visual validation
  • Webhooks

Benefits

  • Thousands of tests can be run in parallel across multiple browsers, and tests can be run on-premise, in users’ private clouds, or on the Testim cloud.

  • Actions taken within apps are captured as screenshots, HTML DOM can be saved in cases where tests fail and debugging is required, and Applitools Eyes integration allows users to visually compare test results.

  • Bugs can be reported to bug tracking systems with a click, with all required information attached.

  • Thousands of parameters are analyzed for each element, and Testim weighs their overall reliability before ranking them accordingly.

  • Tests can be created either by recording or by code, or both can be utilized in any combination.

  • Users can run tests with full OS, browser, starting URL, and other customization capabilities, different conditions, and different data sets.

  • Testim FAQs

    Testim FAQs

    Below are some frequently asked questions for Testim.

    Q. What type of pricing plans does Testim offer?

    Testim offers the following pricing plans:

    Pricing model: Free, Subscription

    Free Trial: Available

    Basic: free Pro: customizable plans available, contact Testim for details.

    Q. What are the main features of Testim?

    Testim offers the following features:

    • Advanced reporting
    • Annotations & mark-ups
    • Auto-create tests
    • Branches
    • Bug tracker
    • CI/CD connection
    • Drill down analysis
    • Errors & logs
    • Export to code
    • Local debugging
    • Multiple projects
    • Parallel execution support
    • Parameterized testing
    • Requirements-based testing
    • SDK (JAVA, JS, RUBY, PYTHON, C#)
    • Screenshot capture
    • Steps to reproduce
    • Test conditions
    • Test editor
    • Test script reviews
    • Video capture
    • Visual validation
    • Webhooks

    Q. Who are the typical users of Testim?

    Testim has the following typical customers:

    Large Enterprises, Mid Size Business

    Q. What languages does Testim support?

    Testim supports the following languages:

    English

    Q. What type of pricing plans does Testim offer?

    Testim has the following pricing plans:

    Free, Subscription

    Q. Does Testim support mobile devices?

    We do not have any information about what devices Testim supports

    Q. What other apps does Testim integrate with?

    Testim integrates with the following applications:

    BrowserStack, CircleCI, GitHub, Jira, Slack, TestRail, Trello

    Q. What level of support does Testim offer?

    Testim offers the following support options:

    Phone Support, Online Support, Knowledge Base, Video Tutorials