No more typing reviews! Try our Samantha, our new voice AI agent.

CloudBees vs Digital.ai Continuous Testing comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Mar 15, 2026

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

CloudBees
Ranking in AI-Augmented Software-Testing Tools
4th
Average Rating
8.4
Reviews Sentiment
7.0
Number of Reviews
20
Ranking in other categories
Build Automation (10th), Configuration Management (12th), Value Stream Management Software (2nd), DevSecOps (9th), Feature Management (3rd), AI Software Development (23rd)
Digital.ai Continuous Testing
Ranking in AI-Augmented Software-Testing Tools
2nd
Average Rating
7.6
Reviews Sentiment
4.9
Number of Reviews
7
Ranking in other categories
Mobile App Testing Tools (3rd), Test Automation Tools (16th)
 

Mindshare comparison

As of October 2026, in the AI-Augmented Software-Testing Tools category, the mindshare of CloudBees is 2.7%. The mindshare of Digital.ai Continuous Testing is 5.5%, down from 10.3% compared to the previous year. It is calculated based on PeerSpot user engagement data.
AI-Augmented Software-Testing Tools Mindshare Distribution
ProductMindshare (%)
Digital.ai Continuous Testing5.5%
CloudBees2.7%
Other91.8%
AI-Augmented Software-Testing Tools
 

Featured Reviews

KishoreKumar4 - PeerSpot reviewer
Senior Qe Lead at Cognizant
Consistent automation has improved deployments and supports efficient client-facing workflows
Deployment and other processes are feasible for me, making this a smooth process. The integration part is good. We can use multiple things by integrating with CI/CD pipelines, and this is very feasible for us. This allows us to do our work easily. The productivity is very good. CloudBees is a good and efficient tool. We can work in client-facing scenarios, and since clients have provided these types of tools, we are able to work on them effectively.
Mampi Bhattacharya - PeerSpot reviewer
Developer at a tech vendor with 10,001+ employees
Continuous testing has accelerated daily releases and now provides faster, richer debugging insights
Digital.ai Continuous Testing could be better in certain areas, and I can share my experience-based view on what can be frustrating. One issue is device availability and queue delays during peak CI hours. Sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines. Improvements are needed in smarter auto-scaling of device pools and better priority-based scheduling. Additionally, execution speed variability occurs; the same test sometimes runs fast and sometimes slow, depending on device load and network latency, making results less predictable. More stable execution environments and better performance isolation per session would help. Furthermore, debugging can still be indirect; even with logs or videos, I do not fully control the device as I would with local debugging, making it hard to pause and inspect live states or reproduce edge-case issues locally. More interactive debugging and improved local reproduction tools are necessary. Cost versus usage efficiency is another area of concern, as device cloud usage can be expensive and we sometimes have idle or inefficient tests that waste money. Improvements in usage analytics and cost optimization suggestions for smart test selection to run only impacted tests are areas where I believe Digital.ai Continuous Testing could improve.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"CloudBees is the Jenkins tool for building and deploying. There's open-source Jenkins, which is free and can be used by any organization, but it offers a different architecture for Jenkins. If your organization is larger, you might choose the architecture. This way, you can have different masters for different applications, and different teams can manage their masters separately. However, a single person can still control all the masters, whoever manages it for the organization."
"CloudBees assists by automating tasks, previously done manually, in the pipeline setup."
"CloudBees is a good and efficient tool."
"CloudBees is a user-friendly tool."
"It’s a very good tool for auditing your project pipelines as well."
"CloudBees operates seamlessly. Deploying to a cluster is straightforward—just one click, and the job is done."
"The most valuable features are Java features, microservice communication, payment validation, Jenkins Sonar, management master to CloudBees, Blue Ocean, JobConfig, and support."
"The security audit product offered by CloudBees is particularly beneficial in automating audit processes, which reduces the time developers spend on audits."
"I have seen a clear positive ROI after implementing Digital.ai Continuous Testing, especially in terms of time saving, faster release cycle, and improved efficiency."
"Digital.ai Continuous Testing has positively impacted my organization with massive reductions in testing time, enabling us to cut our regression cycle from two to three days down to two to three hours, transition from weekly releases to nearly daily deployments, and reduce production defects by 30 to 50% while significantly improving debugging efficiency and overall team productivity."
"The most useful feature for me is Mobile Studio. It has a UI where I can click on elements, and it generates a script for me. Mobile Studio can generate code from testing steps. I'm using Python with it."
"Digital.ai Continuous Testing has had a very positive impact in terms of efficiency and quality."
"Experitest is one of the only companies to offer a real device on the cloud to perform testing, and they also provide quality documentations that help you navigate and maximize the solution."
"The most valuable part of Experitest is the number of real devices on which the test is run."
"Digital.ai Continuous Testing has had a pretty positive impact on the organization, especially in terms of speed and reliability."
 

Cons

"The user interface of CloudBees is good but could be even more intuitive. Improving the user-friendliness of the interface and having simpler setup configurations would greatly benefit new users."
"We did face some challenges, particularly with the infrastructure."
"The setup is somewhat complicated. You need a cloud architect and engineer to set it up properly. The initial setup will take time, so you need a good engineer and architect to handle it."
"We've noticed occasional issues with folder permissions changing unexpectedly. Specifically, permissions sometimes shift from the CloudBees user to the root user. This can cause pipeline failures, as pipelines require the correct CloudBees user permissions to execute properly."
"It could improve the document upload process."
"If you're logged in and working for about thirty minutes and then go idle for five to ten minutes, Jenkins will prompt you to re-authenticate."
"One challenge I'd like to highlight is that with CloudBees CI growing bigger and bigger, there are limitations in terms of managing old plugins and services and upgrading them with time."
"Sometimes, there are performance issues, however, they may be due to our organization's configuration."
"The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I submit a ticket to technical support, but they often have to fix it in the next version."
"The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before."
"Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times."
"I would also like to see more videos and descriptions that could make installation more efficient."
"Digital.ai Continuous Testing is a strong platform, but there are a few areas where it could be improved to make the experience even better."
"One challenge is that the initial setup and integration with CI/CD pipelines can sometimes be a bit complex, especially for teams new to automation."
"I believe that it could be more stable. During times when something is not working, it is difficult to find the solution."
"Device availability and queue delays during peak CI hours are an issue; sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines."
 

Pricing and Cost Advice

Information not available
"We make monthly payments. The cost is dependent on the number of devices we intend to support."
"It is quite fairly priced, but it really depends on your budget. It is somewhere in the mid-range of products. It is not free and it is not QGP that nearly costs a whole house. You pay for the number of users who require access to execute the tests."
"The price is reasonable for our company, but I'm not the decision-maker."
report
Use our free recommendation engine to learn which AI-Augmented Software-Testing Tools solutions are best for your needs.
917,403 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Construction Company
18%
Manufacturing Company
16%
Financial Services Firm
13%
Comms Service Provider
10%
Outsourcing Company
22%
University
14%
Financial Services Firm
11%
Retailer
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business2
Midsize Enterprise2
Large Enterprise18
By reviewers
Company SizeCount
Small Business4
Midsize Enterprise2
Large Enterprise2
 

Questions from the Community

What needs improvement with CloudBees?
For CloudBees, I can suggest that the log is very high, which is very hectic for us when trying to find which error is coming. This creates complexity. If possible, we could sort the logs so we can...
What is your primary use case for CloudBees?
We use CloudBees for deploying the code in higher environments, such as QA, C2, staging, and production.
What advice do you have for others considering CloudBees?
We can upload the JAR file and deploy at the Jenkins level during our deployment. These types of labels and IDs can be deployed using CloudBees. Once we click to start the build, it automatically r...
What needs improvement with Digital.ai Continuous Testing?
Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times. One thing I noticed is that the initial setup and configuration can feel complex, especia...
What is your primary use case for Digital.ai Continuous Testing?
The main use case for Digital.ai Continuous Testing has been automating test execution as part of the CI/CD pipeline, especially for ensuring builds are stable before the release. For example, I us...
What advice do you have for others considering Digital.ai Continuous Testing?
If someone is considering using Digital.ai Continuous Testing, my advice would be to start with a clear workflow in mind. From my experience, it works best when you use it as part of a CI/CD pipeli...
 

Also Known As

No data available
Experitest Seetest, Experitest
 

Overview

 

Sample Customers

Capital One, PEGA, vistaprint, HSBC, BOSCH, Starbucks Coffee
Samsung, American Express, Barclays, China Mobile, Citi, Cisco, McAfee
Find out what your peers are saying about CloudBees vs. Digital.ai Continuous Testing and other solutions. Updated: September 2026.
917,403 professionals have used our research since 2012.