Frequently Asked Questions
What types of application testing does TestCraft support?
TestCraft currently supports web application testing and mobile web application testing. Our platform does not yet support native mobile application testing, but this capability is on our product roadmap and we are working hard to offer this soon.
What types of testing does TestCraft do?
TestCraft is ideally suited for the following testing types:
Learn how our customers use TestCraft to improve their software testing efforts in these case studies.
When you say TestCraft is “codeless,” what does that mean?
TestCraft a fully codeless test automation platform. Any tester, regardless of coding knowledge or experience, can automate test scenarios visually using our tool.
However, we allow organizations to add code as well, if necessary.
What is the real difference between TestCraft and using Selenium on its own?
TestCraft is a codeless test automation tool that is based on Selenium code. By offering a codeless test automation option, TestCraft makes Selenium accessible to any tester, rather than limiting Selenium only to those with previous coding skills.
TestCraft offers many other advantages over using Selenium on its own. We are a purely SaaS platform, which comes with a fully built-in framework. Alternatively, with Selenium you are responsible for building and maintaining a framework on your own. TestCraft is also easier to use and maintain over time, due to our unique test modeling capabilities and AI-based, self-healing technology. The visual way in which TestCraft works makes it much easier to design and maintain the tests, as well as reuse elements. This means that TestCraft allows for faster testing than Selenium.
Feel free to consult this article to see more differences between TestCraft and native Selenium.
What, if anything, does a user need to set up before running a test suite?
TestCraft is a SaaS solution, so everything is set up for you from the start with a built-in testing framework. All you need to do before running your test suite is to define your test scenario using a simple drag-and-drop canvas or build your test during runtime using our on-the-fly test creation mechanism.
One major advantage of TestCraft is its “On-the-Fly” mode, which creates a test model out of your test scenario instead of a recording. While TestCraft functions as simply as a record-and-playback tool, this test model makes it easier to reuse test steps and apply changes, as needed. Any change to a test step will apply automatically to all other scenarios that use it, reducing test maintenance time dramatically. This helps the tester achieve the best of both worlds of automated test creation: simplicity and scalability.
How does TestCraft identify collections of elements on the page?
TestCraft has a machine learning algorithm, which identifies web elements by collecting all the possible data on all the web page elements at a given time. These attributes are then all fed into the algorithm, which determines the most probable element that it should be looking for in any given run. This helps the platform identify the web element correctly even when a web application change occurs.
Our AI-based, self-healing technology allows the TestCraft platform to overcome changes, such as an enlarged signup button or a form that has moved to a different location, and prevent unnecessary test breakages. This helps reduce test maintenance time dramatically.
How does TestCraft handle network timeouts, as well as other issues that can cause testing delays?
When executing a test flow, we automatically wait for three things:
A. Complete page load
B. All AJAX requests
C. All CSS animations
The platform will then wait for a configurable amount of time, which you can define beforehand, and then it will show a time-out error. For test steps that typically require more time to execute, you can define an explicit timeout as needed.
How can I test different data sets within the same test cases?
You can easily set different data to different scenarios by either entering the data manually or injecting the values from a spreadsheet. For example, if you are looking to test a login scenario, you can do so with various emails and passwords. Each email and password combination counts as a different data set, so you can ensure that your website process is functioning properly.
How do I add any validation checkpoints?
A validation step is just another step in the scenario. You can have different types of validation as part of the scenario, which can be done as part of the test.
Does TestCraft support complex web applications, such as React, Angular, Salesforce, etc.?
Our codeless testing platform is language-agnostic, which means that we support testing for any type of web application. This applies to React & Angular applications, as well as other SPAs. We also support JavaFX testing (although only for a JavaFX web application, not their desktop application).
We also offer support for a wide range of enterprise SaaS applications, such as Salesforce, Workday, ServiceNow, and SAP.
Does TestCraft support web applications that are hosted on-premises?
Yes. In order to support testing for on-prem web applications, we would need to access the internal application through a local tunnel, whether it’s through whitelisting the IP address, a VPN, or another method.
Does TestCraft convert Selenium scripts to TestCraft test scenarios?
We can convert TestCraft test scenarios into Selenium-based test scripts in certain circumstances, but we do not allow users to import Selenium code and convert them into TestCraft tests. This way, our customers will not spend unnecessary time maintaining the Selenium tests that prevented them from testing at scale in the first place.
How can I customize a set of scenarios (out of all the created ones) for a specific environment?
You can add multiple tests to a suite to define a specific scenario so it would run on different browsers and work environments.
Does TestCraft support visual testing?
Yes. We have an integration with Applitools that you can use to validate elements visually.
We have one application which needs to be tested on multiple devices. Can TestCraft support this?
Yes. We can test web applications in various browsers and work environments, including mobile web.
How does TestCraft conduct automated testing when there are stringent security protocols?
TestCraft is committed to meeting the highest security standards. We work with a variety of customers that are highly sensitive to protecting their data and complying with certain industry and general data protection regulations. As a SaaS platform, we offer the benefits of flexibility, scalability, and license cost reduction that come with operating on the cloud, while also maintaining strict security measures.
You are invited to read more about TestCraft’s security policies and practices here.
Where does TestCraft store test elements?
All test elements are stored in the cloud. This allows any tester on your team to access and reuse any test element.
Does TestCraft identify web elements automatically?
Our AI-based technology identifies web elements automatically, but you also have the option to identify elements manually, as needed.
Can I test complex elements?
Yes. TestCraft allows users to test a wide range of web elements, from iFrames to elements that are hidden within a Shadow DOM.
Can I kick off tests automatically after a build process?
Yes, you can trigger that in a scheduled manner, through the CI/CD. We offer integrations with all the major CI/CD platforms, such as Jenkins, TeamCity, and others.
How reliable is TestCraft’s machine learning algorithm?
TestCraft’s machine learning algorithm accounts for changes in web applications with 97.4% accuracy. This means that in 97.4% of test scenarios, TestCraft will either overcome a change and identify the correct element or correctly identify a bug and cause the test to fail accordingly.
You also have the option to modify tests manually, as needed. If a test breaks, binding can be done quickly and easily using TestCraft’s On-the-Fly mechanism during runtime.
Which integrations does TestCraft offer?
TestCraft offers a variety of integrations that cover virtually every step of the software testing cycle. Some of our more popular integrations include:
- Azure DevOps
We are constantly adding more integrations to enhance the continuous testing process.
Can I run multiple scripts at a time with TestCraft?
Yes. The number of tests you can run concurrently depends on your TestCraft licensing agreement.
What cloud locations does TestCraft offer?
We offer cloud locations in the U.S. and in Ireland for Europe.
Are the scheduling times on TestCraft customizable?
Yes. You can customize your schedule to have your tests run at any time, in different environments. You can also run multiple tests in parallel, depending on your needs.
How does TestCraft deal with multiple versions of a system under test?
With our platform, it’s very easy to reuse tests for different versions of your application. Alternatively, you can also clone a test and modify it to better fit your specific version.