1. Carburetor Jetting Guide
2. Holley Carburetor Jetting Guide

MOTORIZED BICYCLE PERFORMANCE MODIFICATIONS FOR CHINA GAS GRUBEE ENGINE by Michael Forrest. Message to beginners. Software available for modifications. Carburetor Jetting Tips. Reed valve intake. Upgrading your carburetor. Dellorto carburetor. Mar 27, 2018  The process to jet a carburetor correctly for high-performance or racing applications uses a similar method as to how you would tune a street car, except the size of the carburetor is different. Lee Walker from Quick Fuel Technology explains how you can make sure you’ve got the right jets in your carburetor on race day. For the most part, motorcycles and carburetors have come to a parting of the ways. While a few carburetor-equipped bikes are still on the market, the vast majority of. In older Mopars, ignition timing and fuel parameters were easily adjustable by twisting the distributor to add timing, and jetting the carburetor to get more fuel to.

The California Air Resources Board supports the state’s climate goals with investments in low-carbon transit and development that puts housing closer to work and transportation hubs.

Dlc9lp. California has made significant progress to reduce our exposure to harmful air pollutants, the result of regulations and programs based on sound science. These achievements reflect a collective and bipartisan effort over the past half century that involves the Legislature, air districts, regulated industries and the public. We have come a long way but many in our state still breathe unhealthful air, and childhood asthma rates are above the national average.

There is far more work to be done. CARB stands ready as it enters its next 50 years to build on this strong environmental legacy and ensure that all Californians will breathe clean air.

Need assistance or information about programs or regulations? We are ready to help with a range of resources.

Today we’re faced with both a growing number of ways to test new software and a growing number of tools to accomplish those tests. And who really has time to keep track of the hundreds (and counting) of tools out there? Fortunately for you, we do. Use the navigation to the right to jump to different testing tool categories.

Before you get lost in the deep indexes of Google trying to figure out the best software testing tools for your needs, take a look at this trusty list developed by the software testing experts here at QASymphony. Be sure to checkout QASymphony’s software testing tools after spending some time here.

Here’s what you can expect:

There are 102 software testing tools and 8 categories all with the following information:

• Summary of the testing tool
• UI Screen Shots
• Key Features
• What you need to know
• Links to customer reviews (where applicable)
• Pricing (if available)

We’ve broken down our recommendations into 8 categories, plus a bonus section with up and coming tools to keep an eye on.

Extra: Need even more help narrowing your search? Check out our enterprise guide to evaluating software testing tools for best practices to ensure a successful evaluation.

Test Automation Tools

Test automation is one of the most mature software testing segments. Currently, the rise of good open source options and the push toward DevOps and multichannel models are transforming this segment.

We can break down test automation tools into two subcategories:

• Functional testing
• Integration/API testing

Functional Software Testing Tools

Why use Functional Testing tools? Functional Testing tools drive automated tests by interacting with the UI layer of an application. These tools usually provide a record and playback interface, making it easier for nontechnical testers to provide automation coverage. However, these tests can be slow and brittle.

These tools usually provide a record and playback interface, making it easier for nontechnical testers to provide automation coverage.

1. Tricentis Tosca Testsuite

Summary: Provides model-based test automation focused on test case design versus problem solving. The Tosca Testsuite also offers end-to-end testing and recording capabilities.

Features:

• Offers support for Agile
• Includes a more complete set of tools around test data management and Orchestration
• Delivers model-based automation support that allows for easier reuse/less maintenance

What you really need to know: With the Tosca Testsuite, Tricentis has focused on creating model-based automation and a “mini-suite” that goes beyond pure test automation to provide risk coverage and test case design as well.
For more information:Check out the Tricentis test-automation site.
Reviews:Head over toITCentralStation.com or G2Crowd.com to read reviews.

2. HP Unified Functional Testing (UFT)

Summary: Previously known as QuickTest Professional (QTP), HP UFT automates GUI functionality and back-end service testing. It also offers reusable test components, helps convert manual testing assets into automated ones, embraces the shift left to make testing part of the Agile development cycle, and allows for testing across multiple machines and devices.

Features:

• Strong partner network
• Increasing support for newer browsers and mobile (though HP does fall behind other market leaders)
• Integrated offering that includes other test tools

What you really need to know: Although HP remains the market share leader in paid test automation, it has recently struggled to focus on newer platforms, ceding ground to competitors.
For more information:Check out the HP UFT site
Reviews: Checkout UTF reviews over at ITCentralStation.com
Pricing: Plans start at $600 per month with three pricing tiers. Visit their pricing page to learn more.

3. IBM Rational Functional Tester

Summary: Part of IBM’s larger Rational testing platform, the Rational Functional Tester uses>ToolCapabilityApache JMeterAPI TestingSoapUIAPI TestingPowerMockObject MockingEasyMockObject MockingREST AssuredAPI TestingWebInjectAPI TestingMockitoObject MockingJmockitObject MockingmocktailObject MockingWireMockObject MockingBetamaxObject MockingMockserverObject Mocking

Performance Testing Tools

Performance testing tools take a simple automation script and run it through hundreds or thousands of machines to simulate how an application will perform under load.

These tests are typically expensive and are run less frequently than functional automation tests. Performance testing is particularly important for cloud applications and there are two main types to consider:

• Pure Play
• Extension Tools

This list represents both pure play and extension tools, each of which has its pros and cons. Here’s what you need to know about the difference between the two types of tools:

Pure Play Performance Testing Tools

Pros:

• Typically cheaper
• Creates less friction during purchase and implementation processes
• Offers faster development with best of breed tools
• Supports more integration and open source use

Cons:

• Requires separate scripts/languages to train and maintain

Extension Performance Testing Tools

Pros:

• Allows for reuse of past automation scripts
• Uses familiar languages
• Offers a single vendor relationship across multiple tools

Cons:

• Follows slower, less focused development
• Provides a closed ecosystem that limits access to best of breed tools
• Typically more expensive and geared toward large organizations

1. Tricentis Flood

Tricentis Flood is a cloud-based, distributed load testing platform that helps teams test how their applications scale with massive load generated from around the world. Flood can generate load using popular open source load testing tools (such as Apache JMeter, Flood Element, Gatling and Chrome) as well as Tricentis Tosca functional testing cases (API and UI).

Flood is easily integrated with CI tools like Jenkins and Bamboo, as well as the most popular APM tools like New Relic, AppDynamics, and Dynatrace. Additionally, Flood can be integrated into your own private hosting account with providers like AWS and Azure.

Flood’s free trial comes with 5 node hours that can be used to jump-start your load testing. Subscriptions come in flexible options to meet your budget, with different options of testing capacity, features, hosting, and term length. Try it free here.

2. Automation Anywhere Testing Anywhere

Summary: Uses robotic process automation to automate any type of testing and offers cross platform support for mobile, web and desktop. Automation Anywhere can convert scripts into load scripts and allows for machine learning and analytics.

Features:

• Offers easy conversion from automation
• Less expensive but similar to HP
• Includes a TestLab to control testing devices

Tool Type: Extension
What you really need to know:Automation Anywhere is a lower end competitor to HP that offers some test case management capabilities as well as more robust automation capabilities.
For more information: Check out their automation RPA solution.
Reviews: Head over to G2Crowd.com or ITCentralStation.com to read a few reviews.

2. BlazeMeter

Summary: Runs open source-based performance tests as well as scalable load testing. BlazeMeter is compatible with Apache JMeter, offers real-time reporting and mobile capture, simulates network conditions and allows developers to create and edit performance tests.

Features:

• Scalable
• DevOps ready
• Uses open source and AWS
• Offers strong support for APIs and customization

Tool Type: Pure Play
What you really need to know:BlazeMeter is a growing player in the cloud performance testing space. Although it has limited use cases and does not offer monitoring or post-production capabilities, it is popular with developers.
For more information:Checkout the BlazeMeter performance testing solution.
Pricing: Free plan available, but paid plans start at $99 per mo with 3 pricing tiers. Visit their pricing page.

3. Borland Silk Performer

Summary: Offers unlimited scalability to simulate any size load as well as a variety of network technologies, including mobile. Silk Performer also provides visual diagnostics and stress testing with pattern detection. As part of Borland’s larger Silk Central platform, Silk Performer also includes a wide variety of supporting capabilities.

Features:

• Offers cross-platform support
• Mature
• Well-integrated into Silk Central
• Integrates with monitoring tools and IDEs

Tool Type: Extension
What you really need to know:Borland is a robust competitor to HP (although it does offer similarly high prices), with strong cross-platform support and cloud load capabilities.
For more information: Checkout Silk Performer load and stress performance testing.
Reviews: Head over to ITCentralStation.com to read a few reviews.

4. CA Technologies Application Test

Summary: Automates testing and embraces the shift left. The CA Application Test tool allows for functional, regression and user journey testing in addition to performance testing. The tool is workflow-driven and works with mobile devices.

Features:

• Offers robust mainframe support
• Allows for reuse of LISA test cases and infrastructure
• Creates a load on an internal network with few resources

Tool Type: Extension
What you really need to know:CA Technologies is mostly focused on competing in the mainframe space and testing desktop applications and complex infrastructure using LISA.
For more information: Checkout CA Technologies website.

5. HP LoadRunner, Performance Center & StormRunner

Summary: HP offers a combination of three tools for performance and load testing. LoadRunner provides comprehensive load testing with interactive simulations and root cause analysis capabilities, while Performance Center creates a center of excellence for reusing best practices and resources across testing for multiple applications. Both LoadRunner and Performance Center support continuous and mobile testing. Finally, StormRunner extends testing capabilities to the SaaS world.

Features:

• Robust and mature tools
• Supports legacy and newer technologies
• Cloud enabled
• Offers record and playback or scripting
• Allows for reuse of Unified Functional Testing tests

Tool Type: Extension
What you really need to know:With both LoadRunner and Performance Center as well as StormRunner to extend to the cloud, HP is a leader in this space.
For more information: Checkout the StormRunner Load, Performance Center and LoadRunner sites.
Reviews: Read LoadRunner reviewshere, StormRunner Loadhereand Performance Centerhere.
Pricing: LoadRunner/StormRunner Load is priced at $.56 per virtual user per day, but they have a free edition as well. Visit their pricing here.

6. IBM Rational Performance Tester

Summary: Offers code-free testing and real-time reporting as well as root cause analysis tools. IBM Rational Performance Tester also compares test results to SLA targets, integrates with IBM Rational Quality Manager and includes a test recorder.

Features:

• Robust and mature tool
• Supports legacy and newer technologies
• Cloud enabled
• Offers record and playback or scripting
• Allows for reuse of Rational Functional Tester tests

Tool Type: Extension
What you really need to know:IBM Rational Performance Tester is cloud enabled and offers web and desktop support, but its mobile support is extremely weak.
For more information: Checkout the Rational performance test automation solution.
Reviews: Head over to ITCentralStation.com to read reviews.

7. Neotys NeoLoad

Summary: NeoLoad uses an intuitive GUI for use case creation, target identification and test execution. It allows you to simulate load locally or using the Neotys Cloud Platform, supports web and mobile and monitors all servers during load testing.

Features:

• Provides end-to-end testing
• Offers cross-platform capabilities
• More affordable pricing than legacy solutions
• Cloud and on premise enabled

Tool Type: Pure Play
What you really need to know:Neotys is a small but fast-growing player with cross-platform support for web and mobile (via NeoLoad) and post-production monitoring capabilities (via NeoSense).
For more information: Visit Neotys.com to learn more.
Reviews: Visit ITCentralStation.com to read reviews.

8. Parasoft Load Test

Summary: Provides performance, stress and concurrency testing with the ability to simulate various loads and test from different locations. Parasoft Load Test can also enforce Quality of Service metrics and run tests using tests previously created in Parasoft.

Features:

• Supports legacy applications
• Mature tool
• Allows for reuse of other tests created with Parasoft
• Offers performance monitoring capabilities

Tool Type: Extension
What you really need to know:While Parasoft Load Test does allow for reuse of test cases under load and provides performance monitoring and desktop and web support, it does not have any mobile capabilities and is not cloud enabled.
For more information: Learn more about Parasoft load testing.
Reviews: Visit the Parasoft review page onTrustRaidus.com and ITCentral Station.com

9. Radview WebLOAD

Summary: Simulates a variety of load conditions for an unlimited number of users and distributes the load across any number of machines. Radview WebLOAD can also monitor server performance and offers cross-platform support for web, desktop and mobile (via PerfectoMobile).

Features:

• Mature tool
• Some cross-platform support
• Some open source support (supports Selenium)

Tool Type: Pure Play
What you really need to know: Radview is a fledgling player in performance testing that was previously publicly listed but has since been delisted and is not performing very well currently (it has scaled down from 100 employees to about 25).
For more information:Checkout Radview performance testing
Reviews: VisitG2Crowd.comto read Radview reviews.
Pricing: Plans start at € 1,990 per license with 3 pricing tiers. Request pricing here.

10. SmartBear LoadComplete

Summary: A desktop tool for load, stress and scalability testing that works with both HTML sites and rich internet applications. SmartBear LoadComplete can generate load from virtual machines, on premise computers or the cloud and offers record and replay capabilities, visual programming, a test cost simulator, distributed load testing, analytics and functional test reuse.

Features:

• Mature tool
• Offers performance monitoring capabilities
• Allows for easy deployment of tests both on desktop and in the cloud
• Lower priced than HP

Tool Type: Extension
What you really need to know:LoadComplete is a core SmartBear product and extension of TestComplete. It offers web support, is cloud enabled and provides monitoring capabilities, but it has no mobile capabilities.
For more information: Learn more about LoadComplete performance testing.
Pricing: Offers a free version with plans start at $230 per year and 5 pricing tiers. View pricing here.

11. Soasta CloudTest

Summary: Offers continuous load testing at any scale with real-time analytics. Soasta CloudTest also has embedded user monitoring capabilities and allows users to build tests using RUM-based data and application-specific scenarios.

Features:

• Offers cross-platform support
• Innovative tool
• Ties in directly with performance monitoring
• Enterprise-ready

Tool Type: Pure Play
What you really need to know:Soasta is the largest player in the pure play space, with more than $75 million in funding to date. It provides cross-platform support with CloudTest for web and TouchTest for mobile (which also provides mobile automation) and offers post-production performance monitoring with mPulse.
For more information: Learn more about Soasta CloudTest load and performance testing.
Reviews: Read CloudTest reviews onITCentralStation.com
Pricing: Offers a free version with plans start at $2500 per year and 2 pricing tiers. View pricing here.

12. TestPlant eggPlant Performance

Summary: Provides cloud-based, distributed load simulations with dynamic test controls and standard scripting languages. It also provides application-level virtual users for more complete test coverage. TestPlant’s eggPlant Performance tool is part of the larger eggPlant range of testing tools.

Features:

• Offers cross-platform support
• Allows for reuse of functional tests as performance tests
• Can traverse various layers of applications including UI, API and command line layers

Tool Type: Extension
What you really need to know:eggPlant Performance can support web, desktop and mobile testing as an extension of eggPlant Functional.
For more information: Learn more about TestPlant eggPlant.
Pricing: No prices listed, but view licensing and pricing information here.

Test Management Tools

Test management is a mature testing segment currently being transformed by the widespread adoption of Agile, DevOps and Test Driven development. Most test management tools are either geared toward Agile or Waterfall development methodologies.

Below are Test Management tools to consider:

1. qTest Manager by QASymphony

Summary: Provides tracking, management, organization and reporting capabilities for software testing and test case management. qTest Manager sets up and manages requirements, organizes and manages test cases, executes tests, tracks defects and reports on test data. It also integrates with JIRA, Rally and VersionOne as well as other popular automation tools.

Features:

• User-friendly interface
• Allows for a variety of integrations such as JIRA, Jenkins, Rally and automation
• Supports manual, exploratory and automated testing all in once place
• Market leader in software testing tools built for Agile teams.

What you really need to know: qTest Manager is a market leader in test management tools and is the only platform tool that offers a single source of truth for manual, exploratory and automated testing. It also offers the most comprehensive view of testing efforts, reporting and provides seamless integrations with leading automation tools and JIRA.
For more information: Learn more about qTest test management here.
Reviews: Read qTest reviews on their G2Crowd.com listing page.
Pricing: No prices listed on their website, but you can request pricing here.

2. SmartBear QAComplete

Summary: Provides visibility into the testing process with capabilities to manage, organize and report on tests. SmartBear QAComplete offers out-of-the-box templates or custom workflow options, defect logging, the ability to trace tests to user stories and reusability across the testing cycle. It also integrates with tools like Jira, Selenium and SoapUI.

Features:

• Highly customizable
• Supports a variety of integrations

What you really need to know: SmartBear QAComplete provides a single location to manage testing. Through customization, it can work for both Agile and Waterfall development processes.
For more information: Learn more about QAComplete.
Pricing: Plans start at $599 per year with 2 pricing tiers. View pricing here.

3. Zephyr

Summary: Supports creation, planning, execution and tracking of tests. Zephyr supports structured and free-form tests as well as manual and automated tests and integrates with leading tools like JIRA, Confluence and Bugzilla.

Features:

• Offers real-time visibility
• Supports execution of multiple tests at once

What you really need to know: Zephyr is another player in the test management space, with an emphasis on real-time, on-demand testing. It is particularly focused on the smaller to mid markets segment through Atlassian, but is not built for the Enterprise.
For more information: Learn more about this test management tool at GetZephyr.com.
Pricing: Read how to buy Zephyr here.

4. Testuff

Summary: A SaaS test management tool with both web and desktop clients that supports various testing methodologies and offers management capabilities throughout the entire testing lifecycle. Testuff also supports automated testing, two-way integrations with bug trackers and video tracking of defects.

Features:

• Offers a video recording feature for defect tracking
• Lower priced
• User-friendly

What you really need to know: Testuff is a SaaS tool whose most unique feature is its video defect tracking. It also offers a multitude of integrations with bug trackers and several integrations with automation tools.
For more information: You can learn more at Testuff.com
Pricing: Plans start at $27 per user per month with 3 pricing tiers. View pricing here.

Note the Open Source Test Management Tools as well:

There are also several open source options for test management. If you decide to go the open source route, consider these tools:

-ity Testing Tools

Named based on the shared suffix of its subcategories (security, usability, compatibility), -ity testing is more of an emerging segment featuring typically expensive and specialized tools. These tools are evolving, becoming easier to use and offering improved service, to assist smaller teams who cannot yet invest in dedicated resources.

We can break down -ity testing tools into three subcategories:

• Security
• Usability
• Compatibility

Security Testing Tools

Security testing tools are typically built around a particular platform and/or technology. There is little open source pressure for security testing, so these are usually expensive, specialized tools that include heavy services. Here are the top security testing tools to consider:

1. HP Fortify On Demand

Summary: Provides application security as a service with a single platform to view and manage security risk, develop security testing schedules and run remediation projects. Fortify on Demand runs automated tests with a full audit of results and includes support for the SAST, DAST and IAST spaces (due to addition of the legacy WebInspect tool) as well as limited support for MAST.

Features:

• Strongest set of combined offerings with full support across languages
• Includes RASP support

What you really need to know: HP is undoubtedly the largest player in the security space, with tools for SAST, DAST, IAST and MAST.
For more information: To learn more, visit the HP Fortify website.
Reviews: Visit ITCentralStation.com for a list of reviews.
Pricing: Plans start at $2000 per application with 4 pricing tiers. Request pricing here.

2. Veracode

Summary: Veracode offers tools for SAST, DAST, IAST and MAST. Its binary static analysis is built toward Agile, while its DAST and IAST tools offer true cloud hosting and web perimeter monitoring. Additionally, almost all of its offerings are targeted to mobile.

Features:

• Strongest player for cloud and mobile technologies
• Integrates with numerous bug tracking and QA tools, such as TFS
• Includes RASP support

What you really need to know: Veracode is the largest player in the security space without its own testing and SDLC tools.
For more information: Learn more at Veracode.com.
Reviews: Head over to Gartner.com to read reviews for Veracode.

3. IBM Application Security APPScan

Summary: Offers a single console for testing, reporting and policies and automates the correlation of static, dynamic and interactive security testing. IBM’s AppScan static testing tool is well known in the security space, although its DAST tools rely on third party solutions and its IAST tools only work with .Net and Java.

Features:

• Strong in SAST
• Includes a complete suite of offerings

What you really need to know: IBM competes with HP as a similar full service offering, with some focus on downstream security tools like SIEM.
For more information: Head over to IBMs website to learn more.
Reviews: Visit ITCentralStation.com or Gartner.com for reviews.
Pricing: Plans start at $10,700 per install. Request pricing here.

Usability Testing Tools

Usability testing tools tend to be more basic and offer easy deployment within applications. The value of usability tools generally lies in the expertise or community provided. Take a look at the top usability software testing tools to consider:

1. UserTesting

Summary: Creates videos of people using a website or application and delivers a report that calls out problems and answers to any user surveys. UserTesting pools users from its own network or your company’s that match your target audience.

Features:

• Lower cost
• Easy to use
• Flexible licensing (per video pricing)
• Large network of testers

What you really need to know: UserTesting focuses solely on usability testing for websites and mobile apps. Its network of users and experts is strong and includes dedicated UX professionals. Although the product has traditionally been weak, it is improving.
For more information: Visit the UserTesting website to learn more.
Pricing: Pricing starts at $99 per video with 2 pricing tiers. View pricing here.

2. Validately

Summary: Allows you test live websites, mock HTML, images or prototypes and analyze the results via path reports and videos automatically flagged at issue points. Validately makes it easy to test on your own customers or find testers from its network and enables you to talk to these testers live.

Features:

• Lower cost
• Easy to use
• Offers the ability to get feedback before coding, saving costs and reducing throwaway work

What you really need to know: Validately focuses on user feedback before coding takes place. It is designed for users to interact with and provide feedback on desktop, web and mobile wireframes (not apps).
For more information: Visit Validately.com to learn more.
Pricing: Pricing starts at $79 per month with 3 pricing tiers. View pricing here.

Compatibility Testing Tools

Compatibility testing provides value based on efficient cross-browser mobile and web testing. Compatibility testing is simple to conduct manually, but is time consuming, expensive and risk prone. Technical or crowd automated tools bring efficiency to this process. Checkout the top compatibility testing tools to consider:

1. Browsera

Summary: Provides a detailed report of layout problems to avoid combing through screenshots, locates Javascript errors and tests dynamic pages. Browsera can also test pages that require a login and test entire sites at once, eliminating the need to go page by page.

Features:

• Pinpoints layout differences
• Eliminates the need to test page-by-page for entire websites
• Offers testing for dynamic pages and Javascript

What you really need to know: Browsera offers both free and enterprise versions of its compatibility testing tool. Its most unique features include the ability to detect layout differences across browsers and to identify Javascript errors.
For more information: Learn more on Broswera.com.

2. Browserling

Summary: Provides live interactive sessions for cross-browser testing with responsive testing and SSH tunnels for local testing. Browslering also offers screenshots, screen sharing, a bug hunter and videos. It is for web testing only.

Features:

• Lower priced
• Detect Javascript errors
• No insstallation
• Test dynamic pages

What you really need to know: Founded in 2011, Browserling focuses only on web and does not support automated testing.
For more information: Learn more at Browserling.com
Pricing: There is a free plan, but pricing starts at $49 per month with 3 pricing tiers. View pricing here.

Test Setup & Infrastructure Testing Tools

Test setup and infrastructure is a rapidly changing segment due to trends in mobile, web (cloud), NoSQL and containers, with many new companies emerging.

We can break down test setup and infrastructure tools into four subcategories:

• Test cloud
• Mobile device farm
• Test data management
• Environment management

Test Cloud Tools

Test cloud tools provide a network of virtual machines where desktop and web testing can occur at a lower cost, saving organizations money. Containers and AWS/cloud providers are lowering the barrier to entry for this market. Below are some of the top Test Cloud tools to consider:

1. Sauce Labs

Summary: Provides cross-browser, mobile and manual testing options as well as automation to test both web and mobile in parallel. Sauce Labs uses tunnel technology to encrypt traffic between individual tests and its cloud and offers access to live remote desktop sessions during tests.

Features:

• Lower cost
• Offers open source compatibility
• Includes additional functionality for manual and cross-browser testing
• Tight CI integration

What you really need to know: Sauce Labs offers everything as one product with additional enterprise capabilities in enhanced subscriptions. It currently only works with open source technologies like Selenium, Appium and JS Unit Testing. The additional manual testing and cross-browser comparison features it offers are very nice to have.
For more information: Learn more at Sauce Labs
Reviews: Visit G2Crowd.com or ITCentralStation.com to read reviews about SauceLabs.
Pricing: Pricing starts at $19 per month with 6 pricing tiers. View pricing here.

2. HP StormRunner Load

Summary: A SaaS load and performance tool for planning, executing and scaling web and mobile testing. HP StormRunner Load provides anomaly detection and real-time predictive analytics. It also supports the use of real mobile devices in cloud performance testing as well as test recordings.

Features:

• Supports Agile development processes
• Highly scalable
• Integrates with other HP testing tools

What you really need to know: HP StormRunner Load is a highly scalable solution for Agile cloud testing.
For more information: View the HP StormRunner Load site.
Reviews: Head over to ITCentralStation.com to read reviews about StormRunner Load.
Pricing: LoadRunner/StormRunner Load is priced at $.56 per virtual user per day, but they have a free edition as well. Visit their pricing here.

3. IBM Smart Business Development and Test Cloud

Summary: A self-service platform designed to simplify the assessment, planning, designing and implementation of development and testing private cloud environments. IBM Smart Business Development and Test Cloud also offers on demand provisioning of physical and virtualized test resources.

Features:

• Offers support for building complex testing environments
• Delivers automated provisioning and configuration management
• Integrates with IBM CloudBurst

What you really need to know: IBM’s Smart Business Development and Test Cloud is more focused on creating test environments than it is on creating machines/browsers from which to test.
For more information: Learn more about IBMs Smart Business Development tool.

4. Borland Silk Central Connect

Summary: Offers pre-configured cross-browser test environments in the cloud and allows for reusable test scripts. Silk Central Connect also provides side-by-side results of cross-browser testing for easy comparison and integrates with Silk Test.

Features:

• Offers support for commercial automation (via Silk Test)

What you really need to know: Silk Central is a more enterprise-grade version of Sauce Labs. Like Sauce Labs, it offers mobile support via emulators. However, it only runs Silk Test scripts.
For more information: Learn more about Silk Central Connect.
Reviews: Head over toG2Crowd.com to read Silk Central reviews.

5. BroswerTap

Summary: Broadcasts a live RTMP stream of a browser to enable testing in real-time. BrowserTap offers parallel views to test multiple browsers at once and allows for testing of responsive design.

Features:

• Enables real-time changes due to live stream of browser feed
• Supports testing for responsive design

What you really need to know: BrowserTap has a long list of useful features it intends to implement, however it is still in the early stages of doing so and has a long way to go.
For more information: Learn more about BroswerTap.

Mobile Device Farm Testing Tools

Mobile device farms provide a network of mobile devices for testing to occur, saving device acquisition, management and maintenance costs. A recent entrance by Amazon with a fixed price offering has shaken up the market.

Mobile device farms to consider include Pure Play vs. Extension Tools. The list below represents both pure play and extension tools, each of which has its pros and cons. Here’s what you need to know about the difference between the two types of tools:

Pure Play

Pros:

• Typically cheaper
• Creates less friction during purchase and implementation processes
• Offers faster development with best of breed tools
• Supports more integration and open source use

Cons:

• Requires separate scripts/languages to train and maintain

Extension

Pros:

• Allows for reuse of past automation scripts
• Uses familiar languages
• Offers a single vendor relationship across multiple tools

Cons:

• Follows slower, less focused development
• Provides a closed ecosystem that limits access to best of breed tools
• Typically more expensive and geared toward large organizations

1. Amazon Web Service Device Farm

Summary: Provides automated testing against real mobile devices in the AWS cloud as well as remote access. AWS Device Farm also allows for manual reproduction of issues, integrations with development environments and use of built-in test suites, open source frameworks or manual tests.

Features:

• Lower pricing
• Wide device selection options
• Open source support
• Developer-friendly
• Integrates with AWS for billing, etc.

Tool Type: Pure Play
What you really need to know:Amazon released Device Farm as an extension of Amazon Web Services in July 2015. Later in 2015, it release support for an internal scriptless UI automation framework in addition to existing Calabash, Appium and Espresso integrations. This framework is not yet popular, as most users are still using the open source integrations.
For more information: Visit the Device Farm.
Reviews: Head over to G2crowd.com for reviews.
Pricing: Plans start at $.17 per min with 2 pricing tiers. View pricing here.

2. Borland Silk Mobile Testing

Summary: Embraces the shift left for mobile testing by providing a management hub designed for continuous delivery workflows. Silk Mobile Testing also supports cross-platform automation tests, supports manual or exploratory testing and provides screenshots, videos and status reports from tests. It also integrates with Borland’s Silk Performer and Silk Central solutions.

Features:

• Offers cross-platform and cross-device support
• Well-integrated into Silk Central

Tool Type: Extension
What you really need to know:Borland offers enterprise-grade testing tools competitive with HP’s, however they tend to be costly.
For more information: Check out Borlands website for more information.

3. Experitest SeeTestCloud

Summary: Offers device inventory, application, user and project management for mobile, enables remote access and integrates with performance testing tools like HP LoadRunner and JMeter. Experitest offers both an onsite and a hosted, online version of SeeTestCloud.

Features:

• High security
• Compatible with companies that own their own devices
• Provides commercial automation support
• Offers network visualization
• Allows for device monitoring

Tool Type: Extension
What you really need to know:Experitest SeeTestCloud is an onsite device cloud that hooks into your available mobile devices. Experitest also offers SeeTestAutomation, which integrates with HP UFT and LoadRunner as well as some open source tools like JMeter.
For more information: Learn more about SeeTestCloud here.
Pricing: Plans start at $2000 per year with 2 pricing tiers. View pricing here.

4. HP Mobile Center

Summary: Provides both real devices and emulators that support app testing, live monitoring and user insight delivery. HP Mobile Center also enables device management and user permissions, recording and replaying of interactions, structured manual testing or automated testing and security assessments.

Features:

• Integrates with HP UFT and LeanFT for improved automated testing
• Uses real devices with the option for emulators

Tool Type: Extension
What you really need to know:HP Mobile Center integrates with other HP testing tools to provide a more complete, end-to-end testing experience. Its support for both real devices and emulators provides flexibility in testing options.
For more information: Visit the HP Mobile Center site page for more information.
Reviews: Head over to ITCentralstation.com to read reviews.
Pricing: Plans start at $12,000 per year with 2 pricing tiers. View pricinghere.

5. Keynote Mobile Testing

Summary: Provides test automation for real mobile devices. Keynote Mobile Testing supports unit, build acceptance, regression and explorative and negative testing. It also allows for test creation via scripting or integrations with open source frameworks and integrates with several CI applications.

Carburetor Jetting Guide

Features:

• Uses real mobile devices and provides support for new devices immediately after their release
• Integrates with leading CI applications, including Appium and Selenium
• Offers various pricing plans

Tool Type: Extension
What you really need to know:Keynote Mobile Testing allows for automated testing across a wide variety of devices and supports a multitude of integrations that allow the tool to work seamlessly with an Agile development process.
For more information: Learn more at the Keynote website.
Pricing: Plans start at $180 per mo with 3 pricing tiers. View pricinghere.

6. Mobile Labs deviceConnect

Summary: Provides remote device management, tracking and monitoring as well as user and application management. Mobile Labs deviceConnect also offers manual and automated application testing, all from its private cloud testing platform.

Features:

• High security
• Compatible with companies that own their own devices
• Provides commercial automation support

Tool Type: Pure Play
What you really need to know:Mobile Labs deviceConnect is a private cloud-based mobile cart that allows users to connect devices they own to a private cloud for functional, automated or performance testing. Mobile Labs partners exclusively with HP for automated testing.
For more information: Learn more at the deviceConnect product page.

7. Perfecto Mobile Monitoring

Summary: Offers cloud-based, automated testing as well as usability and performance monitoring. Perfecto’s Mobile Monitoring solution also offers visual reports and integrations with various automation frameworks, including open source options and HP UFT.

Features:

• High security
• Wide availability of devices
• Supports various automation frameworks
• Offers performance testing and monitoring support

Tool Type: Extension
What you really need to know:Perfecto Mobile offers a combination of privately-hosted and shared/cloud-hosted devices.
For more information: Learn more at the Perfecto Mobile website.
Reviews: Head over to G2Crowd.com & TrustTradius.com to read reviews.
Pricing: Plans start at $99 per month with 3 pricing tiers. Request pricing here.

8. Sauce Labs

Summary: Provides automated testing for emulators, simulators and real devices for native, hybrid and mobile web tests. Sauce Labs is based on open source standards and works with both iOS and Android devices.

Features:

• Lower cost
• Open source compatibility
• Offers additional functionality for manual and cross-browser testing
• Tight CI integration

Tool Type: Pure Play
What you really need to know:Sauce Labs offers everything as one product with additional enterprise capabilities in enhanced subscriptions. It currently only works with open source technologies like Selenium, Appium and JS Unit Testing. It is the only mobile testing tool that supports automation for native, hybrid and mobile web testing across all device types (real, emulators and simulators).
For more information: Head over to Saucelabs.com to learn more.
Reviews: Visit G2Crowd.com or ITCentralStation.com to read reviews about SauceLabs.
Pricing: Pricing starts at $19 per month with 6 pricing tiers. View pricing here.

9. Smart Software Testing Solutions pCloudy

Summary: Supports continuous development and testing on real devices. pCloudy also offers location testing, HTML5 browser functionality and debugging capabilities.

Features:

• Aligns with continuous development practices
• Offers a unique debugging feature
• Uses real devices

Tool Type: Extension
What you really need to know: Smart Software Testing Solution’s pCloudy emphasizes continuous development and testing as well as debugging.
For more information: Checkout their website here.
Pricing: Pricing starts at $20 per 5 hours with 6 pricing tiers. View pricing here.

10. Soasta TouchTest

Summary: Provides automated testing and the ability to run tests across multiple devices at once. Soasta TouchTest also delivers access to the latest devices and mobile performance metrics.

Features:

• Supports automated testing
• Offers performance metrics
• Supports testing across multiple devices simultaneously

Tool Type: Extension
What you really need to know: Soasta TouchTest integrates with Soasta CloudTest for cross-platform web testing and Soasta mPulse for post-production performance monitoring.
For more information: Learn more about their mobile testing solution here.
Pricing: Offers a 3 pricing tiers. View and request pricing here.

11. TestPlant eggCrate

Summary: A storage and charging solution for mobile devices that can become a complete test device lab when connected to TestPlant’s eggBox and eggPlant Network.

Features:

• Lower cost
• Compatible with companies that own their own devices
• Offers commercial automation support

Tool Type: Extension
What you really need to know:TestPlant eggCrate is a mobile testing solution that you can connect to existing mobile devices. eggCrate currently only works with eggPlant functional tests and does not provide any open source or load testing support.
For more information: Checkout the eggCrate tool on TestPlants product page.
Pricing: No prices listed, but view licensing and pricing information here.

12. Xamarin Platform

Summary: Provides native user interfaces, native API access and native performance for mobile app testing. Xamarin Platform also allows for shared projects and portable class libraries and supports testing on iOS, Android and Mac. Its testing model uses the C# language.

Features:

• Allows for use of a single language across all platforms
• Offers debugging capabilities

Tool Type: Extension
What you really need to know: Xamarin allows for native development and testing across iOS, Android and Mac, however it uses the C# language exclusively.
For more information:Visit Xamarin.com to learn more about their testing tool.
Pricing: Offers two free plans, a free trial and 2 other pricing tiers. Request pricing here.

Test Data Management

Test data management tools automate the process of deploying “gold” test data to databases. The introduction of open source databases first shook up the market, and it is facing change again due to the rise of NoSQL/Big Data stores. Let’s look at the top Test data management tools to consider.

1. Informatica Test Data Management (TDM)

Summary: Offers sensitive data discovery and classification, data masking, test data generation, data subsetting, data connectivity, pre-built application accelerators and monitoring and compliance reporting. Informatica TDM can be deployed on premise, in the cloud or using a hybrid cloud model.

Features:

• Offers the strongest standalone toolset
• Provides a diverse set of other data tools
• Includes a rich partner network of integrations

What you really need to know: Informatica offers a best of breed solution around data security and data management. Its test data management solution offers persistent data masking, test data generation, data subsetting and cloud and warehouse capabilities.
For more information: Visit the Informatica TDM product page.

2. CA Technologies Test Data Manager

Summary: A test-oriented and fully automated solution that is built for reusability. CA Technologies Test Data Manager provides synthetic data generation, data masking, data subsetting, coverage analysis, test data allocation, test data warehouse and virtualization. It is also geared toward the Agile model of continuous delivery.

Features:

• Offers the strongest integrated toolset
• Provides a diverse set of virtualization and application development tools

What you really need to know: CA Technologies is highly focused on test data management as it relates to DevOps and automation. Its Test Data Manager solution, which came from a 2015 acquisition of GridTools, provides data masking, data provisioning and test data generation.
For more information: Learn more over at CA Technologies website.

3. HP Test Data Management

Summary: Extracts relevant data to create a production-like test environment by building a data model and subset rules with a graphical user interface. HP Test Data Management also masks sensitive data and offers the ability to extract data on demand.

Features:

• Offers a strong complementary toolset with HP QC and UFT

What you really need to know: HP has not made any recent progress with its test data management solution, making it appear as an afterthought. The solution supports data masking, data subsetting and data generation, but it does not have any cloud capabilities and it doesn’t support any of the newer database technologies.
For more information: Learn more at the HP website.

4. IBM InfoSphere Optim

Summary: Uses pre-built workflows and services on demand for continuous testing and Agile development. IBM InfoSphere Optim makes it easy to create production-like environments, allows for functional, regression integration and load testing via integrations with the Rational Test Workbench and allows for data masking and enterprise test data management policy development and enforcement.

Features:

• Offers a strong integration with IBM testing tools
• Works across pre-production and production environments
• Integrates with IBM hosting

What you really need to know: IBM gained test data management capabilities in 2005 through its acquisition of Ascential Software. Its InfoSphere Optim test data management solution supports data masking, data subsetting and data generation and integrates with the Rational Test Workbench.
For more information: Visit the IBM InfoSphere page for more information.

5. Delphix Engine and Data Masking

Summary: Delphix Engine is a virtualization engine that streamlines data delivery, compresses and creates virtual copies of production data and captures changes at the transaction level. It offers self-service data management and can be used on premise or in the cloud. Delphix Data Masking works alongside the Delphix Engine to securely mask data by replacing sensitive data with fictitious data to better protect data in downstream, non-production environments.

Features:

• More agile solution with support for newer technologies and focus on the high tech space

What you really need to know: Delphix is the newest established test data management player, though it has made great strides since its 2008 founding. The Delphix Engine and Data Masking tools support data masking, data subsetting and data generation and are compatible with AWS.
For more information:Head over to Delphix.com to learn more.

Environment Management Software Testing Tools

Environment management tools automate the process of deploying software into a test or staging environment. These tools are increasing in importance alongside the rise of DevOps due to quicker builds and the need for automation. Docker, Puppet and Chef have paved the way for newer, cheaper and better environment management solutions.

Here’s a list of top Environment Management tools to consider:

1. Plutora Test Environment Manager (TEMS)

Summary: A SaaS-based tool that allows for management of both standalone and integrated environments throughout pre-production. Plutora TEMS includes an environment availability and allocation engine, a unified dashboard for environment-related information, governance processes to identify and fix changes in test environments and integrations with several leading tools. In addition to environment scheduling and configuration, it also provides cost forecasting.

Features:

• Offers capabilities across the entire testing lifecycle
• Tracks configuration versions and environment changes
• Enterprise-ready

What you really need to know: Plutora TEMS is a comprehensive, enterprise-ready testing tool that offers a variety of capabilities along the entire testing lifecycle, including auditing and governance as well as customizable management processes.
For more information: Visit the TEMS website for more information.

2. TestPlant eggPlant Manager

Summary: A web-based tool that supports continuous integration and regular testing. TestPlant eggPlant Manager works with eggPlant Functional and eggCloud to enable automated testing. It allows for defining of test runs, scheduling test executions, managing systems and devices and analyzing results.

Features:

• Aligns with the larger TestPlant eggPlant environment for expanded testing

What you really need to know: TestPlant eggPlant Manager works well for environment management for businesses already using other TestPlant solutions. It can be limiting otherwise.
For more information: Head over to TestPlant.com for more information.
Pricing: No prices listed, but view licensing and pricing information here.

3. TEMS Omnium

Summary: A SaaS tool that provides a single source of truth for build versions on all environments. Omnium allows for capturing, organizing and identifying usage and scheduling patterns for applications and IT environments. It can be deployed locally or via the cloud and is available in two versions: Omnium Light and Omnium Enterprise.

Features:

• Supports several integrations, including open source

What you really need to know: TEMS Omnium is available in two versions that each meet different levels of needs. Its most unique feature is the wide variety of integrations with DevOps and TestOps tools.
For more information: Learn more about Omnium here.
Pricing: Plans start at $55 per mo with 2 pricing tiers. View pricing here.

Mobile Testing Tools

Mobile testing has become increasingly critical as mobile device usage grows ubiquitous. Given the variety of application types (native, hybrid, mobile web) and operating systems, testing mobile applications can prove difficult. Mobile testing tools use automated testing frameworks to help simplify this process and we’ve outlined the op mobile software testing tools for you below.

Extra: Are you ready for mobile? Take a look at our take on whymobile testing is a new animal that needs a new strategy.

1. Keynote DeviceAnywhere

Summary: Offers real devices, including phones and tablets, for mobile testing. DeviceAnywhere is part of Keynote’s larger Mobile Testing tool, which provides test automation and supports unit, build acceptance, regression and explorative and negative testing.

Features:

• Uses real mobile devices and provides support for new devices immediately after their release
• Integrates with leading CI applications, including Appium and Selenium
• Offers various pricing plans

What you really need to know: Keynote DeviceAnywhere allows for automated testing across a wide variety of devices and supports a multitude of integrations that allow the tool to work seamlessly with an Agile development process.
For more information: Learn more on the DeviceAnywhere product page.
Pricing: Plans start at $200 per project with 5 pricing tiers. View pricinghere.

2. TestPlant eggPlant Mobile

Summary: Allows for mobile testing using both real devices and emulators. As part of TestPlant’s larger eggPlant testing range, eggPlant Mobile uses eggPlant Functional’s image-based UI approach to simplify cross-device and cross-platform mobile testing.

Features:

• Aligns with the larger TestPlant eggPlant environment, including TestPlant’s mobile device farm, for expanded testing
• Offers access to both real devices and emulators
• Supports multiple devices (including iOS, Android, Windows and BlackBerry) and platforms

What you really need to know: TestPlant eggPlant Mobile supports test automation for mobile testing across various devices and platforms, with the option to use real devices or emulators.
For more information: Checkout the eggPlant Mobile software testing tool here.
Pricing: No prices listed, but view licensing and pricing information here.

3. Appium

Summary: An open source test automation framework for mobile testing. Appium uses the WebDriver protocol to support testing for iOS and Android apps and works with native, hybrid and mobile web apps. It also offers full access to back-end APIs and supports a variety of programming languages.

Features:

• Uses both real devices and emulators
• Supports any testing framework, tool and language
• Offers cross-platform support

What you really need to know: Appium is an open source framework that allows for automated testing for native, hybrid or mobile web apps for iOS and Android. It does not require code modifications and supports testing in any language.
For more information: Head over to Appium.io to learn more.
Reviews: Checkout Appium reviews on ITCentralStation.com

4. Selendroid

Summary: Provides test automation for native, hybrid and mobile web apps for Android devices only. Selendroid is built on Selenium and the WebDriver API. It does not require any code modifications to test apps and offers a built-in inspector to simplify test case development.

Features:

• Uses both real devices and emulators
• Compatible with JSON Wire Protocol and Selenium 3 Ready
• Integrates with Selenium Grid for scaling and parallel testing

What you really need to know: Selendroid offers automated testing for native, hybrid or mobile web apps for Android only. It supports multiple Android target APIs and can be extended at runtime via extensions.
For more information: Checkout Selendriod.io to learn more.
Reviews: Head over to G2Crowd.com to read reviews.

5. ios-driver

Summary: Provides test automation for native, hybrid and mobile web apps for iOS devices only. ios-driver uses Selenium and the WebDriver API. It does not require any code modifications to test apps.

Features:

• Uses emulators, with support for real devices launching in the next release
• Compatible with JSON Wire Protocol
• Integrates with Selenium Grid for scaling and parallel testing

What you really need to know: ios-driver offers automated testing for native, hybrid or mobile web apps for iOS only. It does not require jailbreaking of devices and can be used as part of a Selenium Grid to manage a device or simulator farm.
For more information: Learn more about ios-driver here.
Pricing: ios-driver is a free download.

Bug Tracking Tools

Bug tracking tools simplify the process of identifying, managing and reporting on software bugs. These tools strengthen collaboration, streamline recording and reporting on bugs and ensure consistency across the board, especially when the alternative is a spreadsheet. Checkout the top bug tracking tools to consider below:

1. Bugzilla

Summary: An open source bug tracking tool that undergoes regular development. Bugzilla offers tracking for bugs and code changes, collaboration for team members, patch submission and reviewing, integrated email capabilities and more.

Features:

• Offers automatic duplicate bug detection
• Supports administrative capabilities, including customizations and security features
• Allows for report scheduling and bug modifications via email
• Free

What you really need to know: Bugzilla is a free, open source bug tracking tool that offers a variety of capabilities around bug tracking and user collaboration. It is under active development.
For more information: Head over to the Bugzilla website.
Reviews: Head over to G2Crowd.com to read reviews.
Pricing: Bugzilla is a free tool.

2. MantisBT

Summary: An open source issue tracker that allows for custom issue fields, notifications and workflows. MantisBT also provides email notifications and role based access control to make collaboration easy.

Features:

• Easy to use
• Offers web and mobile interfaces
• Free with the option for paid hosting

What you really need to know: MantisBT is a simple yet powerful open source bug tracking tool. It is free for use and offers a variety of plugins to extend its functionality.
For more information: Learn more about MantisBT here.
Reviews: Head over to G2Crowd.com to read reviews.
Pricing: MantisBT is a free tool.

3. Atlassian JIRA

Summary: Provides bug tracking and issue tracking as part of a larger incident management tool. JIRA offers capabilities around planning, tracking, releasing and reporting and supports both custom and out-of-the-box workflows. It also integrates with a variety of testing tools and add-ons, available via the Atlassian Marketplace.

Features:

• Provides Agile reporting and portfolio planning
• Integrates with developer tools and over 1,000 add-ons
• Offers cloud, server and data center deployment options

What you really need to know: JIRA provides bug tracking along with a variety of other incident management capabilities that can extend its use beyond software development. It is an enterprise-ready solution that supports a wide variety of integrations.
For more information: Head over to Atlassian to learn more about JIRA.
Reviews: Read reviews at G2Crowd.com, Softwareadvice.com, and GetApp.com
Pricing: Plans start at $10 per user with 9 pricing tiers. View pricinghere.

4. FogCreek FogBugz

Summary: Provides bug tracking as part of a larger work tracking and collaboration tool. FogBugz supports task management, time tracking, smart scheduling, email support, document collaboration and crash reporting. It also helps manage Agile development and review and manage code.

Features:

• Offers cloud or onsite deployment options
• Allows for bulk issue editing
• Supports custom workflows, case types and statuses
• Provides communities to hear directly from customers
• Includes automated error reporting

What you really need to know: FogBugz provides bug tracking as well as numerous other work tracking and collaboration capabilities that expand its use cases beyond software development. It is very collaboration-friendly.
For more information: Learn more a the FogBugz website.
Pricing: Plans start at $20 per mo with 2 pricing tiers. View pricinghere.

5. Bontq

Summary: Offers issue tracking and project management. Bontq can capture screenshots and record videos, supports team collaboration and management and delivers email notifications regarding changes.

Features:

• Provides bug tracking as well as feature requests, test cases and internal Wikis
• Supports screenshots and videos

What you really need to know: Bontq is a cloud-based bug tracking and project management tool with a desktop component. It offers recording capabilities as well as task management and documentation.
For more information: Visit Bontq.com to learn more.
Pricing: Plans start at $9 per mo with 5 pricing tiers. Request pricing here.

6. BugAware

Summary: Provides customizable bug tracking capabilities, including bug submissions, user discussions, bug tracking and prioritization, dynamic reporting, team management and email alerts. BugAware is available as a web-based or on premise tool.

Features:

• Offers complete customization for everything from workflows and task types to user roles
• Includes dynamic search and reporting functionality

What you really need to know: BugAware provides highly customizable bug and issue tracking with advanced search features. Because of its team management, reporting and customization capabilities, its use cases extend beyond software testing.
For more information: Head on over to BugAware.com to learn more.
Pricing: Plans start at $12 per mo with 2 pricing tiers. Request pricing here.

Niche Testing

Niche categories are emerging to handle the new problems being created from Agile, mobile, cloud, DevOps and best of breed movements. The top emerging niche fields include:

• Test reporting
• Logging/debugging
• Crowd testing
• Beta management.

Test Reporting & Test Metrics Tools

Test reporting tools centralize and standardize the reporting around testing activity from independent tools, bridging the Agile/Waterfall, cross-platform and manual vs. automated testing metrics divides. With the right test reporting tools teams can ditch spreadsheet and start gaining real-time insight into the progress, health and quality of software testing. Checkout the top test reporting tools to consider below:

1. qTest Insights by QASymphony

Summary: Provides self-service business intelligence for test metrics and reporting. qTests Insights offers a single source of truth for teams to manage and analyze metrics. It includes drill down reporting, custom dashboard capabilities, visual heat maps and interactive charts.

Features:

• Provides accurate, real-time data visualization
• Integrates with other QASymphony testing tools as well as third party solutions
• Recently revamped for an improved user experience

What you really need to know: QASymphony recently revamped its qTest reporting tool and the result is qTest Insights 2.0. It used this revamp to add unique features like heat maps to better visualize data and to improve overall capabilities to provide more accurate, real-time insights in an easy to use format.
For more information: Head over to the qTest Insights product page at QASymphony.com to learn more.

2. Testuff

Summary: A SaaS test management tool with both web and desktop clients that supports various testing methodologies, offers test management capabilities throughout the entire testing lifecycle and supports automated testing. Testuff also offers defect reporting, including two-way integrations with bug trackers and video tracking of defects.

Features:

• Offers a video recording feature for defect tracking
• Lower priced
• User-friendly

What you really need to know: Testuff is not solely focused on test reporting. Rather, it is a test management tool that includes defect reporting. It also offers a multitude of integrations with bug trackers and several integrations with automation tools.
For more information: Visit Testuff.com to learn more.

Logging/Debugging

Logging/debugging tools collect information around technical and functional errors from pre-production and production environments. Production logging is mostly useful in mobile and cloud applications. Checkout the logging/debugging tools to consider below.

1. QASymphony qTest eXplorer

Summary: Supports exploratory, session-based and manual testing across platforms by automatically recording test sessions and documenting defects. QASymphony qTest eXplorer integrates with leading Agile ALMs, including Rally, JIRA and VersionOne, to improve issue and defect submission.

Features:

• Streamlines issue and defect sharing
• Supports deeper exploration for defects and bugs
• Centralizes test documentation
• Integrates with leading Agile ALMs
• Allows for editing of recorded sessions

What you really need to know: QASymphony qTest eXplorer eliminates the need for manual screen grabs and documentation by automating the entire process. This automation as well as integrations with leading Agile ALMs allows for streamlined processes, deeper investigations for bugs and more robust documentation.
For more information: Checkout theqTest eXplorer product pageover at QASymphony.com to learn more.

2. HP Sprinter

Summary: Captures user actions during manual exploratory testing and provides write ups to enable accurate bug reproduction. HP Sprinter also provides automated defect scanners for certain conditions like spelling, mirror testing to run tests across multiple machines and data injection to eliminate the need to repeat manual tests.

Features:

• Offers full functionality
• Capable of creating automation
• Integrates with other HP testing tools
• Lower cost (free with HP QC/ALM)

What you really need to know: HP Sprinter was released in 2011 as part of HP QC/ALM Premium Edition. In addition to capturing screenshots and videos, HP Sprinter also provides much more functionality around test automation, data injection and more.
For more information: Learn more about Sprinter here.

3. Instabug

Summary: Focused only on mobile apps, Instabug provides in-app feedback and bug reporting and enables live chat with beta testers directly inside the app. Instabug also offers crash reporting, workflow automation, dozens of integration opportunities and a single dashboard for bug reporting and fixing.

Holley Carburetor Jetting Guide

Features:

• Offers mobile-specific functionality
• Integrates well with third-party tools like Jira and ZenDesk
• Lower priced (priced at less than $3K/year, all in)

What you really need to know: Released in 2013, Instabug focuses solely on mobile applications and offers advanced features like live chat with beta users and crash analytics.
For more information:Head over to Instabug.com to learn more.
Reviews: Head over to G2Crowd.com to read reviews.
Pricing: Plans start at $49 per mo with 4 pricing tiers. View pricing here.

4. TestFairy

Summary: Provides video recording, logs and user feedback solely for iOS and Android mobile applications. TestFairy also offers app distribution, crash reports and community pages.

Features:

• Offers mobile-specific functionality
• Provides robust data logging (including memory, signal strength and more)
• Includes an app launching capability

What you really need to know: Released in 2013, TestFairy is comparable to Instabug, as it also focuses solely on mobile. However, TestFairy is focused more on bug reporting than bug management compared to Instabug.
For more information: Checkout TestFairy.com to learn more.
Pricing: Plans start at $79 per mo with 4 pricing tiers. View pricinghere.

5. Browserling

Summary: Provides live interactive sessions for cross-browser testing with responsive testing and SSH tunnels for local testing. Browslering also offers screenshots, screen sharing, a bug hunter and videos. It is for web testing only.

Features:

• Lower priced

What you really need to know: Founded in 2011, Browserling focuses only on web and does not support automated testing.
For more information: Learn more at Broswerling.com
Reviews: Read reviews on the Google Chrome Store.
Pricing: Plans start at $19 per mo with 2 pricing tiers. View pricinghere.

6. BrowserStack

Summary: Provides testing for a range of devices and browsers as well as local testing to test development and internal sites. BrowserStack also offers a native experience, with all testing taking place on real devices and browsers, not virtual machines.

Features:

• Offers mobile and web support as well as support for both manual and automated testing
• Provides local (on premise) site testing support
• Includes robust SDKs for integration automation

What you really need to know: Founded in 2011, BrowserStack allows for testing on both the web and real mobile devices.
For more information: Learn more at Broswerstack.com.
Reviews: Read reviews over atTrustRadius.com and ITCentralStation.com.
Pricing: Plans start at $29 per year with 3 pricing tiers. View pricinghere.

7. CrossBrowserTesting

Summary: Provides live testing on real browsers and mobile devices via an interactive test lab. CrossBrowserTesting also offers automated screenshots and screenshot comparisons, Selenium tests and local tests.

Features:

• Offers mobile and web support as well as support for both manual and automated testing
• Currently developing an integration with the holistic SmartBear testing solution
• Lower priced
• Provides local (on premise) site testing support

What you really need to know: SmartBear acquired CrossBrowserTesting in 2016 and it is not yet fully integrated into the SmartBear environment. On its own, CrossBrowserTesting allows for testing on both the web and real mobile devices.
For more information: Learn more by visiting the CrossBrowserTesting website.
Pricing: Plans start at $29 per mo with 3 pricing tiers. Visit their pricing page here.

Crowd Testing

Crowd testing tools use “the crowd” to assist in software testing through web-enabled platforms. Crowd testing reduces the general cost of labor as well as the cost of access to specialized devices, networks and skill sets. Checkout the top Crowd Testing tools to consider below, but first:

Note on Managed vs. Unmanaged Crowd Testing Communities

Crowd testing communities are either managed or unmanaged. A managed community is one where the vendor manages interactions (e.g. bug verification) with the crowd. These communities minimize the effort required from your business and provide a much higher quality service, but they are also more expensive. Meanwhile, an unmanaged community is one where your business manages interactions with the crowd. These communities require more effort from your business, but they are also less expensive.

1. 99tests

Summary: Crowd sources automation, functional, security, load, localization and usability testing. 99tests works with over 20,000 testers across over 150 countries.

Features:

• Offers security via optional custom NDAs and SOHA verification for testers

Community Type: Unmanaged
What you really need to know: 99tests offers unmanaged community crowd testing for a wide variety of tests and draws on a global community of testers.
For more information: Visit 99tests.com to learn more about their crowd testing options.
Pricing: Plans start at $3995 per test cycle with 2 pricing tiers. View pricinghere.

2. Applause

Summary: Provides crowd testing for exploratory functional testing, test case execution, accessibility and security, usability, localization and load testing. Applause relies on a network of over 250,000 professional testers globally.

Features:

• Extensive network of testers
• Well-established
• Offers both managed and unmanaged communities

Community Type: Managed and unmanaged, moving toward fully managed
What you really need to know:Applause is the largest player in the crowd testing space, as it is well-established and has an extensive base of testers. It currently offers both managed and unmanaged communities, but it is moving toward more premium managed offerings.
For more information: Learn more on the Applause website.
Reviews: Head over to G2Crowd.com or TrustRadius.com to read reviews.
Pricing: Visit their pricing estimator page.

3. blur Group

Summary: Provides a marketplace of testing specialists who pitch and bid on testing projects of all kinds.

Features:

• Well-established and regularly growing network
• Allows you to pick testers based on project pitches and bids

Community Type: Managed
What you really need to know:blur Group uses a bidding model to give projects to the best bidders based on their overall offer, including project pitch and price. Companies have hands-on selection with blur Group managing the process.
For more information: Checkout the blur Groups crowd testing options.
Reviews: Head over to TrustPilot.com to read reviews.

4. Bugcrowd

Summary: Delivers crowd testing for application security through a network of over 28,000 security researchers. Bugcrowd uses a bounty model to encourage testers to find more bugs.

Features:

• Has the ability to find high impact defects
• Offers skilled security and penetration testing

Community Type: Unmanaged
What you really need to know:Bugcrowd specializes in finding a small volume of critical security bugsvia a bounty system that rewards more established testers.
For more information: Learn more at Bugcrowd.com.

5. BugFinders

Summary: Provides functional, usability, security, localization, lifestyle, accessibility and in-live performance testing. Every BugFinders project includes a Test Project Manager who provides regular status updates and other critical information. BugFinders also compiles a report of the testing outcomes.

Features:

• High level of service

Community Type: Managed
What you really need to know:BugFinders focuses on delivering white glove service through its crowd testing, with daily updates and report analysis walkthroughs for every project.
For more information:VisitBugFinders.com to learn more.

6. Crashalytics

Summary: Crash reporting for iOS and Android applications. Crashalytics is lightweight with a negligible network impact that offers advanced reporting with real-time updates.

Features:

• Integrates easily with apps that need testing
• Provides real-time updates
• Free for most use cases

What you really need to know: Crashalytics reports crashes in mobile apps in real-time. It was acquired by Twitter in 2013.
For more information: Learn more at Crashalytics.com.
Reviews: Head over to G2Crowd.com or GetApp.com to read reviews.
Pricing: This software is free.

7. Crowdar

Summary: Provides managed communities that offer functional and performance testing as well as test management and test automation.

Features:

• Offers end-to-end testing services
• Competitive pricing

Community Type: Managed
What you really need to know:Crowdar does mostly small scale work, with its end-to-end testing services managed via an assigned employee.
For more information: Visit Crowdar to learn more.

8. CrowdSourced Testing

Summary: Functional, localization and usability testing for websites, mobile apps (iOS, Android and Windows), video games and software. CrowdSourced Testing relies on a global network of over 45,000 professional testers with an average of 6+ years of experience.

Features:

• Experienced network of testers
• Delivers testing for a wide variety of needs (mobile, website, software, video games)

Community Type: Managed
What you really need to know:CrowdSourced Testing offers functional, localization and usability testing, with a strong focus on UX and localization testing.
For more information: Visit CrowdSourced Testing website to learn more.
Pricing: Pricing starts at $49 per platform/testers with 2 other pricing tiers. View pricing here.

9. CrowdTest

Summary: Provides performance testing and test automation. CrowdTest offers pay per bug or pay per test models and rates and pays its testers based on their performance.

Features:

• Offers two payment models (per bug or per test)
• Incentivizes testers by rating and paying based on performance

Community Type: Unmanaged
What you really need to know:CrowdTest is a South American-focused company that uses a community of testers that it rates and pays based on how well they do.
For more information: Go here to learn more about CrowdTest.

10. CrowdTesters

Summary: Provides app, localization, non-functional, security, cloud, usability and game testing as well as “bug bashing.” CrowdTesters uses a proposal system where testers submit project proposals based on specified requirements and organizations select their preferred tester.

Features:

• Offers a wide variety of testing capabilities
• Allows organizations to personally select their tester

Community Type: Unmanaged
What you really need to know:CrowdTesters provides an unmanaged community in which you can submit project requirements and select your tester based on proposals.
For more information:VisitCrowdTesters.com to learn more.

11. Upwork

Summary: Provides a large network of freelancers for any number of testing requirements. Upwork is not a testing-specific community, but it does boast a large network of technology freelancers. With Upwork, companies post a job description, freelancers apply and companies can select a freelancer based on factors like skills, project proposal and pricing.

Features:

• Largest network of technology, testing, marketing and other freelancers

Community Type: Unmanaged
What you really need to know:Formerly Elance-Odesk, Upwork has a network of over three million freelancers, however only a small portion specialize in software testing. That said, Upwork still has among the largest networks of technology freelancers.
For more information: Checkout the developers section of Upwork.com to find testers.

12. HockeyApp

Summary: Provides distribution, crash reports, user feedback, user metrics and team management. HockeyApp also integrates with several development platforms. Companies simply upload their apps and users can download for testing.

Features:

• Easy to use
• Ideal for apps that will ultimately be uploaded to an app store

Community Type: Managed
What you really need to know:Acquired by Microsoft in 2014, HockeyApp provides a very simple and straightforward user experience, although its testing capabilities are limited compared to other tools.
For more information: Head on over to HockeyApp.com to learn more.
Pricing: Plans start at $30 per mo with 5 pricing tiers. View pricinghere.

13. LionBridge

Summary: Offers managed QA services, traditional QA services, mobile app testing and game testing. LionBridge uses both lab-based automated testing and hands-on location testing.

Features:

• Provides an extensive network of testers

Community Type: Managed
What you really need to know:LionBridge offers a network of over 140,000 crowd sourcers, however only a portion of these people are testers.
For more information: See their network of crowdsources here.

14. Mob4Hire

Summary: Provides functional and usability testing for mobile. Mob4Hire has a network of 65,000 testers, all of whom it ranks in order to eliminate weaker testers.

Features:

• Ranks testers and eliminates those with low scores

Community Type: Unmanaged
What you really need to know:Mob4Hire is a moderately well established testing community that specializes in functional and usability testing for mobile software only.
For more information: Surf the mob of testers at Mob4Hire.com

15. MyCrowd

Summary: Delivers functional, exploratory, website, mobile app and email template crowd testing. MyCrowd boasts a network of 25,000 testers across 40 countries.

Features:

• Offers custom solutions
• Delivers testing for mobile and websites

Community Type: Unmanaged
What you really need to know:MyCrowd provides a relatively small community of testers, with a big focus on website and mobile testing.
For more information: Visit mycrowd.com to learn more.
Pricing: Plans start at $23 per hour with 3 pricing tiers. View pricinghere.

16. Pay4Bugs

Summary: Crowd sourced bug finding with support for a variety of mobile networks and hardware. Pay4Bugs integrates with bug tracking systems and follows a pay per bug model.

Features:

• Has the ability to find high impact defects
• Offers skilled security and penetration testing
• Integrates with bug tracking systems

Community Type: Unmanaged
What you really need to know:Pay4Bugs offers crowd sourced bug finding for mobile apps on a pay per bug model.
For more information: Visit Pay4Bugs.com to learn more.
Pricing: Plans start at $300 per mo with 3 pricing tiers. View pricing here.

17. passbrains

Summary: Provides compatibility, functional, localization, load and performance, usability and security crowd testing. passbrains offers access to a private company-created crowd or a passbrains crowd, with testers selected based on numerous factors like skills and location.

Features:

• Well established with a large global talent base
• Provides a full suite of managed testing solutions

Community Type: Managed
What you really need to know:passbrains provides a mix of managed onsite, offshore and crowd testing for a wide variety of needs. It is enterprise-focused and built for expertise in mobile crowdsourcing.
For more information: Head over to passbrains.com to learn more about their crowd testing.
Pricing: Plans start at € 990 per with 3 pricing tiers. View pricing here.

18. PeoplePerHour

Summary: Provides a network of freelancers, including but not limited to software testers. PeoplePerHour allows companies to post a job and review applicants or search for freelancers directly based on skills, rates, etc.

Features:

• Vets freelancers to ensure quality applications

Community Type: Unmanaged
What you really need to know:PeoplePerHour is a middle-man for finding freelancers. It vets freelancers to ensure it provides quality testers, but projects are not managed.
For more information: Visit peopleperhour.com to learn more.

19. Revolution IT

Summary: Managed crowdsourced testing for cloud, web, mobile and games across functional, usability, compatibility and security testing. Revolution IT is an Australian company with 100,000 testers globally. It offers integrations with testing tools like JIRA and Quality Center as well as a joint offering with HP AppPulse.

Features:

• Integrates with various testing tools
• Provides real-time visibility into test progress

Community Type: Managed
What you really need to know:Revolution IT is an Australian company with a large presence in the local market. It provides a variety of crowd testing capabilities and integration opportunities.
For more information: Learn more here.

20. TestBats

Summary: Crowd testing for mobile, websites, games and Mac and PC software. TestBats boasts a network of over 45,000 testers in 178 countries.

Features:

• Offers testing for multiple application types

Community Type: Managed
What you really need to know:TestBats is a German crowd testing company and its work is mostly limited to the European market.
For more information: Learn more at TestBats.nl.

21. TestFairy

Summary: Provides crowd testing solely for iOS and Android mobile applications via video recording, logs and user feedback. TestFairy also offers app distribution, crash reports and community pages.

Features:

• Offers integrations with JIRA, GitHub, NetBeans and other bug tracking tools

Community Type: Managed

What you really need to know:TestFairy provides a detailed video capture of all testing, including statistics like CPU, memory and network.
For more information: Head over to TestFairy.com to learn more.
Pricing: Plans start at $79 per mo with 4 pricing tiers. View pricing here.

22. Testfire

Summary: Offers recording for iOS and Android mobile app testing so that customers can easily communicate issues. Testfire also provides video logs and device details as well as integrations with issue trackers like JIRA and GitHub and customer support tools like Zendesk and Desk.com.

Features:

• Easy to plug in to apps for testing
• Integrates with issue trackers and customer support tools

Community Type: Unmanaged
What you really need to know:Testfire is a crowd testing app that specializes in testing documentation via video recording.
For more information: Visit Testfire.io to learn more.
Pricing: Plans start at $495 per mo with 2 pricing tiers. View pricinghere.

23. Topcoder

Summary: Provides crowdsourcing for design and prototyping, application development, algorithms and analytics and app modernization. Topcoder also offers staff augmentation and boasts a community of one million members.

Features:

• Well established and extensive network
• Offers skilled security and penetration testing

Community Type: Managed
What you really need to know:Topcoder offers a large, well established network, although testing is not its only focus. It follows a pay per bug model.
For more information: Head on over to Topcoder.com to learn more.

Beta Management Testing Tools

Beta management tools control the beta testing process from app deployment to monitoring by collecting feedback and instructing beta participants how and where to test the application. Let’s take a look at the top Beta Management testing tools to consider:

1. BetaEasy

Summary: Offers a community of users to test and provide feedback on websites, mobile applications and desktop applications. With BetaEasy, users solve problems collectively by communicating with one another and voting on each other’s suggestions. It also allows companies to communicate with users and react to their suggestions and provides detailed reports of all communications and progress.

Features:

• Supports mobile, web and desktop testing
• Allows for collective feedback by connecting testers in communities

What you really need to know: BetaEasy allows for beta testing across applications and websites of all kinds and makes providing feedback a community effort, where testers can bounce ideas off one another and vote on suggestions.
For more information: Visit BetaEasy to learn more.
Pricing: Plans start at $19r mo with 3 pricing tiers. View pricinghere.

2. Applause Mobile Beta Management

Summary: Simplifies inviting beta users, distributing builds and collecting feedback for beta testing of mobile apps. Applause Mobile Beta Management is mobile-only. It allows users to share feedback and submit bugs directly from within the app they are testing and provides managers with bug and feedback reports as well as participant session information and automatic crash reporting.

Features:

• Enterprise-ready (e.g. allows for branding of the entire experience)
• Part of the larger Applause testing solutions
• Integrates with bug tracking systems

What you really need to know: Applause Mobile Beta Management supports beta testing for mobile applications only. It offers a branded, enterprise-ready solution that integrates with Applause’s testing suite and leading bug tracking systems to simplify the process of fixing bugs reported by users.
For more information: Visit Applause Mobile Beta Management to learn more.

Up and Coming Software Testing Tools

These companies aren’t quite ready for our ultimate list just yet, but they are definitely ones to keep an eye on.

• Froglogic(Test Automation)
• Flood.io(Performance and Load Testing)
• API Fortress(API Testing)
• Codified Security(Security Testing)
• Browsershots(Compatibility Testing)
• Bitbar(Mobile Device Farm)

NEVER MISS AN UPDATE

Subscribe to Our Newsletter

Javascript is disabled. Please enable it to see the form.