The TestQuality Command Line Interface allows you to upload your automated test results from pytest to TestQuality. Automated test results must be output in JUnit XML format, which most test automation tools will provide. Test result attachments and related defects are also supported through test name tags or console outputs.

For DEFECTS we expect the following tag format for both test name tags and console ouptuts.

  • GitHub Defects [[DEFECT|22]]
  • Jira Defects [[DEFECT|TQ-123]]

For ATTACHMENTS the following format is expected:

  • Attachments from test name tag [[ATTACHMENT|ScreenshotFileName.png]]
  • Attachments from console output [[ATTACHMENT|path/to/file]]

Note that for attachment test name tag usage you will neet to use ‘run_result_output_dir’ option to specify the test result output directory.

Download TestQuality Command Line Interface

Download CLI tools from http://cli.testquality.com/

CLI tools are available for Windows, MacOS, Linux, and Alpine.


In order to upload xml you will need to:

  1. Create a target Test Plan
  2. Authenticate with TestQuality
  3. Run command to upload files

Compiled Commands

There are compiled commands for

  • Windows
  • MacOS
  • Linux
  • Alpine

Commands can be downloaded from cli.testquality.com

Note: For alpine you must install libstdc++

apk add –no-cache libstdc++


For list of commands

yarn start –help


testquality-macos –help

For command help

yarn start login –help


testquality-macos login –help


Include –save to save tokens to use with other commands.


Example workflow.

testquality-macos login larry@bitmodern.com *password* –save

testquality-macos upload_test_run ‘sampleXml/*.xml’ –project_name=Test –plan_name=Test

You can also create a manual test plan run.

testquality-macos create_manual_run –project_name=My_Project –plan_name=My_Test_Plan –run_name=Test_Run_Name

CSV Files

testquality-macos upload_csv ./test_run_results.csv –cf ./test_run_results.config