Can Yildirim's Blog

Jira Test Tool Comparison : Zephyr For Jira vs X-Ray

July 12, 2016

Hi everyone,

I have been researching proper test tool for Jira for a while. After the deep observation, two tools came to my attention. I got a trial Jira Cloud account and setup these two plugin.

I am going to mention about 3 different dimensions, these are;

  • Applicability for JIRA
  • API
  • Test Cases/ Executions
1 . Applicabililty  for JIRA

B4A2B8D2-9BF0-4691-8469-1AF78EFC7C2F

If you want to create a test, you should select Issue Type as Test.

Zephyr test tasks works on software project. That circumstance is confusing in my opinion. For Example: If id of a feature is 4 so id of test issue will be  5.

X-Ray for Jira, inform us  more, at this point. You have a few way to apply your tests to your project. X-Ray for Jira provides us more flexibility on the domain.

Issue Type Group in Requirements Project

EDE23BFB-9176-4C68-A9C3-C465E99C2B98

As A Test Project and Requirements

B6CA9436-2928-4C39-B29D-73214F75C9CB

Separated** as Requirements Project, Test project, Test Execution Project**

449BD632-2C3F-42C6-A0B7-12A3835608DC

2. API

API can be usable for Automated tests . If you make the integration between Jira and CI, that will be suitable for your test&release process.

Zephyr has a great API and ApiDoc as i review. You can reach the Zephyr API from this link.

X Ray has a nice API so. Cucumber , import and export supports are  significant features. They present  api doc in confluence. Zephyr API looks like more understandable than X-Ray API about the ApiDoc.

3. Test Cases / Executions

Xray for JIRA features:

  • Create,Edit and View Test
  • Support For Automated and Manuel Test
  • Specify steps of manual tests with step detail, data, expected result and input attachments.
  • Associate preconditions with automated or manual tests.
  • Group tests into test sets.
  • View and filter all list of test runs for a specific test.
  • Clone tests and test sets.
  • Tracking metrics

Create Issue

create issue

Test Set

create test execution

Test Steps

test steps

Zephyr For JIRA Features:

  • Writing testcases
  • Test Scheduling
  • Test Execution and defect
  • Specify steps of manual tests with step detail, data, expected result and input attachments.
  • Tracking Metrics
  • Automated test support can be provide via API
  • wiki markup
  • test case clone

Create Test

**zephyr test create **

Specify Test Steps

zephyr specify test steps

Test Cycles

zephyr test cycyles


Can Yildirim

Written by Can Yildirim who lives in London. Full Stack Software Engineer. Follow me on Twitter Linkedin