CODEWITHSUNDEEP
automated-testscypress
WouX
WouX

Reputation: 413

Cypress - How can I run test files in order

When I press the "run all specs" button or use the run command that runs all files in Cypress it runs all test files alphabetically, so I don't want that.

I want to sort all of them with my own rules.

Let's say I have 3 steps in a chat app test.

  1. Can connect the chat app
  2. Can connect the chat
  3. Can the user send a message

I want to test every step without being tied to each other. What I mean, Testing one of their own function. What I do is as follows

chat_app_connect.spec.js

describe('Server Connecting Test', () => {
    it('Visit Server page', () => {
        cy.visit('https://chat.page..');
    });

    it('Check welcome messages', () => {
        cy.contains('Live Support');
        cy.contains('Hello, Stranger');
    });

    it('Check URL and status of circle', () => {
        // URL
        cy.url()
            .should('include', '/hello');
        // Status Circle    
        cy.get('circle')
            .should('have.class', 'positive');
    });
});

chat_connect.spec.js

import './chat_app_connect.spec.js';

describe('Chat Connecting Test', () => {
    it('Type customer name', () => {
        cy.get('input')
            .clear()
            .type('E2E Test');
    });
    it('Click to the submit button', () => {
        cy.get('.submit-button')
            .click();
    });
    it('Check URL and status of circle', () => {
        // URL
        cy.url()
            .should('equal', 'https://client.dev.octopus.chat/');
        // Status Circle
        cy.get('circle', { timeout: 5000 })
            .should('have.class', 'positive');
    });
});

chatting.spec.js

import './chat_connect.spec.js';

describe('Chatting Tests', () => {
    it('Type a test message then press Enter and check the message if it sent', () => {
        // Type
        cy.get('#chat-message')
            .clear()
            .type('Hey I\'m a test message{enter}');
        // Check the message
        cy.get('.message-list')
            .should('contain', 'Hey I\'m a test message');
    });
});

as you see every test is tied to each other, and that is mean when I tried to test just catting functionality its call every test and the whole tests will be tested.

I don't know if it is the right way or not.

what should I do in this case or can it be an acceptable way

Upvotes: 41

Views: 44886

Answers (7)

madhuri varada
madhuri varada

Reputation: 93

We can run spec files in the order in HeadlessMode 

step1: Create the testFile.spec.cy.js
Step2: Import the spec files into the testFile

example : import 'login.spec.cy.js"
          import 'homePage.spec.cy.js",
          import 'DashboardPage.spec.cy.js"

npx cypress run --spec testFile.spec.cy.js

Upvotes: 0

MikhailRatner
MikhailRatner

Reputation: 582

The accepted answer is not up to date yet. For Cypress 12 you can configure the order of your tests inside of the cypress.config.ts file (instead of cypress.json) like this:

import { defineConfig } from 'cypress';

export default defineConfig({
    e2e: {
        baseUrl: 'http://localhost:5000',
        specPattern: [
            '**/login.cy.ts',
            '**/logout.cy.ts',
        ],
    },

    component: {
        devServer: {
            framework: 'angular',
            bundler: 'webpack',
        },
        specPattern: [
            '**/myFirstComponent.cy.ts',
            '**/mySecondComponent.cy.ts'
        ],
    },
});

Keep in mind that the specPattern has to be inside of e2e or in component depending on what kind of tests you want to order.

Also for me it was necessary to add **/ in front of my test names, e.g. '**/login.cy.ts'.

Upvotes: 3

JeanLescure
JeanLescure

Reputation: 1139

I have a particular case where I launch multiple instances of an app, rather than using fixtures or test data, I simply integrate user feedback as Cypress tests from login on forwards.

In any case, I used the specPattern configuration property in cypress.json to set the spec file run order:

{
  "baseUrl": "http://localhost:5000",
  "specPattern": [
    "login/*.js",
    "leads/new-lead.spec.js",
    "leads/leads-list.spec.js",
    "leads/lead-detail.spec.js",
    "leads/lead-modify.spec.js",
    //...
  ]
}

No file numbering needed :D

This configuration property was added in version 10, see also:

Upvotes: 56

Vlad R
Vlad R

Reputation: 2624

In addition to @Brendan answer, if you have a nested folder structure, this approach will work as well.

01-folder-name
 |
  - 01-some-spec.js

Upvotes: 1

Peter Drinnan
Peter Drinnan

Reputation: 4522

Jean Lescure's answer was a lifesaver. We needed to run tests based on priority without having a bunch of duplicated tests or symlinks. The following worked for us in our default cypress config file:

  "integrationFolder":"cypress/integration",
  "testFiles": [
    "high_priority_specs/**/*.js",
    "medium_priority_specs/**/*.js",
    "low_priority_specs/**/*.js"
  ]

To change the level of priority we used 3 configs files that were loaded using the cypress --configFile argument. To run the higher priority tests (smoke tests only) we used the following:

  "integrationFolder":"cypress/integration",
  "testFiles": [
    "high_priority_specs/**/*.js"
  ]

Upvotes: 7

alcfeoh
alcfeoh

Reputation: 2247

The easiest solution is most likely to add a prefix to all your test files, such as:

  • 01-chat_app_connect.spec.js
  • 02-chat_connect.spec.js

etc.

Cypress is going to take those files in alphabetical order, which you can "trick" into your wanted behavior by using a number as a prefix.

Upvotes: 18

Brendan
Brendan

Reputation: 4649

Cypress does not intentionally let you do this, and for good reasons:

  1. It's generally indicative of poor test design. Tests should not depend on the state of one another. Any test should be able to be run successfully in isolation from the rest of the test suite.
  2. You'll never be able to take advantage of cypress' built in ability to run tests in parallel since you can't guarantee one spec will be ran after another

Here is a relevant discussion about this that gets into more detail: https://github.com/cypress-io/cypress/issues/390

However, if you decide to do this anyway, you can do it by prefixing the name of the specs with a number:

01-some-spec.js
02-alphabetically-first-spec.js
03-some-other-spec.js

Upvotes: 6

Related Questions