CODEWITHSUNDEEP
jenkinsjenkins-pipelinejenkins-docker
Avindra Goolcharan
Avindra Goolcharan

Reputation: 4211

Reuse agent (docker container) in Jenkins between multiple stages

I have a pipeline with multiple stages, and I want to reuse a docker container between only "n" number of stages, rather than all of them:

pipeline {
   agent none

   stages {
       stage('Install deps') {
            agent {
                docker { image 'node:10-alpine' }
            }

            steps {
                sh 'npm install'
            }
        }

       stage('Build, test, lint, etc') {
            agent {
                docker { image 'node:10-alpine' }
            }

            parallel {
                stage('Build') {
                    agent {
                        docker { image 'node:10-alpine' }
                    }

                    // This fails because it runs in a new container, and the node_modules created during the first installation are gone at this point
                    // How do I reuse the same container created in the install dep step?
                    steps {
                        sh 'npm run build'
                    }
                }

                stage('Test') {
                    agent {
                        docker { image 'node:10-alpine' }
                    }

                    steps {
                        sh 'npm run test'
                    }
                }
            }
        }


        // Later on, there is a deployment stage which MUST deploy using a specific node,
        // which is why "agent: none" is used in the first place

   }
}

Upvotes: 17

Views: 22938

Answers (4)

RiverHeart
RiverHeart

Reputation: 832

For declarative pipelines you can use nested stages described here

There's a better example than this in the link above, I just didn't want to copy paste verbatim.

pipeline {
    agent none

    stages {
        stage("Reuse Docker Image Across Sub-stages") {
            agent { docker "image1" }
            stages {
               stage("sub stage 1") {
                   steps { sh "./one.sh" }
               }
               stage("sub stage 2") {
                   steps { sh "./two.sh" }
               }
            }
        }

        stage("Use new docker image for something else") 
            agent { docker "image2" }
            steps { sh "./three.sh" }
        }
    }
}

Upvotes: 3

Ankit Pandoh
Ankit Pandoh

Reputation: 577

For Declarative pipeline, one solution can be to use Dockerfile in the root of the project. For e.g.

Dockerfile 

FROM node:10-alpine
// Further Instructions

Jenkinsfile 

pipeline{

    agent {
        dockerfile true
    }
    stage('Build') {
        steps{
            sh 'npm run build'
        }
    }
     stage('Test') {
        steps{
            sh 'npm run test'
        }
    }
}

Upvotes: 3

Oleksandr S.
Oleksandr S.

Reputation: 2014

See reuseNode option for Jenkins Pipeline docker agent:
https://jenkins.io/doc/book/pipeline/syntax/#agent

pipeline {
  agent any

  stages {
    stage('NPM install') {
      agent {
        docker {
          /*
           * Reuse the workspace on the agent defined at top-level of
           * Pipeline, but run inside a container.
           */
          reuseNode true
          image 'node:12.16.1'
        }
      }

      environment {
        /*
         * Change HOME, because default is usually root dir, and
         * Jenkins user may not have write permissions in that dir.
         */
        HOME = "${WORKSPACE}"
      }

      steps {
        sh 'env | sort'
        sh 'npm install'
      }
    }
  } 
}

Upvotes: 20

StephenKing
StephenKing

Reputation: 37580

You can use scripted pipelines, where you can put multiple stage steps inside a docker step, e.g.

node {
  checkout scm
  docker.image('node:10-alpine').inside {
    stage('Build') {
       sh 'npm run build'
     }
     stage('Test') {
       sh 'npm run test'
     }
  }
}

(code untested)

Upvotes: 8

Related Questions