sed operation being overwritten in Dockerfile

Question

I have in interesting issue where, in my Dockerfile, I'm running an inline sed command in a RUN directive. I can watch the STDOUT of the build and see the sed command is correct and successful however, once the image is built and run, the file is not modified. This leads me to believe that another layer is overwriting the one from that RUN declaration, but I don't think that a subsequent directive in my Dockerfile would do that. Here is the Dockerfile (the ping was to speed up startup to troubleshoot). Notice that I commented out the VOLUME directive just to see if that was interfering somehow (like in this issue, even though my RUN is before the VOLUME. I feel like I'm missing something basic, but after banging my head on the desk for 2 weeks, I need help. :-)

FROM alpine:3.6
RUN apk add --no-cache maven git
WORKDIR /build/
RUN git clone https://github.com/sonatype-nexus-community/nexus-repository-helm.git \
    && cd nexus-repository-helm \
    && mvn clean package



FROM    centos:centos7
LABEL MAINTAINER=[...]

ENV NEXUS_VERSION=3.12.1-01
ARG NEXUS_DOWNLOAD_URL=https://download.sonatype.com/nexus/3/nexus-${NEXUS_VERSION}-unix.tar.gz
ARG NEXUS_DOWNLOAD_SHA256_HASH=8f3137471cdb002b6cf9d1874bbddb6ad280d4d7a492e363cfc5f54fbd45b5d9

RUN yum install -y \
  curl tar java-1.8.0-openjdk \
  && yum clean all


# configure nexus runtime
ENV SONATYPE_DIR=/opt/sonatype
ENV NEXUS_HOME=${SONATYPE_DIR}/nexus \
  NEXUS_DATA=/nexus-data \
  NEXUS_CONTEXT='' \
  SONATYPE_WORK=${SONATYPE_DIR}/sonatype-work \
  DOCKER_TYPE='docker'

# install nexus
RUN mkdir -p ${NEXUS_HOME} \
  && curl --fail --silent --location --retry 3 \
    ${NEXUS_DOWNLOAD_URL} \
  | gunzip \
  | tar x -C ${NEXUS_HOME} --strip-components=1 nexus-${NEXUS_VERSION} \
  && chown -R root:root ${NEXUS_HOME}

COPY --from=0 \
      /build/nexus-repository-helm/target/nexus-repository-helm-0.0.1.jar \
  ${NEXUS_HOME}/system/org/sonatype/nexus/plugins/nexus-repository-helm/0.0.1/nexus-repository-helm-0.0.1.jar

# configure nexus
RUN sed -e '/^nexus-context/ s:$:${NEXUS_CONTEXT}:' -i ${NEXUS_HOME}/etc/nexus-default.properties

RUN sed -e '/nexus-repository-helm' -e '//i \ \ \ \ 
        org.sonatype.nexus.plugins:nexus-repository-helm
        mvn:org.sonatype.nexus.plugins/nexus-repository-helm/0.0.1
    ' \
    ${NEXUS_HOME}/system/org/sonatype/nexus/assemblies/nexus-core-feature/${NEXUS_VERSION}/nexus-core-feature-${NEXUS_VERSION}-features.xml

RUN useradd -r -u 200 -m -c "nexus role account" -d ${NEXUS_DATA} -s /bin/false nexus \
  && mkdir -p ${NEXUS_DATA}/etc ${NEXUS_DATA}/log ${NEXUS_DATA}/tmp ${SONATYPE_WORK} \
  && ln -s ${NEXUS_DATA} ${SONATYPE_WORK}/nexus3 \
  && chown -R nexus:nexus ${NEXUS_DATA}

#VOLUME ${NEXUS_DATA}

EXPOSE 8081

WORKDIR ${NEXUS_HOME}

ENV INSTALL4J_JAVA_HOME="/usr/bin/java"
ENV INSTALL4J_ADD_VM_PARAMS="-Xms1200m -Xmx1200m -XX:MaxDirectMemorySize=2g -Djava.util.prefs.userRoot=${NEXUS_DATA}/javaprefs"

USER nexus

CMD ["ping", "localhost"]
#CMD ["bin/nexus", "run"]

Here is the STDOUT of the build (Step 11 is the sed operation):

$ docker build -t nexus:local .
Sending build context to Docker daemon  9.625MB
Step 1/8 : FROM alpine:3.6
 ---> 77144d8c6bdc
Step 2/8 : RUN apk add --no-cache maven git
 ---> Using cache
 ---> 06ea90323059
Step 3/8 : WORKDIR /build/
 ---> Using cache
 ---> 883f7001e5e7
Step 4/8 : RUN git clone https://github.com/sonatype-nexus-community/nexus-repository-helm.git     && cd nexus-repository-helm     && mvn clean package
 ---> Using cache
 ---> 8916c43cbca0
Step 5/8 : FROM sonatype/nexus3
 ---> 292674e848ae
Step 6/8 : LABEL MAINTAINER=[...]
 ---> Using cache
 ---> ba1dedda1d61
Step 7/8 : COPY --from=0       /build/nexus-repository-helm/target/nexus-repository-helm-0.0.1.jar   ${NEXUS_HOME}/system/org/sonatype/nexus/plugins/nexus-repository-helm/0.0.1/nexus-repository-helm-0.0.1.jar
 ---> Using cache
 ---> d6c2db5babd8
Step 8/8 : RUN sed -e '/nexus-repository-helm' -e '//i \ \ \ \ 
        org.sonatype.nexus.plugins:nexus-repository-helm
        mvn:org.sonatype.nexus.plugins/nexus-repository-helm/0.0.1
    '     ${NEXUS_HOME}/system/org/sonatype/nexus/assemblies/nexus-core-feature/${NEXUS_VERSION}/nexus-core-feature-${NEXUS_VERSION}-features.xml
 ---> Running in f79d0a7bbc87
sed: can't read /opt/sonatype/nexus/system/org/sonatype/nexus/assemblies/nexus-core-feature//nexus-core-feature--features.xml: No such file or directory
The command '/bin/sh -c sed -e '/nexus-repository-helm' -e '//i \ \ \ \ 
        org.sonatype.nexus.plugins:nexus-repository-helm
        mvn:org.sonatype.nexus.plugins/nexus-repository-helm/0.0.1
    '     ${NEXUS_HOME}/system/org/sonatype/nexus/assemblies/nexus-core-feature/${NEXUS_VERSION}/nexus-core-feature-${NEXUS_VERSION}-features.xml' returned a non-zero code: 2
ssteiner-mbp:asset-repo ssteiner$ docker build -t nexus:local .
Sending build context to Docker daemon  9.625MB
Step 1/11 : FROM alpine:3.6
 ---> 77144d8c6bdc
Step 2/11 : RUN apk add --no-cache maven git
 ---> Using cache
 ---> 06ea90323059
Step 3/11 : WORKDIR /build/
 ---> Using cache
 ---> 883f7001e5e7
Step 4/11 : RUN git clone https://github.com/sonatype-nexus-community/nexus-repository-helm.git     && cd nexus-repository-helm     && mvn clean package
 ---> Using cache
 ---> 8916c43cbca0
Step 5/11 : FROM    sonatype/nexus3
 ---> 292674e848ae
Step 6/11 : LABEL MAINTAINER=[...]
 ---> Using cache
 ---> ba1dedda1d61
Step 7/11 : ARG NEXUS_VERSION=3.12.1-01
 ---> Running in d57500c9e0c7
Removing intermediate container d57500c9e0c7
 ---> 6100a60825e0
Step 8/11 : ENV SONATYPE_DIR=/opt/sonatype
 ---> Running in 33658a9a879b
Removing intermediate container 33658a9a879b
 ---> 496da8aa67b9
Step 9/11 : ENV NEXUS_HOME=${SONATYPE_DIR}/nexus   NEXUS_DATA=/nexus-data
 ---> Running in 3c57eff29800
Removing intermediate container 3c57eff29800
 ---> 6ce7595add66
Step 10/11 : COPY --from=0       /build/nexus-repository-helm/target/nexus-repository-helm-0.0.1.jar   ${NEXUS_HOME}/system/org/sonatype/nexus/plugins/nexus-repository-helm/0.0.1/nexus-repository-helm-0.0.1.jar
 ---> 4f85bde4e5eb
Step 11/11 : RUN sed -e '/nexus-repository-helm' -e '//i \ \ \ \ 
        org.sonatype.nexus.plugins:nexus-repository-helm
        mvn:org.sonatype.nexus.plugins/nexus-repository-helm/0.0.1
    '     ${NEXUS_HOME}/system/org/sonatype/nexus/assemblies/nexus-core-feature/${NEXUS_VERSION}/nexus-core-feature-${NEXUS_VERSION}-features.xml
 ---> Running in de0fe21cd88e


    
        org.sonatype.nexus.assemblies:nexus-core-feature
        nexus-audit-plugin
        nexus-blobstore-tasks
        nexus-ssl-plugin
        nexus-coreui-plugin
        nexus-repository-httpbridge
        nexus-repository-maven
        nexus-repository-npm
        nexus-repository-raw
        nexus-restore-maven
        nexus-blobstore-s3
        nexus-restore-npm
        nexus-script-plugin
        nexus-task-log-cleanup
        nexus-repository-helm
        wrap
        mvn:org.sonatype.nexus/nexus-core/3.12.1-01
        mvn:org.sonatype.nexus/nexus-supportzip-api/3.12.1-01
        mvn:org.sonatype.nexus/nexus-email/3.12.1-01
        mvn:org.apache.commons/commons-email/1.5
        mvn:com.sun.mail/javax.mail/1.5.6
        mvn:org.sonatype.nexus/nexus-repository/3.12.1-01
        mvn:org.sonatype.nexus/nexus-capability/3.12.1-01
        mvn:org.sonatype.nexus/nexus-mime/3.12.1-01
        mvn:org.apache.tika/tika-core/1.14
        mvn:org.sonatype.nexus/nexus-blobstore/3.12.1-01
        mvn:org.sonatype.nexus/nexus-blobstore-api/3.12.1-01
        mvn:org.sonatype.nexus/nexus-blobstore-file/3.12.1-01
        mvn:org.apache.commons/commons-lang3/3.4
        wrap:mvn:com.squareup/tape/1.2.3
        mvn:org.sonatype.nexus/nexus-httpclient/3.12.1-01
        mvn:commons-codec/commons-codec/1.10
        mvn:org.sonatype.nexus/nexus-elasticsearch/3.12.1-01
        mvn:org.sonatype.nexus.bundles/org.sonatype.nexus.bundles.elasticsearch/3.12.1-01
        mvn:com.fasterxml.jackson.dataformat/jackson-dataformat-cbor/2.9.2
        mvn:com.fasterxml.jackson.dataformat/jackson-dataformat-smile/2.9.2
        mvn:com.fasterxml.jackson.dataformat/jackson-dataformat-yaml/2.9.2
        mvn:org.yaml/snakeyaml/1.18
        mvn:org.hdrhistogram/HdrHistogram/2.1.6
        wrap:mvn:com.vividsolutions/jts/1.13
        mvn:com.ning/compress-lzf/1.0.2
        mvn:io.netty/netty/3.10.6.Final
        mvn:org.sonatype.nexus/nexus-selector/3.12.1-01
        mvn:org.apache.commons/commons-jexl3/3.0
        mvn:org.apache.james/apache-mime4j/0.6
        mvn:org.sonatype.nexus/nexus-script/3.12.1-01
        mvn:org.apache.ivy/ivy/2.3.0
        mvn:org.sonatype.nexus/nexus-ssl/3.12.1-01
        wrap:mvn:org.apache.geronimo.framework/geronimo-crypto/2.2.1
        mvn:org.sonatype.nexus/nexus-webhooks/3.12.1-01
        mvn:org.sonatype.nexus/nexus-quartz/3.12.1-01
        mvn:org.sonatype.nexus/nexus-scheduling/3.12.1-01
        mvn:org.jboss.spec.javax.ws.rs/jboss-jaxrs-api_2.0_spec/1.0.1.Beta1
        wrap:mvn:org.jboss.resteasy/resteasy-jaxrs-services/3.1.3.Final
        mvn:org.jboss.spec.javax.annotation/jboss-annotations-api_1.2_spec/1.0.0.Final
        wrap:mvn:net.jcip/jcip-annotations/1.0
        mvn:org.sonatype.nexus/nexus-thread/3.12.1-01
        mvn:com.fasterxml.jackson.core/jackson-databind/2.9.2
        mvn:org.quartz-scheduler/quartz/2.2.2
        wrap:mvn:c3p0/c3p0/0.9.1.1
        mvn:org.apache.commons/commons-compress/1.16.1
        mvn:org.objenesis/objenesis/2.2
        mvn:org.tukaani/xz/1.8
    
    
        org.sonatype.nexus.plugins:nexus-audit-plugin
        mvn:org.sonatype.nexus.plugins/nexus-audit-plugin/3.12.1-01
        mvn:org.sonatype.nexus/nexus-audit/3.12.1-01
        mvn:org.sonatype.nexus/nexus-webhooks/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-blobstore-tasks
        mvn:org.sonatype.nexus.plugins/nexus-blobstore-tasks/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-ssl-plugin
        nexus-repository-helm
        wrap
        mvn:org.sonatype.nexus.plugins/nexus-ssl-plugin/3.12.1-01
        mvn:org.sonatype.nexus/nexus-ssl/3.12.1-01
        mvn:org.sonatype.nexus/nexus-crypto/3.12.1-01
        wrap:mvn:org.apache.geronimo.framework/geronimo-crypto/2.2.1
    
    
        org.sonatype.nexus.plugins:nexus-coreui-plugin
        mvn:org.sonatype.nexus.plugins/nexus-coreui-plugin/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-repository-httpbridge
        mvn:org.sonatype.nexus.plugins/nexus-repository-httpbridge/3.12.1-01
        mvn:commons-fileupload/commons-fileupload/1.3.2
        mvn:commons-io/commons-io/2.4
    
    
        org.sonatype.nexus.plugins:nexus-repository-maven
        nexus-repository-helm
        wrap
        mvn:org.sonatype.nexus.plugins/nexus-repository-maven/3.12.1-01
        wrap:mvn:org.apache.maven/maven-model/3.3.3
        wrap:mvn:org.codehaus.plexus/plexus-utils/3.0.24
        wrap:mvn:org.apache.maven/maven-repository-metadata/3.3.3
        mvn:org.eclipse.aether/aether-api/1.0.2.v20150114
        mvn:org.eclipse.aether/aether-util/1.0.2.v20150114
        mvn:org.eclipse.aether/aether-spi/1.0.2.v20150114
        mvn:org.apache.maven.indexer/indexer-reader/5.1.2-816025a
        wrap:mvn:org.apache.maven.archetype/archetype-catalog/2.4
    
    
        org.sonatype.nexus.plugins:nexus-repository-npm
        nexus-repository-helm
        wrap
        mvn:org.sonatype.nexus.plugins/nexus-repository-npm/3.12.1-01
        mvn:org.apache.commons/commons-compress/1.16.1
        mvn:org.objenesis/objenesis/2.2
        wrap:mvn:se.sawano.java/alphanumeric-comparator/1.4.1
        mvn:com.fasterxml.jackson.datatype/jackson-datatype-joda/2.9.2
        mvn:com.fasterxml.jackson.core/jackson-annotations/2.9.2
        mvn:com.fasterxml.jackson.core/jackson-core/2.9.2
        mvn:joda-time/joda-time/2.9.5
    
    
        org.sonatype.nexus.plugins:nexus-repository-raw
        mvn:org.sonatype.nexus.plugins/nexus-repository-raw/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-restore-maven
        mvn:org.sonatype.nexus.plugins/nexus-restore-maven/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-restore-npm
        mvn:org.sonatype.nexus.plugins/nexus-restore-npm/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-script-plugin
        mvn:org.sonatype.nexus.plugins/nexus-script-plugin/3.12.1-01
    
    
        org.sonatype.nexus.plugins:nexus-task-log-cleanup
        mvn:org.sonatype.nexus.plugins/nexus-task-log-cleanup/3.12.1-01
        mvn:commons-io/commons-io/2.4
    
    
        org.sonatype.nexus.plugins:nexus-blobstore-s3
        nexus-repository-helm
        wrap
        mvn:org.sonatype.nexus.plugins/nexus-blobstore-s3/3.12.1-01
        mvn:com.codahale.metrics/metrics-annotation/3.0.2
        mvn:org.sonatype.nexus/nexus-extdirect/3.12.1-01
        mvn:org.sonatype.nexus/nexus-analytics-api/3.12.1-01
        mvn:org.sonatype.nexus/nexus-servlet/3.12.1-01
        mvn:javax.servlet/javax.servlet-api/3.1.0
        mvn:org.sonatype.nexus/nexus-guice-servlet/3.12.1-01
        wrap:mvn:eu.bitwalker/UserAgentUtils/1.19
        mvn:org.sonatype.nexus/nexus-validation/3.12.1-01
        mvn:org.hibernate/hibernate-validator/5.1.2.Final
        mvn:org.jboss.logging/jboss-logging/3.1.3.GA
        mvn:com.fasterxml/classmate/1.0.0
        mvn:org.sonatype.nexus/nexus-webresources-api/3.12.1-01
        mvn:com.google.code.gson/gson/2.3.1
        mvn:commons-fileupload/commons-fileupload/1.3.2
    
    
        org.sonatype.nexus.plugins:nexus-repository-helm
        mvn:org.sonatype.nexus.plugins/nexus-repository-helm/0.0.1
    

Removing intermediate container de0fe21cd88e
 ---> 740b5256c0f0
Successfully built 740b5256c0f0
Successfully tagged nexus:local

Then afterwards, an exec session into the running container and doing a cat of the file shows the original contents (I don't have space to post the full file, but trust me, it's unmodified). What am I missing?

sirlatrom · Accepted Answer

The second invocation of sed, i.e. the one that is to modify ${NEXUS_HOME}/system/org/sonatype/nexus/assemblies/nexus-core-feature/${NEXUS_VERSION}/nexus-core-feature-${NEXUS_VERSION}-features.xml, appears to be missing the -i/--in-place flag, leading to the output being written to standard out rather than to the input file.

It can be a helpful practice to specify options that do not require parameters before those that do, whenever the order of the options does not change their effect.

sed operation being overwritten in Dockerfile

Answers (1)

Related Questions