Strange issue with copy artifact plugin not copying everything

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Strange issue with copy artifact plugin not copying everything

Suckow, Thomas J
I am seeing a strange behavior with the Copy Artifact Plugin version 1.35.1

I have a job that creates some shared objects and some include headers.
Those files are archived as artifacts and in another job use the "Copy
Artifact" build step to copy them.

The console says 18 files were copied, but in fact only 15 are present.
The same 3 are always missing. Weirder still, if I configure the second
job to NOT clean the workspace, the second time you run the build the
files will be copied. In fact I can configure the job to copy the same
artifacts twice to work around the issue.

I assume this is a bug in the plugin though I can't begin to speculate
what is going wrong, I use the plugin for other things and never have had
issues.

Anyone else seen this strange behavior or have thoughts on the matter?

-
Thomas

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/D1A88FD6.17159%25thomas.suckow%40pnnl.gov.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

RE: Strange issue with copy artifact plugin not copying everything

Matthew.Webber
The first step is to determine whether the problem is that the files are not being archived in the upstream job, or whether they are archived but then not subsequently retrieved by the CopyArtifact plugin in the downstream job. Look on the Jenkins master itself, in Jenkins_home/jobs/<upstream-job-name>/builds/<build-number>/archive/.

We use archive and CopyArtifact a lot, and I have never seen anything like this. Have you checked that your path specifications are all correct?

Matthew


> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of Suckow, Thomas J
> Sent: 18 June 2015 23:10
> To: [hidden email]
> Subject: Strange issue with copy artifact plugin not copying everything
>
> I am seeing a strange behavior with the Copy Artifact Plugin version 1.35.1
>
> I have a job that creates some shared objects and some include headers.
> Those files are archived as artifacts and in another job use the "Copy
> Artifact" build step to copy them.
>
> The console says 18 files were copied, but in fact only 15 are present.
> The same 3 are always missing. Weirder still, if I configure the second
> job to NOT clean the workspace, the second time you run the build the
> files will be copied. In fact I can configure the job to copy the same
> artifacts twice to work around the issue.
>
> I assume this is a bug in the plugin though I can't begin to speculate
> what is going wrong, I use the plugin for other things and never have had
> issues.
>
> Anyone else seen this strange behavior or have thoughts on the matter?
>
> -
> Thomas
>

--
This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/6836E1DC2DDC174C9D64B7860E5AF5FC9EE84AA2%40EXCHMBX01.fed.cclrc.ac.uk.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Strange issue with copy artifact plugin not copying everything

Suckow, Thomas J
For good measure I went and checked the folder and the archive directory
has all the files it is supposed to. Though I expect this since my
workaround works.

I created a brand new freestyle job that ALL it does is copy the
artifacts. The first time it is run, only 15 are copied. If I click build
now again, then the missing ones are copied. If I delete the workspace,
the same pattern happens again.

In case anyone has thoughts, here is the parent job:

Centos 6 installed packages:
yum -y install gcc-c++ binutils scons chrpath tar python-devel

Tar from:
http://download-mirror.savannah.gnu.org/releases/gpsd/


Build step:
tar -xzf gpsd-3.10.tar.gz
cd gpsd-3.10
echo "env.Alias('myinstall', binaryinstall + headerinstall)" >> SConstruct
scons prefix=$WORKSPACE/stage myinstall


Archive artifacts: stage/**/*




This is my test job:


Copy Artifact plugin
Project name: libgps
Which build: Latest successful build
Target directory: libgps


Missing files in libgps/stage/lib (Always the same):
libgps.so

libgps.so.21

libgps.so.21.0




As another workaround (besides running the job twice) you can add a second
"Copy Artifacts" build step with the exact same settings and it will work.


If anyone has thoughts on loggers I could set to verbose that might reveal
something, I am all ears.

-
Thomas

On 6/19/15, 7:05 AM, "[hidden email]"
<[hidden email]> wrote:

>The first step is to determine whether the problem is that the files are
>not being archived in the upstream job, or whether they are archived but
>then not subsequently retrieved by the CopyArtifact plugin in the
>downstream job. Look on the Jenkins master itself, in
>Jenkins_home/jobs/<upstream-job-name>/builds/<build-number>/archive/.
>
>We use archive and CopyArtifact a lot, and I have never seen anything
>like this. Have you checked that your path specifications are all correct?
>
>Matthew

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/D1A97CBB.171DA%25thomas.suckow%40pnnl.gov.
For more options, visit https://groups.google.com/d/optout.