Stuck jobs

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Stuck jobs

john.peterson

We semi-regularly get jobs that get stuck after the following:

 

[URLTrigger] A change within the response URL invocation (log)
[US-VM01_Win7x64] Starting limited count build: 1 of 1
Building remotely on US-VM01_Win7x64 (Win7x64_Clean) in workspace c:\jenkins\workspace\CMM-M Main (x64) - Win7 - Inst

http://jenkins_us1:9191/static/a0989eb8/images/spinner.gif

 

The VM launches and connects.  But the job itself never starts (the first “missing” line here is the beginning of “We will get a clean checkout from SVN”).  If I log into the machine, I can get to SVN, so it’s not like there are inaccessible resources?

 

It can happen on any VM instance.  It can happen on any one of our many products.  It can happen with any version of Jenkins in the last 3 years.  It can happen with any of our 100’s of system test variations.  There seems to be no rhyme or reason.  It just occasionally – hangs.

 

header

John E. Peterson

ASW Quality Program Manager
[hidden email]
Tel: +1 (810) 220-4360
Fax: +1 (810) 220-4300

Nikon Metrology, Inc.
631 Bear Run Lane
Lewis Center, OH  43035
USA
www.nikonmetrology.com

 

 

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/f887a652f08a465e92147583add54c85%40NKEU-EX-01.nikonoa.net.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Stuck jobs

Daniel Beck
Output of https://wiki.jenkins-ci.org/display/JENKINS/Obtaining+a+thread+dump might be useful when this occurs, to see what's going on.

> On 7. Mar 2018, at 14:52, <[hidden email]> <[hidden email]> wrote:
>
> We semi-regularly get jobs that get stuck after the following:
>  
> [URLTrigger] A change within the response URL invocation (log)
> [US-VM01_Win7x64] Starting limited count build: 1 of 1
> Building remotely on US-VM01_Win7x64 (Win7x64_Clean) in workspace c:\jenkins\workspace\CMM-M Main (x64) - Win7 - Inst
> <image001.gif>
>  
> The VM launches and connects.  But the job itself never starts (the first “missing” line here is the beginning of “We will get a clean checkout from SVN”).  If I log into the machine, I can get to SVN, so it’s not like there are inaccessible resources?
>  
> It can happen on any VM instance.  It can happen on any one of our many products.  It can happen with any version of Jenkins in the last 3 years.  It can happen with any of our 100’s of system test variations.  There seems to be no rhyme or reason.  It just occasionally – hangs.
>  
> <image002.jpg>
> John E. Peterson
> ASW Quality Program Manager
> [hidden email]
> Tel: +1 (810) 220-4360
> Fax: +1 (810) 220-4300
> Nikon Metrology, Inc.
> 631 Bear Run Lane
> Lewis Center, OH  43035
> USA
> www.nikonmetrology.com
>  
>  
>
> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
> To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/f887a652f08a465e92147583add54c85%40NKEU-EX-01.nikonoa.net.
> For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/F6E9E77F-0860-434D-A4BF-701BAE3E67D3%40beckweb.net.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

RE: Stuck jobs

john.peterson
Thanks.  At least something we can do to get a bit more detail on what may be going on.

John E. Peterson
ASW Quality Program Manager
[hidden email]
Tel: +1 (810) 220-4360
Fax: +1 (810) 220-4300
Nikon Metrology, Inc.
631 Bear Run Lane
Lewis Center, OH  43035
USA
www.nikonmetrology.com



-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Daniel Beck
Sent: Wednesday, March 07, 2018 8:58 AM
To: [hidden email]
Subject: Re: Stuck jobs

Output of https://wiki.jenkins-ci.org/display/JENKINS/Obtaining+a+thread+dump might be useful when this occurs, to see what's going on.

> On 7. Mar 2018, at 14:52, <[hidden email]> <[hidden email]> wrote:
>
> We semi-regularly get jobs that get stuck after the following:
>  
> [URLTrigger] A change within the response URL invocation (log)
> [US-VM01_Win7x64] Starting limited count build: 1 of 1 Building
> remotely on US-VM01_Win7x64 (Win7x64_Clean) in workspace
> c:\jenkins\workspace\CMM-M Main (x64) - Win7 - Inst <image001.gif>
>  
> The VM launches and connects.  But the job itself never starts (the first “missing” line here is the beginning of “We will get a clean checkout from SVN”).  If I log into the machine, I can get to SVN, so it’s not like there are inaccessible resources?
>  
> It can happen on any VM instance.  It can happen on any one of our many products.  It can happen with any version of Jenkins in the last 3 years.  It can happen with any of our 100’s of system test variations.  There seems to be no rhyme or reason.  It just occasionally – hangs.
>  
> <image002.jpg>
> John E. Peterson
> ASW Quality Program Manager
> [hidden email]
> Tel: +1 (810) 220-4360
> Fax: +1 (810) 220-4300
> Nikon Metrology, Inc.
> 631 Bear Run Lane
> Lewis Center, OH  43035
> USA
> www.nikonmetrology.com
>  
>  
>
> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
> To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/f887a652f08a465e92147583add54c85%40NKEU-EX-01.nikonoa.net.
> For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/F6E9E77F-0860-434D-A4BF-701BAE3E67D3%40beckweb.net.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/a4c8f950fe0c4909a6633f7b41388c75%40NKEU-EX-01.nikonoa.net.
For more options, visit https://groups.google.com/d/optout.