[Issue 1646] New - Hudson hangup and poll never on CVS

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

[Issue 1646] New - Hudson hangup and poll never on CVS

tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646
                 Issue #|1646
                 Summary|Hudson hangup and poll never on CVS
               Component|hudson
                 Version|current
                Platform|Other
              OS/Version|Linux
                     URL|
                  Status|NEW
       Status whiteboard|
                Keywords|
              Resolution|
              Issue type|DEFECT
                Priority|P1
            Subcomponent|other
             Assigned to|issues@hudson
             Reported by|tspengler






------- Additional comments from [hidden email] Tue May  6 06:48:12 +0000 2008 -------
Our environment is:
We have a limited threadCound for SCMPolling (8)
We have a system with remoteclients

if one client has problems, all scm threads are hanging on this client and no
more cvs actions are possible
it seams that there is no timeout implemented
if the node (with the problems) is killed you get following

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
SEVERE: Failed to record SCM polling
hudson.remoting.RequestAbortedException: java.io.EOFException
        at hudson.remoting.Request.abort(Request.java:187)
        at hudson.remoting.Channel.terminate(Channel.java:437)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
Caused by: java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

May 6, 2008 8:39:22 AM hudson.remoting.Channel$ReaderThread run
SEVERE: I/O error in channel compiler ci-dev@george
java.io.EOFException
        at
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
        at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Tue May  6 06:48:54 +0000 2008 -------
Created an attachment (id=242)
ThreadDump from the master


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

tspengler-2
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646



User tspengler changed the following:

                What    |Old value                 |New value
================================================================================
            Subcomponent|other                     |cvs
--------------------------------------------------------------------------------




------- Additional comments from [hidden email] Fri May 16 09:34:54 +0000 2008 -------
corrected the component

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

Kohsuke Kawaguchi
Administrator
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646



User kohsuke changed the following:

                What    |Old value                 |New value
================================================================================
                  Status|NEW                       |STARTED
--------------------------------------------------------------------------------




------- Additional comments from [hidden email] Thu Jul 10 05:28:47 +0000 2008 -------
Thanks for the thread dump.

I'm trying to understand your bug report. When you say "if one client has
problems", are you talking about one CVS client having a problem? Or are you
talking about one slave having a problem? Can you elaborate on what you mean by
"a problem"?

Is the hang in CVS process itself?

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

tspengler-2
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Thu Jul 10 07:06:39 +0000 2008 -------
the cvs client hangs
and of course it is not reproducible


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

Kohsuke Kawaguchi
Administrator
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Sat Jan 10 21:56:07 +0000 2009 -------
The thread stack trace indicates that all the polling is happening remotely, and
waiting for its completion.

"pool-6-thread-8" prio=1 tid=0x0e042ef0 nid=0x2f8 in Object.wait()
[0x142ec000..0x142ed140]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:474)
        at hudson.remoting.Request.call(Request.java:88)
        - locked <0x37d133f0> (a hudson.remoting.UserRequest)
        at hudson.remoting.Channel.call(Channel.java:390)
        at hudson.FilePath.act(FilePath.java:305)
        at hudson.FilePath.exists(FilePath.java:506)
        at hudson.model.AbstractProject.pollSCMChanges(AbstractProject.java:595)
        at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:259)
        at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:291)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)
        at java.util.concurrent.FutureTask.run(FutureTask.java:123)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
        at java.lang.Thread.run(Thread.java:595)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

scm_issue_link
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Sun Jan 11 01:38:56 +0000 2009 -------
Code changed in hudson
User: : kohsuke
Path:
 trunk/hudson/main/core/src/main/java/hudson/scm/SubversionSCM.java
 trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java
 trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.jelly
 trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties
http://fisheye4.cenqua.com/changelog/hudson/?cs=14354
Log:
[HUDSON-1646] In 1.273, Added http://server/hudson/descriptor/hudson.triggers.SCMTrigger/ to show the summary of SCM polling activities and how long it's taking, to assist the trouble-shooting of this issue.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

scm_issue_link
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Sun Jan 11 02:16:31 +0000 2009 -------
Code changed in hudson
User: : kohsuke
Path:
 trunk/hudson/main/core/src/main/java/hudson/model/AdministrativeMonitor.java
 trunk/hudson/main/core/src/main/java/hudson/model/Hudson.java
 trunk/www/changelog.html
http://fisheye4.cenqua.com/changelog/hudson/?cs=14356
Log:
[HUDSON-1646] Formalized an extension point to monitor the system for self diagnosis.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

scm_issue_link
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646






------- Additional comments from [hidden email] Sun Jan 11 02:17:43 +0000 2009 -------
Code changed in hudson
User: : kohsuke
Path:
 trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java
 trunk/hudson/main/core/src/main/resources/hudson/model/Hudson/manage.jelly
 trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.jelly
 trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.properties
 trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties
 trunk/www/changelog.html
http://fisheye4.cenqua.com/changelog/hudson/?cs=14357
Log:
[HUDSON-1646] Formalized an extension point to monitor the system for self diagnosis.


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[Issue 1646] Hudson hangup and poll never on CVS

Kohsuke Kawaguchi
Administrator
In reply to this post by tspengler-2
https://hudson.dev.java.net/issues/show_bug.cgi?id=1646



User kohsuke changed the following:

                What    |Old value                 |New value
================================================================================
                Priority|P1                        |P3
--------------------------------------------------------------------------------




------- Additional comments from [hidden email] Thu Jul  9 20:49:43 +0000 2009 -------
I need to refresh my memory on the additional status monitoring my changes have
added.

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]