Agent fails - windows agent service is restarting - SIGINT to 3460 failed - Killing as fallback

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Agent fails - windows agent service is restarting - SIGINT to 3460 failed - Killing as fallback

zakyn-2
Hello,

I would like to ask you for a help.

We have a problem, that windows service of all agents/nodes are crashing and reconneting again. The longest time is 12 hours sometimes less.
In the windows event log there is - SIGINT to 3460 failed - Killing as fallback - message.

I tried all the things I found on google but still without any success.
I tried run agents just from cmd and the behavior is the same.

Could you please help me?

Thank you.

Vladimir



jenkins-slave-err.log

Jan 08, 2020 2:03:46 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Terminated
Jan 08, 2020 2:03:56 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Performing onReconnect operation.
Jan 08, 2020 2:03:56 PM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$FindEffectiveRestarters$1 onReconnect
INFO: Restarting agent via jenkins.slaves.restarter.WinswSlaveRestarter@27f599
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main createEngine
INFO: Setting up agent: MYAGENT
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main$CuiListener <init>
INFO: Jenkins agent is running in headless mode.
Jan 08, 2020 2:03:58 PM hudson.remoting.Engine startEngine
INFO: Using Remoting version: 3.36
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager initializeWorkDir
INFO: Using c:\_js\remoting as a remoting work directory
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager setupLogging
INFO: Both error and output logs will be printed to c:\_js\remoting
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Locating server among [http://MYADDRESS/]
Jan 08, 2020 2:03:59 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve
INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Agent discovery successful
  Agent address: MYADDRESS
  Agent port:    49187
  Identity:      3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Handshaking
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connecting to MYADDRESS:49187
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Trying protocol: JNLP4-connect
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Remote identity confirmed: 3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:04:00 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connected

wrapper.log
2020-01-08 10:08:38,702 INFO  - Stopping jenkinsslave-c___js
2020-01-08 10:08:38,703 DEBUG - ProcessKill 2512
2020-01-08 10:08:38,825 INFO  - Found child process: 7408 Name: conhost.exe
2020-01-08 10:08:38,908 INFO  - Stopping process 7408
2020-01-08 10:08:38,911 INFO  - Send SIGINT 7408
2020-01-08 10:08:38,912 WARN  - SIGINT to 7408 failed - Killing as fallback
2020-01-08 10:08:38,914 INFO  - Stopping process 2512
2020-01-08 10:08:38,918 INFO  - Send SIGINT 2512
2020-01-08 10:08:38,919 WARN  - SIGINT to 2512 failed - Killing as fallback
2020-01-08 10:08:38,921 INFO  - Finished jenkinsslave-c___js
2020-01-08 10:08:38,923 DEBUG - Completed. Exit code is 0
2020-01-08 10:08:42,687 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 10:08:42,709 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl http://MYAGENT/slave-agent.jnlp -secret 75ef2485eebc894178cbfa9cecd0501cfffb49d4fcb6a240e6
2020-01-08 10:08:42,716 INFO  - Extension loaded: killOnStartup
2020-01-08 10:08:42,720 DEBUG - Checking the potentially runaway process with PID=2512
2020-01-08 10:08:42,727 DEBUG - No runaway process with PID=2512. The process has been already stopped.
2020-01-08 10:08:42,754 INFO  - Started process 2724
2020-01-08 10:08:42,758 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 10:08:42,761 INFO  - Recording PID of the started process:2724. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 10:08:47,081 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 10:08:47,312 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 10:08:47,317 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,264 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,457 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,464 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,556 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,760 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,787 INFO  - Stopping jenkinsslave-c___js
2020-01-08 14:03:56,787 DEBUG - ProcessKill 2724
2020-01-08 14:03:56,908 INFO  - Found child process: 3460 Name: conhost.exe
2020-01-08 14:03:56,987 INFO  - Stopping process 3460
2020-01-08 14:03:56,991 INFO  - Send SIGINT 3460
2020-01-08 14:03:56,994 WARN  - SIGINT to 3460 failed - Killing as fallback
2020-01-08 14:03:56,998 INFO  - Stopping process 2724
2020-01-08 14:03:57,004 INFO  - Send SIGINT 2724
2020-01-08 14:03:57,004 WARN  - SIGINT to 2724 failed - Killing as fallback
2020-01-08 14:03:57,006 INFO  - Finished jenkinsslave-c___js
2020-01-08 14:03:57,007 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,042 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 14:03:58,056 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,063 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl http://MYAGENT/slave-agent.jnlp -secret 75ef24bf56b0070cecd0501cfffb49d4fcb6a240e6
2020-01-08 14:03:58,072 INFO  - Extension loaded: killOnStartup
2020-01-08 14:03:58,080 DEBUG - Checking the potentially runaway process with PID=2724
2020-01-08 14:03:58,087 DEBUG - No runaway process with PID=2724. The process has been already stopped.
2020-01-08 14:03:58,106 INFO  - Started process 5188
2020-01-08 14:03:58,109 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 14:03:58,112 INFO  - Recording PID of the started process:5188. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 14:04:01,930 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:04:02,128 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 14:04:02,133 DEBUG - Completed. Exit code is 0

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/19d3dd66-8f7d-4409-bde6-7d086955e67b%40googlegroups.com.
Reply | Threaded
Open this post in threaded view
|

Re: Agent fails - windows agent service is restarting - SIGINT to 3460 failed - Killing as fallback

zakyn-2
Hello,

the problem is still there. This is a combination for problems from event log.

Any ideas please?

Thank you.

jenkins-slave-errors.png



Dne středa 8. ledna 2020 14:32:23 UTC+1 zakyn napsal(a):
Hello,

I would like to ask you for a help.

We have a problem, that windows service of all agents/nodes are crashing and reconneting again. The longest time is 12 hours sometimes less.
In the windows event log there is - SIGINT to 3460 failed - Killing as fallback - message.

I tried all the things I found on google but still without any success.
I tried run agents just from cmd and the behavior is the same.

Could you please help me?

Thank you.

Vladimir



jenkins-slave-err.log

Jan 08, 2020 2:03:46 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Terminated
Jan 08, 2020 2:03:56 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Performing onReconnect operation.
Jan 08, 2020 2:03:56 PM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$FindEffectiveRestarters$1 onReconnect
INFO: Restarting agent via jenkins.slaves.restarter.WinswSlaveRestarter@27f599
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main createEngine
INFO: Setting up agent: MYAGENT
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main$CuiListener <init>
INFO: Jenkins agent is running in headless mode.
Jan 08, 2020 2:03:58 PM hudson.remoting.Engine startEngine
INFO: Using Remoting version: 3.36
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager initializeWorkDir
INFO: Using c:\_js\remoting as a remoting work directory
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager setupLogging
INFO: Both error and output logs will be printed to c:\_js\remoting
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Locating server among [<a href="http://MYADDRESS/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYADDRESS%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzvwOVBUVDrsyyNKoryOMRpI_b4g&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYADDRESS%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHzvwOVBUVDrsyyNKoryOMRpI_b4g&#39;;return true;">http://MYADDRESS/]
Jan 08, 2020 2:03:59 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve
INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Agent discovery successful
  Agent address: MYADDRESS
  Agent port:    49187
  Identity:      3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Handshaking
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connecting to MYADDRESS:49187
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Trying protocol: JNLP4-connect
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Remote identity confirmed: 3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:04:00 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connected

wrapper.log
2020-01-08 10:08:38,702 INFO  - Stopping jenkinsslave-c___js
2020-01-08 10:08:38,703 DEBUG - ProcessKill 2512
2020-01-08 10:08:38,825 INFO  - Found child process: 7408 Name: conhost.exe
2020-01-08 10:08:38,908 INFO  - Stopping process 7408
2020-01-08 10:08:38,911 INFO  - Send SIGINT 7408
2020-01-08 10:08:38,912 WARN  - SIGINT to 7408 failed - Killing as fallback
2020-01-08 10:08:38,914 INFO  - Stopping process 2512
2020-01-08 10:08:38,918 INFO  - Send SIGINT 2512
2020-01-08 10:08:38,919 WARN  - SIGINT to 2512 failed - Killing as fallback
2020-01-08 10:08:38,921 INFO  - Finished jenkinsslave-c___js
2020-01-08 10:08:38,923 DEBUG - Completed. Exit code is 0
2020-01-08 10:08:42,687 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 10:08:42,709 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl <a href="http://MYAGENT/slave-agent.jnlp" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYAGENT%2Fslave-agent.jnlp\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFkfaxZkeZUqvzPwyQ4IMSrBk6SuQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYAGENT%2Fslave-agent.jnlp\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFkfaxZkeZUqvzPwyQ4IMSrBk6SuQ&#39;;return true;">http://MYAGENT/slave-agent.jnlp -secret 75ef2485eebc894178cbfa9cecd0501cfffb49d4fcb6a240e6
2020-01-08 10:08:42,716 INFO  - Extension loaded: killOnStartup
2020-01-08 10:08:42,720 DEBUG - Checking the potentially runaway process with PID=2512
2020-01-08 10:08:42,727 DEBUG - No runaway process with PID=2512. The process has been already stopped.
2020-01-08 10:08:42,754 INFO  - Started process 2724
2020-01-08 10:08:42,758 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 10:08:42,761 INFO  - Recording PID of the started process:2724. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 10:08:47,081 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 10:08:47,312 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 10:08:47,317 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,264 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,457 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,464 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,556 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,760 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,787 INFO  - Stopping jenkinsslave-c___js
2020-01-08 14:03:56,787 DEBUG - ProcessKill 2724
2020-01-08 14:03:56,908 INFO  - Found child process: 3460 Name: conhost.exe
2020-01-08 14:03:56,987 INFO  - Stopping process 3460
2020-01-08 14:03:56,991 INFO  - Send SIGINT 3460
2020-01-08 14:03:56,994 WARN  - SIGINT to 3460 failed - Killing as fallback
2020-01-08 14:03:56,998 INFO  - Stopping process 2724
2020-01-08 14:03:57,004 INFO  - Send SIGINT 2724
2020-01-08 14:03:57,004 WARN  - SIGINT to 2724 failed - Killing as fallback
2020-01-08 14:03:57,006 INFO  - Finished jenkinsslave-c___js
2020-01-08 14:03:57,007 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,042 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 14:03:58,056 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,063 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl <a href="http://MYAGENT/slave-agent.jnlp" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYAGENT%2Fslave-agent.jnlp\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFkfaxZkeZUqvzPwyQ4IMSrBk6SuQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2FMYAGENT%2Fslave-agent.jnlp\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFkfaxZkeZUqvzPwyQ4IMSrBk6SuQ&#39;;return true;">http://MYAGENT/slave-agent.jnlp -secret 75ef24bf56b0070cecd0501cfffb49d4fcb6a240e6
2020-01-08 14:03:58,072 INFO  - Extension loaded: killOnStartup
2020-01-08 14:03:58,080 DEBUG - Checking the potentially runaway process with PID=2724
2020-01-08 14:03:58,087 DEBUG - No runaway process with PID=2724. The process has been already stopped.
2020-01-08 14:03:58,106 INFO  - Started process 5188
2020-01-08 14:03:58,109 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 14:03:58,112 INFO  - Recording PID of the started process:5188. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 14:04:01,930 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:04:02,128 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 14:04:02,133 DEBUG - Completed. Exit code is 0

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/22a3e55a-23d0-481e-b22d-d2ab15d96edb%40googlegroups.com.