Hudson too slow to start

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Hudson too slow to start

Jean-Baptiste Quenot
Hi there,

We discussed once about parallel loading of jobs so that Hudson is
nice  and  starts progressively  loading  the  projects.  This  is
particularly important as webapp  initialization is blocking other
webapps in the same container.

In my  setup where we have  more than hundred projects  with large
history, the startup time takes about 12 minutes:

Aug 23, 2007 11:47:37 AM hudson.model.Hudson load
INFO: Took 699424 ms to load
2007-08-23 11:47:38.006::INFO:  Started SelectChannelConnector @ 127.0.0.1:8888

Notice that none  of the webapps served by Jetty  here will not be
available until Hudson  has done its job.  As I  couldn't make the
[1]suggested patch work (see attached), I'm asking for help.

Thanks in advance,
--
     Jean-Baptiste Quenot
aka  John Banana   Qwerty
http://caraldi.com/jbq/

[1] http://www.nabble.com/Projects-give-404-status-when-reloading-configuration-files-tf4142764.html

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

20070820-hudson-parallel-loading.txt (6K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Hudson too slow to start

Kohsuke Kawaguchi
Administrator

I resurrected the parallel loading code and made it so that it can be
activated by setting the system property
'hudson.model.Hudeon.parallelLoad' to true.

Now I'd have to try it on a bigger system and see what errors this will
introduce --- on a small system it seems to work just fine (or maybe
it's just because my laptop is not a real multi-CPU system unlike my
production site.)

When you say you couldn't make it work, did you get any errors?

Also, I believe the reason why this is a big issue for you is that you
are running "reload from disk" operation every hour or so. As I
suggested earlier, for your case, HTTP POSTing config.xml would probably
work better.

Jean-Baptiste Quenot wrote:

> Hi there,
>
> We discussed once about parallel loading of jobs so that Hudson is
> nice  and  starts progressively  loading  the  projects.  This  is
> particularly important as webapp  initialization is blocking other
> webapps in the same container.
>
> In my  setup where we have  more than hundred projects  with large
> history, the startup time takes about 12 minutes:
>
> Aug 23, 2007 11:47:37 AM hudson.model.Hudson load
> INFO: Took 699424 ms to load
> 2007-08-23 11:47:38.006::INFO:  Started SelectChannelConnector @ 127.0.0.1:8888
>
> Notice that none  of the webapps served by Jetty  here will not be
> available until Hudson  has done its job.  As I  couldn't make the
> [1]suggested patch work (see attached), I'm asking for help.


--
Kohsuke Kawaguchi
Sun Microsystems                   [hidden email]

smime.p7s (4K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Hudson too slow to start

Kohsuke Kawaguchi
Administrator
In reply to this post by Jean-Baptiste Quenot

Oh, and separate issue #756 might fix for the Jetty hang up problem.
Does that happen with reloading, too?

Jean-Baptiste Quenot wrote:

> Hi there,
>
> We discussed once about parallel loading of jobs so that Hudson is
> nice  and  starts progressively  loading  the  projects.  This  is
> particularly important as webapp  initialization is blocking other
> webapps in the same container.
>
> In my  setup where we have  more than hundred projects  with large
> history, the startup time takes about 12 minutes:
>
> Aug 23, 2007 11:47:37 AM hudson.model.Hudson load
> INFO: Took 699424 ms to load
> 2007-08-23 11:47:38.006::INFO:  Started SelectChannelConnector @ 127.0.0.1:8888
>
> Notice that none  of the webapps served by Jetty  here will not be
> available until Hudson  has done its job.  As I  couldn't make the
> [1]suggested patch work (see attached), I'm asking for help.
>
> Thanks in advance,
>
>
> ------------------------------------------------------------------------
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]

--
Kohsuke Kawaguchi
Sun Microsystems                   [hidden email]

smime.p7s (4K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Hudson too slow to start

Jean-Baptiste Quenot
* Kohsuke Kawaguchi:

> Oh, and  separate issue  #756 might  fix for  the Jetty  hang up
> problem. Does that happen with reloading, too?

Yes #756  might help, but  that is  not related to  the reloading.
Upon reloading, the home page does  not respond, and all job pages
return 404.
--
     Jean-Baptiste Quenot
aka  John Banana   Qwerty
http://caraldi.com/jbq/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Hudson too slow to start

Jean-Baptiste Quenot
In reply to this post by Kohsuke Kawaguchi
* Kohsuke Kawaguchi:

> When you say you couldn't make it work, did you get any errors?

No I didn't  get errors, but startup still took  12 minutes.  I'll
have to test again with a fresh copy and the aforementioned system
property set.

Thanks for your help,
--
     Jean-Baptiste Quenot
aka  John Banana   Qwerty
http://caraldi.com/jbq/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]