Running three jobs at the same time

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Running three jobs at the same time

sravan
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

Jan Monterrubio
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CADgiF9%2BqpW0nvQpvjnwtgrHqoGgPY-Wk9koWA2yOJpzo-E%2BZyA%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

sravan

yes as two executors on the same machine
On Friday, August 14, 2020 at 1:16:42 PM UTC-7 [hidden email] wrote:
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/4f87c5f1-e35e-4e08-982d-22a0f696de07n%40googlegroups.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

Jan Monterrubio
Would increase the executors to 3 not do the trick? I might be misunderstanding the problem. 

On Fri, Aug 14, 2020 at 16:54 sravan <[hidden email]> wrote:

yes as two executors on the same machine
On Friday, August 14, 2020 at 1:16:42 PM UTC-7 [hidden email] wrote:
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan








--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/4f87c5f1-e35e-4e08-982d-22a0f696de07n%40googlegroups.com.


--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CADgiF9JMcygHO_QAqadDaEPQNwg5YE5erTJ2a9s4VCO4kuOoVg%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

sravan
My problem is I want to run 3 jobs at the same time. currently jenkins allow you to run 2 only 

On Friday, August 14, 2020 at 3:54:20 PM UTC-7 [hidden email] wrote:
Would increase the executors to 3 not do the trick? I might be misunderstanding the problem. 

On Fri, Aug 14, 2020 at 16:54 sravan <[hidden email]> wrote:

yes as two executors on the same machine
On Friday, August 14, 2020 at 1:16:42 PM UTC-7 [hidden email] wrote:
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan








--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/848f7add-a3e0-4bee-b825-b694301b1b78n%40googlegroups.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

Jan Monterrubio
That sounds like a configuration problem to me, as have some agents that have 6cpus and 6 executors and some that have 3 executors. I think we can run about 40 jobs in parallel with our setup. 

On Fri, Aug 14, 2020 at 19:28 sravan <[hidden email]> wrote:
My problem is I want to run 3 jobs at the same time. currently jenkins allow you to run 2 only 

On Friday, August 14, 2020 at 3:54:20 PM UTC-7 [hidden email] wrote:
Would increase the executors to 3 not do the trick? I might be misunderstanding the problem. 

On Fri, Aug 14, 2020 at 16:54 sravan <[hidden email]> wrote:

yes as two executors on the same machine
On Friday, August 14, 2020 at 1:16:42 PM UTC-7 [hidden email] wrote:
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan








--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/848f7add-a3e0-4bee-b825-b694301b1b78n%40googlegroups.com.


--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CADgiF9KLTafiPJc%3DyVwOtyM0esmD1GPwiFZrrPrH5Bg7GWnVdQ%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: Running three jobs at the same time

Baptiste MATHUS
However tempting, I would recommend not using ever more than 1-executor agents.
Especially for heavy tasks related to development.

In $previousJob we've burned hours of engineering time to understand what was causing random failures when the wrong jobs would run together at the wrong time.

TL;DR it's mostly a matter of machine load, and it's exponentially easier to have more agents, isolated with a resource limitation layer like docker if you run them on the same host.
And if you're using the cloud, just set up two smaller VMs or so instead of a single big one.


Cheers

Le sam. 15 août 2020 à 03:05, Jan Monterrubio <[hidden email]> a écrit :
That sounds like a configuration problem to me, as have some agents that have 6cpus and 6 executors and some that have 3 executors. I think we can run about 40 jobs in parallel with our setup. 

On Fri, Aug 14, 2020 at 19:28 sravan <[hidden email]> wrote:
My problem is I want to run 3 jobs at the same time. currently jenkins allow you to run 2 only 

On Friday, August 14, 2020 at 3:54:20 PM UTC-7 [hidden email] wrote:
Would increase the executors to 3 not do the trick? I might be misunderstanding the problem. 

On Fri, Aug 14, 2020 at 16:54 sravan <[hidden email]> wrote:

yes as two executors on the same machine
On Friday, August 14, 2020 at 1:16:42 PM UTC-7 [hidden email] wrote:
How are you running two jobs? is that 2 executors on the same machine? 

On Fri, Aug 14, 2020 at 3:11 PM sravan <[hidden email]> wrote:
Hi All,
I know jenkins allow to run two jobs/ threads at the same time. Is there  way I can increase it to run three jobs at the same time?

I am trying to investigate this and could not find any solution on this. Any help is appreciated .


Thanks,
Sravan








--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/71974307-191b-42a0-8db0-2409c9adce83n%40googlegroups.com.












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].












--


You received this message because you are subscribed to the Google Groups "Jenkins Users" group.


To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].


To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/848f7add-a3e0-4bee-b825-b694301b1b78n%40googlegroups.com.


--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CADgiF9KLTafiPJc%3DyVwOtyM0esmD1GPwiFZrrPrH5Bg7GWnVdQ%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CANWgJS6Pi5zTRBiLqmyxLaCNJrVw%3D9OoohoOc7LMOvmntE%2BUpQ%40mail.gmail.com.