Jenkins pipeline implementing a queue to execute parallel build jobs depending on AWS resource availability

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Jenkins pipeline implementing a queue to execute parallel build jobs depending on AWS resource availability

asmaj
I want to implement a pipeline in which I want to execute jobs parallel inside a stage block using a loop. The execution of the job depends on the availability of AWS resources and therefore while all resources are utilized, the next set of jobs should be added to a queue and then when the resources are released by the currently running jobs, jobs should be dispatched one by one from the queue until the queue is empty.

Is there a way to check the resource availability and dispatch a job from the queue after each triggered job has completed? Can waitUntil be used for this and if so how?

Thanks in advance.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/cf7d3ba7-d839-45aa-960d-165c3136744c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.