[GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
Hello
I am Sahil Khan, I am pursuing my 3rd year engineering from Lakshmi Narain College of Technology and Science Bhopal.I am really passionate about Linux.I have been a keen evangelist for Dockers. I have been using and playing around with Dockers for 2 years and also taken various sessions in my Local City(https://www.null.co.in/profile/5878-sahil-khan).I have also worked on some Docker-based project one of them is Documented on my Blog which can be seen here.( http://sahilkhan.me/Dockers-Virtual-Hosting/ ).
I have also contributed and worked on some Open Source Projects on Github (https://github.com/docker-scripts/privoxy).
I am interested to work on the project "Improvements to the Jenkins Acceptance Test Harness".
The reason I am Interested in that project is that I contribute to Open Source projects and once I was contributing to OWASP ZAP Proxy where I wanted that the Jenkins plugin to be able to use the ZAP docker images.So this built up my interest in Jenkins and Docker Integrations.
Looking forward to your response.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/ca46178c-f7e9-4831-a800-03d411baac71%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Martin d'Anjou
Hello Sahil,

Thanks for your interest in this Jenkins GSoC project.

The best way to get acquainted with the Jenkins ATH is to actually try it out by yourself. There are instructions to run it inside a docker container. The ATH is used mostly for integration tests of plugins. If you look under https://github.com/jenkinsci/acceptance-test-harness/blob/master/src/test/java/plugins/, you will see tests for many plugins. For example, the External Workspace Manager plugin tests are here. The tests are written as a jenkins pipeline script. This is really powerful because using this model, users can write tests for their pipeline build scripts and test them using the ATH. Pipeline library code can be tested the same way.

The ATH is one of the better ways to test user build script and user pipeline libraries, because it runs in a live in-memory Jenkins instance. Users can select the jenkins core version and the plugin versions. But it can be slow to run. Another drawback is that tests will download plugins from the update center, which can fail sometimes when the update center is busy or not available. The good thing is that it is actively maintained and has lot of documentation.

To get started, I suggest you try to run the tests of a plugin that you know. You could also use the ATH to test your own build script or your own pipeline library. Then you can start thinking on how the ATH performance or usability could be improved, and you can create a project proposal based your observations.

Best Regards,
Martin d'Anjou


On Monday, March 12, 2018 at 4:25:14 PM UTC-4, Sahil Khan wrote:
Hello
I am Sahil Khan, I am pursuing my 3rd year engineering from Lakshmi Narain College of Technology and Science Bhopal.I am really passionate about Linux.I have been a keen evangelist for Dockers. I have been using and playing around with Dockers for 2 years and also taken various sessions in my Local City(<a href="https://www.null.co.in/profile/5878-sahil-khan" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.null.co.in%2Fprofile%2F5878-sahil-khan\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEs8nTDFlm0HLm3GdLeQ5mIPX7SiQ&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.null.co.in%2Fprofile%2F5878-sahil-khan\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEs8nTDFlm0HLm3GdLeQ5mIPX7SiQ&#39;;return true;">https://www.null.co.in/profile/5878-sahil-khan).I have also worked on some Docker-based project one of them is Documented on my Blog which can be seen here.( <a href="http://sahilkhan.me/Dockers-Virtual-Hosting/" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fsahilkhan.me%2FDockers-Virtual-Hosting%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHJ2LndgYF8zIukaSi5_YcMuDJ9gg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fsahilkhan.me%2FDockers-Virtual-Hosting%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHJ2LndgYF8zIukaSi5_YcMuDJ9gg&#39;;return true;">http://sahilkhan.me/Dockers-Virtual-Hosting/ ).
I have also contributed and worked on some Open Source Projects on Github (<a href="https://github.com/docker-scripts/privoxy" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fdocker-scripts%2Fprivoxy\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHEg0NkU9TUSVyyLbF_JDlyt0QuiQ&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fdocker-scripts%2Fprivoxy\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHEg0NkU9TUSVyyLbF_JDlyt0QuiQ&#39;;return true;">https://github.com/docker-scripts/privoxy).
I am interested to work on the project "Improvements to the Jenkins Acceptance Test Harness".
The reason I am Interested in that project is that I contribute to Open Source projects and once I was contributing to OWASP ZAP Proxy where I wanted that the Jenkins plugin to be able to use the ZAP docker images.So this built up my interest in Jenkins and Docker Integrations.
Looking forward to your response.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/bc14be3b-d61c-4d4a-aaf4-86badbea8945%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Martin d'Anjou
Sahil,

I forgot to say that we invite all students to participate in office hours where you can meet mentors and ask questions. The office hours schedule is on the main Jenkins GSoC 2018 page.
Unfortunately I cannot participate in the office hours this week, but I will be there next week. Steven Christou is the other mentor for this project.

Martin

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/f7bcd5c1-9523-46a6-94aa-ef7516e2ca33%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan

Sure..
I will test and make a report accordingly.I saw the GitHub repository so why don't we use Docker in swarm mode or kubernates.Docker swarm mode can really make it faster but I need to do some test in that.
On Tuesday, March 13, 2018 at 1:55:14 AM UTC+5:30, Sahil Khan wrote:
Hello
I am Sahil Khan, I am pursuing my 3rd year engineering from Lakshmi Narain College of Technology and Science Bhopal.I am really passionate about Linux.I have been a keen evangelist for Dockers. I have been using and playing around with Dockers for 2 years and also taken various sessions in my Local City(https://www.null.co.in/profile/5878-sahil-khan).I have also worked on some Docker-based project one of them is Documented on my Blog which can be seen here.( http://sahilkhan.me/Dockers-Virtual-Hosting/ ).
I have also contributed and worked on some Open Source Projects on Github (https://github.com/docker-scripts/privoxy).
I am interested to work on the project "Improvements to the Jenkins Acceptance Test Harness".
The reason I am Interested in that project is that I contribute to Open Source projects and once I was contributing to OWASP ZAP Proxy where I wanted that the Jenkins plugin to be able to use the ZAP docker images.So this built up my interest in Jenkins and Docker Integrations.
Looking forward to your response.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/faa3303c-2b6d-4a36-ad88-c34fe450e96d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan
Sure..
I will test and make a report accordingly.I saw the GitHub repository so why don't we use Docker in swarm mode or kubernates.Docker swarm mode can really make it faster but I need to do some test in that.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/28c0c87a-fdf6-4737-90d1-129a72e3f271%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Oleg Nenashev
Yes, it is something doable.

Actually Jenkins Test Harness and Acceptance Test Harness already include some Docker integrations even now, and it would be great to expand them. We also had discussions about introducing testcontainers within Jenkins test frameworks, and it's also a good opportunity for increasing Docker adoption.

Swarm/K8s would be also fine. We have use-cases for such kinds of testing in plugins, and any proposals on this front will be appreciated.

Best regards,
Oleg


On Tuesday, March 13, 2018 at 6:30:03 PM UTC+1, Sahil Khan wrote:
Sure..
I will test and make a report accordingly.I saw the GitHub repository so why don't we use Docker in swarm mode or kubernates.Docker swarm mode can really make it faster but I need to do some test in that.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/29c33a37-a9bb-4665-bf69-77888023744a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan
Hello,
Apologies for the late response. I was refreshing my Jenkins knowledge and trying to test ATH as much as I can.
So I did some tests some screenshots of me using ATH inside Docker container are shown here.
I also watched the youtube video by Kohsuke also GitHub is pretty well Documented and that's really appreciable.
Reports:
  1. I ran the first test BROWSER=firefox JENKINS_VERSION=2.73 mvn test.So this test ran for more than 10 hours in my system(Was not even completed due to power loss).
  2. I ran the test for the Single plugin which used to run for an average time of about 20-30mins(May vary depending on Plugin).
  3. I also tried to write the test for own Pipeline Build thanks to Kohsuke Video still I'm not that much good with that.
Observations:
  1. I saw all the test and their details can be seen in logs file of jenkins/blueocean container.So I can understand how Docker sockets are doing their work.
  2. ATH test Suite working inside Docker is really Slow :(

I was confused with proposing of which container technology whether Docker swarm,Kubernates or Testcontainer would be best.It's really difficult for me to figure this out at this stage as I need a lot more time for testing all of them and implementing them with Test Suite(But GSoC Submission Deadline is Approaching).Also If this is successful I can also implement the same with Test-Harness also and I would like to work on it too.If I can figure this out then Impretty sure can easily complete the work within SoC Final weeks.

I am looking forward to your response


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/7fd000f2-d22f-4870-a9b1-56175acc435c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Oleg Nenashev
Hi Sahil,

Yes, the ATH test suite is not designed to be executed on a single local machine.
We run it on CI instances. But yes, there is an interest to speedup and parallelize the tests.

I was confused with proposing of which container technology whether Docker swarm,Kubernates or Testcontainer would be best.

We have a community bonding period, and in your proposal you could schedule selecting the engine to this phase. But it would be still useful to understand what is your plan for this project. Many deliverables do not really depend on the underlying implementation, so IMHO it would be preferable to create a proposal draft and reflect the main objectives/deliverables, at least on the top level.

Best regards,
Oleg


On Tuesday, March 20, 2018 at 7:21:59 PM UTC+1, Sahil Khan wrote:
Hello,
Apologies for the late response. I was refreshing my Jenkins knowledge and trying to test ATH as much as I can.
So I did some tests some screenshots of me using ATH inside Docker container are shown <a href="https://drive.google.com/drive/folders/103L4DUTqYwnWImal08fqhBkuOkRjfA7F?usp=sharing" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://drive.google.com/drive/folders/103L4DUTqYwnWImal08fqhBkuOkRjfA7F?usp\x3dsharing&#39;;return true;" onclick="this.href=&#39;https://drive.google.com/drive/folders/103L4DUTqYwnWImal08fqhBkuOkRjfA7F?usp\x3dsharing&#39;;return true;">here.
I also watched the youtube video by Kohsuke also GitHub is pretty well Documented and that's really appreciable.
Reports:
  1. I ran the first test BROWSER=firefox JENKINS_VERSION=2.73 mvn test.So this test ran for more than 10 hours in my system(Was not even completed due to power loss).
  2. I ran the test for the Single plugin which used to run for an average time of about 20-30mins(May vary depending on Plugin).
  3. I also tried to write the test for own Pipeline Build thanks to Kohsuke Video still I'm not that much good with that.
Observations:
  1. I saw all the test and their details can be seen in logs file of jenkins/blueocean container.So I can understand how Docker sockets are doing their work.
  2. ATH test Suite working inside Docker is really Slow :(

I was confused with proposing of which container technology whether Docker swarm,Kubernates or Testcontainer would be best.It's really difficult for me to figure this out at this stage as I need a lot more time for testing all of them and implementing them with Test Suite(But GSoC Submission Deadline is Approaching).Also If this is successful I can also implement the same with Test-Harness also and I would like to work on it too.If I can figure this out then Impretty sure can easily complete the work within SoC Final weeks.

I am looking forward to your response


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/8741e872-f10e-449f-8b2d-8d452abcccb5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan
Sure Olev
Will revert you back when completed with proposal.
Thanks for your response.


--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/cd5324c1-8d11-42ab-857c-c75f4089bc9d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan
Hey,
I have submitted my draft proposal on GSoC Platform and looking forward to your feedback to improve my Proposal.
 

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/2db535b0-f54d-4117-b9ba-cb993c4be688%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Martin d'Anjou
Hello Sahil,

Thanks for submitting your proposal.

Sorry for not sharing this sooner, but I just remembered about it: there was a discussion on speeding up the ATH in this group. You can find it here:
https://groups.google.com/forum/#!msg/jenkinsci-dev/R8w7uhh-xbg/PkvWgPeXBwAJ;context-place=forum/jenkinsci-dev

Best Regards,
Martin

On Friday, March 23, 2018 at 4:30:01 PM UTC-4, Sahil Khan wrote:
Hey,
I have submitted my draft proposal on GSoC Platform and looking forward to your feedback to improve my Proposal.
 

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/030748ce-f494-4889-85eb-a81da5e8dc2b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Oleg Nenashev
Added my comments in the proposal.
IMHO the weakest part in it is the technical design. It is not clear to me how you are going to achieve the declared goals.


On Sat, Mar 24, 2018 at 1:33 PM, martinda <[hidden email]> wrote:
Hello Sahil,

Thanks for submitting your proposal.

Sorry for not sharing this sooner, but I just remembered about it: there was a discussion on speeding up the ATH in this group. You can find it here:

Best Regards,
Martin

On Friday, March 23, 2018 at 4:30:01 PM UTC-4, Sahil Khan wrote:
Hey,
I have submitted my draft proposal on GSoC Platform and looking forward to your feedback to improve my Proposal.
 

--
You received this message because you are subscribed to a topic in the Google Groups "Jenkins Developers" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-dev/M8ZjJVCz2rA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/030748ce-f494-4889-85eb-a81da5e8dc2b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAPfivLBTQ-r2ykSS4HxCvkXrTMbQbf4TRLUk6Yozw46tU252fQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
I saw the comments and I will work on this to improve as much as possible.Thanks for your feedback and time.Will revert you back soon when I have improved that.

With Regards ,
Sahil Khan

On Sat, Mar 24, 2018 at 7:06 PM, Oleg Nenashev <[hidden email]> wrote:
Added my comments in the proposal.
IMHO the weakest part in it is the technical design. It is not clear to me how you are going to achieve the declared goals.


On Sat, Mar 24, 2018 at 1:33 PM, martinda <[hidden email]> wrote:
Hello Sahil,

Thanks for submitting your proposal.

Sorry for not sharing this sooner, but I just remembered about it: there was a discussion on speeding up the ATH in this group. You can find it here:

Best Regards,
Martin

On Friday, March 23, 2018 at 4:30:01 PM UTC-4, Sahil Khan wrote:
Hey,
I have submitted my draft proposal on GSoC Platform and looking forward to your feedback to improve my Proposal.
 

--
You received this message because you are subscribed to a topic in the Google Groups "Jenkins Developers" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-dev/M8ZjJVCz2rA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/030748ce-f494-4889-85eb-a81da5e8dc2b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "Jenkins Developers" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-dev/M8ZjJVCz2rA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAPfivLBTQ-r2ykSS4HxCvkXrTMbQbf4TRLUk6Yozw46tU252fQ%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAO3w89XL0CYyZG%2BRObpsDHZETG7gwK-MxCPwB0AO4ZViQhaGTQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: [GSoC 2018] Introduction for Improvements to the Jenkins Acceptance Test Harness

Sahil Khan
In reply to this post by Sahil Khan
I saw the comments and I will work on this to improve as much as possible.Thanks for your feedback and time.Will revert you back soon when I have improved that.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/390d82fd-7f55-4a42-a854-407024b851a9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.