How often is the downloadables crawler run?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

How often is the downloadables crawler run?

Tim Van Holder
Hi,

My Downloadables (as received from the update center) are a few days out of date.
How often is the crawler run? Are the logs of the last run viewable?

Specifically, .NET 5 was released on Wednesday but I'm still only seeing 5.0-rc.2 as highest available version in the file as downloaded at Jenkins startup.
Running the crawler script locally does produce up to date info.

(I also had issues with plugins under hpi:run, but looking at Jira that is a general issue, not specific to my setup.)

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAKMi--BQoC33WFF%3DJOP_BBbnrSNE0sG%2BAAsjc_fAJseLvZz-dg%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: How often is the downloadables crawler run?

Tim Van Holder
Partially answering my own question: looking at https://updates.jenkins.io/updates/ suggests that the last run was 2020-10-28, over two weeks ago.
That feels like a rather long gap between runs.

On Fri, 13 Nov 2020 at 22:38, Tim Van Holder <[hidden email]> wrote:
Hi,

My Downloadables (as received from the update center) are a few days out of date.
How often is the crawler run? Are the logs of the last run viewable?

Specifically, .NET 5 was released on Wednesday but I'm still only seeing 5.0-rc.2 as highest available version in the file as downloaded at Jenkins startup.
Running the crawler script locally does produce up to date info.

(I also had issues with plugins under hpi:run, but looking at Jira that is a general issue, not specific to my setup.)

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAKMi--CdC9Ri5aZ-3ANCQJ59pLPvm3i-cEion8iPQfjcv5uUCQ%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: How often is the downloadables crawler run?

Gavin Mogan
https://github.com/jenkins-infra/crawler/blob/master/Jenkinsfile#L10

Looks like it's supposed to be run every 4 hours.

Sadly it's on the super locked down trusted Jenkins install. It might be worth moving it to the less locked down infra one so more of us can look into and monitor failures.

On Fri., Nov. 13, 2020, 1:41 p.m. Tim Van Holder, <[hidden email]> wrote:
Partially answering my own question: looking at https://updates.jenkins.io/updates/ suggests that the last run was 2020-10-28, over two weeks ago.
That feels like a rather long gap between runs.

On Fri, 13 Nov 2020 at 22:38, Tim Van Holder <[hidden email]> wrote:
Hi,

My Downloadables (as received from the update center) are a few days out of date.
How often is the crawler run? Are the logs of the last run viewable?

Specifically, .NET 5 was released on Wednesday but I'm still only seeing 5.0-rc.2 as highest available version in the file as downloaded at Jenkins startup.
Running the crawler script locally does produce up to date info.

(I also had issues with plugins under hpi:run, but looking at Jira that is a general issue, not specific to my setup.)

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAKMi--CdC9Ri5aZ-3ANCQJ59pLPvm3i-cEion8iPQfjcv5uUCQ%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAG%3D_DusngJNuft_LwNOMFXJ50L1Zg%3DT0V50RGPQLkoHq4N_-sg%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: How often is the downloadables crawler run?

Daniel Beck-2
In reply to this post by Tim Van Holder
Usually it runs every four hours, but an infra change two weeks ago accidentally caused it to stop.

For posterity:
Someone changed the configured Jenkins URL to fix an issue with Jetty.
That caused https://github.com/jenkins-infra/pipeline-library/blob/376e4789fcfca012198fd2dccba7436db87b3a36/vars/infra.groovy#L8 to return false (an unnecessarily brittle line of code if I've ever seen one)

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAMo7PtJyy13DmtyXdtLSd78LgB1BjC-gztguX6Dsn0fK7oo7CQ%40mail.gmail.com.
Reply | Threaded
Open this post in threaded view
|

Re: How often is the downloadables crawler run?

Gavin Mogan

https://updates.jenkins.io/updates/ is now showing 11-14 so \o/ crawlers are back online

On Fri, Nov 13, 2020 at 1:54 PM Daniel Beck <[hidden email]> wrote:
Usually it runs every four hours, but an infra change two weeks ago accidentally caused it to stop.

For posterity:
Someone changed the configured Jenkins URL to fix an issue with Jetty.
That caused https://github.com/jenkins-infra/pipeline-library/blob/376e4789fcfca012198fd2dccba7436db87b3a36/vars/infra.groovy#L8 to return false (an unnecessarily brittle line of code if I've ever seen one)

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAMo7PtJyy13DmtyXdtLSd78LgB1BjC-gztguX6Dsn0fK7oo7CQ%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAG%3D_DuvoFamSpeuYBvB9JMLvaxcAih5iPRGdnEFMsqpM8%3D1%3DpA%40mail.gmail.com.