Flakiness in Jenkins tiles

[cachedout]

Flakiness in Jenkins tiles

[cachedout]

We've (possibly) tracked this down to nginx in front of the Jenkins instance rate-limiting Monitoror. However, I still believe this may be a bug as I believe we shouldn't be seeing Monitoror send bursts of requests quite so aggressively. :-/

[cachedout]

I should point out that I believe I'm seeing multiple tiles update at once, which leads me to believe that perhaps there may be some places where additional splay and randomization may need to be added. I'll keep an eye on this and see if I can confirm this behavior.

[cachedout]

From watching the requests from the browser to the app, here's what comes back when a job suddenly becomes flakey. (Sensitive information snipped out):

{"type":"JENKINS-BUILD","status":"FAILURE","label":"<snipped>","message":"unable to find job","build":{"branch":"master"}}