Comments (1)
Observations:
- The CircleCI job succeeds, which allows code to pass CI and to be merged, but the pa11y run inside the job is failing. You can tell this by the drop in build time from ~25 mins to ~5 mins
- pa11y starts silently failing in the CircleCI job on this build for the Ruby 3 upgrade. However, that commit is small, and nothing in that commit seems relevant to pa11y, so I chalked it up to timing coincidence.
- Update: it looks like this bug was introduced on the very first "successful" ruby-3 build. For example, subsequent builds on the older ruby do not have this issue.
- Other projects started having trouble with pa11y builds around this same time
What I’ve tried:
- Pa11y job ends in
SIGHUP
after serving the site, but before any pa11y output - Running the same pa11y script locally works:
./serve-pa11yci && npm run pa11y-ci
- Running pa11y in a GH Codespace failed in the same way that Matt H’s runs failed (as in, puppeteer exploded immediately)
- Adding a few chrome dependencies before running pa11y got it to work in GH/Codespaces
- But trying the above fix in CircleCI did not solve it, same behavior as before (SIGHUP)
- Trying to SSH into the CircleCI build to further examine the environment is blocked by zscaler. Open ssh connection just hangs, even after checking for proper ssh keys. There are no consistent IP addresses provided by Circle for this purpose, so getting them allow-listed by GSA IT wouldn’t be effective.
- Another idea is to get pa11y to fail more loudly in the CI job, but pa11y-ci doesn’t really offer a
--verbose
or equivalent config - I was able to ssh into a failing build. I'm able to
curl
URLs in the sitemap that pa11y is supposed to be hitting. Running pa11y manually while a detached server is running still returns a genericFailed to run
message when scanning the first URL. I haven't been able to get it to return a more specific error using different configs.
I will update this comment as I try more things.
from 18f.gsa.gov.
Related Issues (20)
- Featured post cards: focus state
- Add automation to add opened issues to Delivery Assurance board
- Test issue HOT 1
- BUG -- feature template adds a type:bug label to the issue.
- Add the 18F Delivery Assurance team as an admin HOT 1
- Update dependencies to run on modern hardware HOT 1
- Some anchor elements have empty href attributes HOT 4
- BUG: Width for some blog posts HOT 5
- Open source policy page links to different license file
- Test issue
- Investigate removing 18F style guide HOT 7
- Upgrade Dockerfile and Docker-Compose files to newer versions
- 18f site style guide page—footer displaying over the content HOT 1
- Pa11y runs are too slow HOT 22
- Pull quotes not showing on blog HOT 1
- BUG: Partnership principles page is misaligned
- BUG Social link in the footer opening in the same tab HOT 3
- Prevent pa11y from silently failing in CI
- Have Github automatically delete merged branches HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from 18f.gsa.gov.