alifensome/gender-pay-gap-bot

gender-pay-gap-bot

A bot to tweet the gender pay gap of a company, at companies who tweet about international women's day.

You can see the bot in action here for such gold as this

Architecture

As of 2022 this is running on AWS and deployed with serverless

Data

Forming a data set linking UK Gov gender pay gap data with twitter users was by far the hardest part of this hack. The data was downloaded on 2021-03-04 so will be out of date.

Combined GPG data

The GPG data was combined into one file data/companies_GPG_Data.json. This will only be as up to date as the UK Gov GPG data as the deadline is April so more data is submitted then.

Joining twitter data

Twitter data was join on from an API based on company name and location. We then manually checked those linked were correct and added in some more manually gathered data.

This data set is in data/twitterAccountData/twitterUserData-prod.json

Twitter Matching Improvements

Problems

• We get duplicate companies sometime with different GPG data but same location.
• Companies house => company website => crawl for twitter url

Manual Data Gathering

• Search twitter with group: 1
• no twitter profile: 1

Canvas Lambda Layer

Deploy with this https://github.com/jwerre/node-canvas-lambda

TODO

• Potential bug At G4S SECURE SOLUTIONS (UK) LIMITED, women's median hourly pay is 275.9% higher than men's, an increase of 271 percentage points since the previous year https://twitter.com/PayGapApp/status/1534883135967612928/photo/1

gender-pay-gap-bot's Issues

Adding a link back to Employer page in tweet?

It might be nice to link back to an employer page e.g. https://gender-pay-gap.service.gov.uk/Employer/gDuQKC7x this could help build confidence in the company match and give people the historical reports too which are available on that page.

If the ID wasn't available then perhaps even just a handy link to the https://gender-pay-gap.service.gov.uk/viewing/search-results?t=1&search=UBS&orderBy=relevance

GitHub sponsorship?

I'd like to sponsor this app to contribute towards its upkeep and both of your time on this project.

Can you set up a way for reoccurring sponsors?