andygrunwald/trendinggithub

A twitter bot (@TrendingGithub) to tweet trending repositories and developers from GitHub

👋 Hi, I'm Andy Grunwald

I am a Software Engineer and Engineering Manager from Germany with a focus on Backend-Systems and Infrastructure, Engineering Culture and People.

👷 Check out what I'm currently working on

• EngineeringKiosk/webpage - Landing page hosted on netlify (today)
• sourcectl/webpage - (2 days ago)
• lansuite/lansuite - A Content Management System designed especially for the needs of LAN-Parties (2 days ago)
• andygrunwald/dropbox-auto-cleaner - Removes files from a Dropbox folder based on file age (1 week ago)
• andygrunwald/andygrunwald.com - andygrunwald.com (1 week ago)

🔭 Latest releases I've contributed to

• prometheus-community/ansible (0.12.0, 1 day ago) - Ansible Collection for Prometheus
• snok/container-retention-policy (v2.2.1, 2 months ago) - Github action for pruning old GHCR container image versions.
• msiebeneicher/snab (v0.4.0, 5 months ago) - SnaB - Snake Basket is a shell runner aims to enable you to bundle shell script and commands like a powerful modern CLI application
• labstack/echo-contrib (v0.15.0, 8 months ago) - Echo community contribution
• mhutter/ansible-docker-systemd-service (v2.10.0, 11 months ago) - Ansible role for creating Systemd services for docker containers

🔨 Latest Pull Requests I published

• [usrmgr] Fix access array offset on value of type bool on lansuite/lansuite (3 days ago)
• [tournament2] Fix PHP warnings like undefined array key or access array offset on type bool on lansuite/lansuite (3 days ago)
• Fixing PHP errors like "undefined array key" or "undefined variable" in modules info2, seating, paypal, helplet and mail on lansuite/lansuite (3 days ago)
• actions/setup-python Upgrade from v4 to v5.0.0 (node16 is deprecated) on snok/container-retention-policy (2 weeks ago)
• Podcast Episode view: Fix clickable chapter when HTML is malformed by Rich Text Editor on EngineeringKiosk/webpage (1 month ago)

📝 My recent blog posts

• Lessons learned from running a local tech meetup for 11 years (1 month ago)
• My alltime-high articles (1 month ago)
• Run your Continuous Integration every day (1 month ago)
• Cancel your meetings if you can live with the outcome (1 month ago)
• I can't wash my clothes without Open Source (2 years ago)

📫 How to reach me

• Twitter: @andygrunwald
• Website: andygrunwald.com
• Email: andygrunwald (at) gmail (dot) com

trendinggithub's Issues

Follow @TrendingGithub follower back

To gain the popularity of @TrendingGithub it make sense to follow the @TrendingGithub`s follower back.

Another (additional) idea of @mre is to follow friends of @TrendingGithub`s follower to get new people into the follower line :)
Of course, this should be automated (e.g. every hour)

Add support for metrics via expvar

Some statistics / monitoring might be useful.
The expvar package looks a good candidate.

Checkout this article for a few details: http://www.mikeperham.com/2014/12/17/expvar-metrics-for-golang/

Implement dependency management

Golang got no dependency management. Implement one.
Godep or the experimental one from Go 1.5

Hashtags don't work when they have commas in them

Reported by Dimitar Nestorov via Twitter: https://twitter.com/dimitarnestorov/status/958195310702014465

Twitter supports now 280 chars per tweet

@DimitarNestorov twittered me (https://twitter.com/dimitarnestorov/status/937107847925690368) that twitter now supports 280 chars.

Goal of this task: Make this bot work with this

Add # of watches and # of stars to tweet

As long as you are <140 chars, add useful information like number of watches, number of stars, delta of these, etc

Searching a new tweet fails if no repository can`t be found

To search a new tweet we scheduling a new function call every 30 minutes.
In this search process we are looking for the first 3 timeframes (week, day, month), and after this every timeframe for every trending (!) language.

If no repository can be found no new search process will be scheduled.

Here is a log:

2015/08/24 00:24:16 Getting projects for timeframe weekly
2015/08/24 00:24:17 Getting projects for timeframe daily
2015/08/24 00:24:17 Getting projects for timeframe monthly
2015/08/24 00:24:18 Getting projects for timeframe weekly and language ruby
2015/08/24 00:24:19 Getting projects for timeframe daily and language ruby
2015/08/24 00:24:19 Getting projects for timeframe monthly and language ruby
2015/08/24 00:24:20 Getting projects for timeframe weekly and language javascript
2015/08/24 00:24:20 Getting projects for timeframe daily and language javascript
2015/08/24 00:24:21 Getting projects for timeframe monthly and language javascript
2015/08/24 00:24:21 Getting projects for timeframe weekly and language php
2015/08/24 00:24:22 Getting projects for timeframe daily and language php
2015/08/24 00:24:22 Getting projects for timeframe monthly and language php
2015/08/24 00:24:23 Getting projects for timeframe weekly and language python
2015/08/24 00:24:23 Getting projects for timeframe daily and language python
2015/08/24 00:24:23 Getting projects for timeframe monthly and language python
2015/08/24 00:24:24 Getting projects for timeframe weekly and language c
2015/08/24 00:24:33 Getting projects for timeframe daily and language c
2015/08/24 00:24:33 Getting projects for timeframe monthly and language c
2015/08/24 00:24:34 Getting projects for timeframe weekly and language unknown
2015/08/24 00:24:35 Getting projects for timeframe daily and language unknown
2015/08/24 00:24:35 Getting projects for timeframe monthly and language unknown
2015/08/24 00:24:36 Getting projects for timeframe weekly and language css
2015/08/24 00:24:36 Getting projects for timeframe daily and language css
2015/08/24 00:24:37 Getting projects for timeframe monthly and language css
2015/08/24 00:24:37 Getting projects for timeframe weekly and language java
2015/08/24 00:24:38 Getting projects for timeframe daily and language java
2015/08/24 00:24:38 Getting projects for timeframe monthly and language java

Implement shutdown due to a SIGTERM

See

• http://en.wikipedia.org/wiki/SIGTERM
• http://12factor.net/disposability

Extend logging to get a few more details on stdout

The logging is quite okay, but it can be better.
At the last "outtage" (#12) it took some time to find out what the root case was.

Have a look at the logging and check if we can improve this.

Document the source code

The source code is quite undocumented.
It is hard to get into the code without knowing the thoughts behind it.

Goal of this task: Document the code :)

Implement profiling possibilites

See

• http://blog.golang.org/profiling-go-programs
• https://medium.com/@tjholowaychuk/profiling-golang-851db2d9ae24
• http://de.slideshare.net/cloudflare/go-profiling-john-graham-cumming
• https://github.com/bradfitz/talk-yapc-asia-2015/blob/master/talk.md

Adjust length of shorten twitter url automatically

Currently we assume 25 letters for the url
The twitters t.co url shortener modifies itselfs (depending on how many urls will be posted).

TODO: Daily GET call to help/configuration to receive max length for URL
Only with this we are able to fill out 140 chars as max as possible.

@link https://dev.twitter.com/overview/t.co
@link https://dev.twitter.com/rest/reference/get/help/configuration

@TrendingGithub is not tweeting anymore since 2nd November 2016

The issue was reported on twitter by @edasque

Extend "Follow people" to follower of @GitHubEng

Greylist repositories - instead of blacklisting

Greylist previously tweeted repositories for 1/2/3 months instead of blacklisting. That way they will reappear if they are trending again.

Migrate from github.com/garyburd/redigo to github.com/gomodule/redigo

See garyburd/redigo@5dd9313

[Question] How to detect trend repositories

I love this repository, but I don't see in the documentation the most interesting thing: how to doy determinate a trending Github Repository? Can you explain to me?

I suppose that you are using something like detect the number of new stars in a short period of time. or maybe Github trending have an API or something like that? Are you polling and endpoint?

Definitely, How you do this :-)