voxpupuli/pcci

pcci

pcci - puppet community continuous integration

An experiment in public beaker testing

requirements:

• github bot account
• redis-server running
• beefy machine to run tests

A experimental instance is running at https://ci.voxpupuli.org

application deployment:

right now this is super janky.

follow_pull_requests.py is run by 5 minute cron

4 run_worker.sh run (sent to background in shell)

one comment.py is run in the foreground in a tmux

improvement needed!

pcci's Issues

Write upstart/init scripts

Right now most of the daemons run in tmux. Can we move them to init scripts managed by service provider

"Details" link in PR leads to garbled URL

Looking at puppetlabs/puppetlabs-mysql#784 , the detail links here:

Lead to

http://ci.puppet.community/buildlogs/%7Bu'pr':%20u'784',%20u'pull':%20%7Bu'begin_test':%20u'2015-12-09%2004:15:39.808079',%20u'merge_commit_sha':%20u'5b09d2482f6686898949c84709289d39666ab4c2',%20u'number':%20u'784',%20u'name':%20u'puppetlabs/puppetlabs-mysql/784',%20u'time':%20u'2015-
http://ci.puppet.community/buildlogs/%7Bu'pr':%20u'784',%20u'pull':%20%7Bu'begin_test':%20u'2015-12-09%2004:12:45.047585',%20u'time':%20u'2015-11-30%2021:00:47.747106',%20u'number':%20u'784',%20u'name':%20u'puppetlabs/puppetlabs-mysql/784',%20u'merge_commit_sha':%20u'5b09d2482f668689894

which, unsurprisingly, are not valid on ci.puppet.community. I would have expected a link to the actual build(log) there.

Test runs need timestamps

Collapse multiple runs of the same PR together? Aggregate success status?

el6 support

@nibalizer is working with others to bring el6 support.

I created this issue to track the status of that feature.

Set 'test in progress' state on CI when a test is began

When PCCI picks up changes to a pr (when the todo list is appended to, this probably happens in follow_pull_requests.py), pcci should vote with the yellow 'test in progress' ball on github. Then when the test is run, comment.py can change the vote to green.

The github api isn't complicated. Simply set yellow, then set green/red.

Module page should include PR summary in 'Pull Request' column

Votes only once for multiple tests

Right now it will run a test on centos then on ubuntu, both will attempt to set the green ball in github. Either pcci needs to store tests and vote with one green ball, or send multiple green balls to github.

Exceptions in follow_pull_requests

voxpupuli/puppet-corosync/132
05b5f702225df6c8878b78997d6bba0ee46fc352
05b5f702225df6c8878b78997d6bba0ee46fc352
Traceback (most recent call last):
  File "pcci/follow_pull_requests.py", line 33, in <module>
    for pull in pulls:
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/PaginatedList.py", line 48, in __iter__
    newElements = self._grow()
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/PaginatedList.py", line 60, in _grow
    newElements = self._fetchNextPage()
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/PaginatedList.py", line 181, in _fetchNextPage
    for element in data if element is not None
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/GithubObject.py", line 217, in __init__
    GithubObject.__init__(self, requester, headers, attributes, completed)
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/GithubObject.py", line 74, in __init__
    self._storeAndUseAttributes(headers, attributes)
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/GithubObject.py", line 86, in _storeAndUseAttributes
    self._useAttributes(attributes)
  File "/home/pcci/latest_pygithub/local/lib/python2.7/site-packages/github/PullRequest.py", line 616, in _useAttributes
    self._url = self._makeStringAttribute(attributes["url"])
TypeError: string indices must be integers

'Completed' page needs to be updated to match the module test page

Bot is making comments where it probably shouldn't

In some cases, eg. puppetlabs/puppetlabs-stdlib#451 the bot is commenting twice or more when the code hasn't changed.

Move all configuration to yaml

Right now config.py is a python script with values in it. Use yaml to configure.

There is an exmaple of this in pcciweb.py