carlcolglazier/cheesecake

🧀🍰 Evidence-based FRC analytics.

I am a PhD student in Technology and Social Behavior at Northwestern University where I am affiliated with the Community Data Science Collective.

My research focuses on decentralized social networks like the Fediverse and their role as sociotechnical systems. I like to use computational social science.

At North Carolina State University, I graduated in 2019 with a B.S. in Computer Science and a B.A. in Communication Media. Previously, I worked as intern in full stack software engineering at IBM and as an undergraduate researcher at the Center for Research Computing at the University of Notre Dame.

Curated Projects

Music Software

• Olearia is a collection of applets for the Daisy Patch.
• ES-5Linx is a VST and JACK utility to handle the Expert Sleepers ES-5 Eurorack expansion on Linux.
• MI_Nebulae_v2 are ports of Native Instruments code for the QuBit Electronix Nebulae v2.
• libre-rytm-sds is a simple set of scripts to send samples to the Elektron Analog RYTM on Linux.

cheesecake's Issues

Delete unplayed playoffs matches.

At the beginning of any playoff round, TBA loads three matches for each set; however, often only two of these are usually played.

To fix this, the system needs a way to know when a match is not being played (rather than just being a match in the future).

2500 NaN for RPs at ndgf

2500 is currently showing NaN for their mean RPs at Great Northern (ndgf)

Create limited Predict() function

The current one is taking a full 30 seconds. Make one that only changes future predictions for an event.

Docker config is breaking my email.

Need to look at the IPs and nginx config, likely.

Webhooks not (always) sending in score breakdowns.

Event page does not display with null prediction(s).

Account for DQs.

These mess up the rank predictions.

Calculations using too much memory on server.

AttributeError: 'NoneType' object has no attribute 'prediction'

[2019-03-14 13:53:11,066] ERROR in app: Exception on /api/verify/2019 [GET]
Traceback (most recent call last):
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 2292, in wsgi_app
    response = self.full_dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1815, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask_cors/extension.py", line 161, in wrapped_function
    return cors_after_request(app.make_response(f(*args, **kwargs)))
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1718, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/_compat.py", line 35, in reraise
    raise value
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1813, in full_dispatch_request
    rv = self.dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1799, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask_caching/__init__.py", line 686, in decorated_function
    rv = f(*args, **kwargs)
  File "./cheesecake/api/__init__.py", line 216, in brier
    diff = match.get_prediction("EloScorePredictor").prediction - match.result()
AttributeError: 'NoneType' object has no attribute 'prediction'

docker-compose.yml file

Reduce queries to The Blue Alliance

This will likely require writing some custom functions for querying the API.

Four robots displayed when alliances swap bots.

Future-oriented Design

The goal of this service is prediction. The initial launch, therefore, should focus on the immediate future as much as possible. That is to say, the events page should emphasize the events going on the current week and that should be the main focus.

Event Page

Overview tab

Needs to be decided what goes here.

Rankings tab

Predict rankings.

Match tab

Display future and past matches with predictions (and verifications).

Need frontend tests.

Need backend tests.

Problems with the database.

Sometimes the authentication just stops working. Need to investigate this one further.

Score breakdown does not update after match is played.

Nonetype for score_breakdown.

[2019-03-09 16:50:01,440] ERROR in app: Exception on /api/rankings/2019ncwak [GET]
Traceback (most recent call last):
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 2292, in wsgi_app
    response = self.full_dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1815, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask_cors/extension.py", line 161, in wrapped_function
    return cors_after_request(app.make_response(f(*args, **kwargs)))
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1718, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/_compat.py", line 35, in reraise
    raise value
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1813, in full_dispatch_request
    rv = self.dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1799, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask_caching/__init__.py", line 686, in decorated_function
    rv = f(*args, **kwargs)
  File "./cheesecake/api/__init__.py", line 179, in get_rankings
    if match.score_breakdown[color]["habDockingRankingPoint"]:
TypeError: 'NoneType' object is not subscriptable

Use PostgreSQL instead of SQLite3.

This will allow us to store JSON objects.

Not all playoff matches are populating.

Sometimes the schedules are not updating properly. This can be solved (likely) by also accepting "Competition Level Starting Notification" notifications.

Vue-resource is retired.

Just found this Medium post: https://medium.com/the-vue-point/retiring-vue-resource-871a82880af4

Might be a good idea to migrate to another library at some point. Fetch over xhr preferred.

Predict using too much memory.

Attempt to fix this by using paging or window functions.

Docker settings: restart on reboot.

Update documentation to use pipenv instead of the requirements.txt file.

Schedule updated, team_keys not being deleted.

Inconsistent results on "backend reset" in production.

Sometimes it just doesn't populate stuff.

This might be a memory issue. Breaking apart the reset function could help make this work better.

Toward Cheesecake 1.0

This is a general planning issue for the steps needed to move toward a full launch next year!

• Investigate stack options.
  • Is go a good option?
  • Do I need a javascript-based front-end?
  • What tools does Python offer for async tasks?
• Identify features for MVP
• UX design concept.

API Queries on Production

Need a function which chooses the correct base URL for the API based on context.

Overfitting in response to webhooks

I wish this was accurate.

Something is off with the prediction loop where the predictors and being trained with the results already fed in. Woops!

Link back to data sources on detail pages.

Handle surrogates

[2019-03-09 17:05:11,895] ERROR in app: Exception on /api/ [POST]
Traceback (most recent call last):
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 2292, in wsgi_app
    response = self.full_dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1815, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask_cors/extension.py", line 161, in wrapped_function
    return cors_after_request(app.make_response(f(*args, **kwargs)))
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1718, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/_compat.py", line 35, in reraise
    raise value
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1813, in full_dispatch_request
    rv = self.dispatch_request()
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/flask/app.py", line 1799, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "./cheesecake/api/__init__.py", line 86, in webhook
    m = update_match(data["message_data"]["match"])
  File "./cheesecake/utils.py", line 32, in update_match
    red = Alliance(**match["alliances"]["red"])
  File "<string>", line 4, in __init__
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/sqlalchemy/orm/state.py", line 428, in _initialize_instance
    manager.dispatch.init_failure(self, args, kwargs)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 67, in __exit__
    compat.reraise(exc_type, exc_value, exc_tb)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 277, in reraise
    raise value
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/sqlalchemy/orm/state.py", line 425, in _initialize_instance
    return manager.original_init(*mixed[1:], **kwargs)
  File "/home/carl/.local/share/virtualenvs/cheesecake-7w3mno1X/lib/python3.6/site-packages/sqlalchemy/ext/declarative/base.py", line 799, in _declarative_constructor
    "%r is an invalid keyword argument for %s" % (k, cls_.__name__)
TypeError: 'surrogates' is an invalid keyword argument for Alliance

Calculate matches in order.