mattcarmody/trackr

An automated assistant that helps me manage myself. Built w/ Python & SQLite. With help from BeautifulSoup, matplotlib & Selenium.

trackr's Issues

Write a goodreads backfiller

Can this be done? Do items on shelves include timestamps? Or can read data for each book be accessed?

Visualizations failing

Save date with new HackerRank items

Date column is blank because I had backdated previous entries by hand.

Calling each site even when it's already updated today

Cut down on unnecessary requests by refactoring update functions

Add Anki

Can access the SQLite db directly on desktop. Data won't always be synced up daily, so give it ability to backfill

Duolingo chart showing negative

I've shifted off Duolingo to Anki so with flat incoming data it's showing negative values.

Always puts data in new row, possible duplicates

All modules, beside the email updates, automatically append to a new row in the spreadsheet. I'd rather it checked to see if an entry had already been made for that date. Then the program can be run more than once a day without creating duplicates.

HackerRank points skewed by login

HackerRank gives points just for logging in and they grow with each consecutive day. I'd rather this program filtered out points earned from anything other than completed exercises. This is especially true because the script (attempts to) log in to HackerRank daily.

Clean up db connection handling

I have a feeling I don't need to be passing cur around all the time. If not, clean up before refactoring trackr.py's function calls.

Break up log file

Currently appends everything to a single text file indefinitely. This can be improved, look into best practices

Warmup Update does not return anything, crashing anything after it

deepWork visualization is hardcoded for week 1

Update sql call to pull appropriate data for that week.

HackerRank leaves page open if it fails

pullFromEmail is failing

Haven't dug into the details or traceback. When I first added a couple print statements:

    print(rel_entry)
    print(words)

after line 9, it unexpectedly "solved" the issue. I didn't commit those changes, it needs a deeper dive.

Goodreads data is capped at 30

Probably still has 2018 data but even so that capped at 30.

HackerRank conditional formatting can't be done easily in LibreCalc

Add a "Select Hackos" field which sums only hackos awarded for completing exercises.

Chess is failing

Create regular, automated backups

Can I build in other sources that I use more often these days?

Anki, Netflix (just PT, not EN), Spotify (separate account for PT or list of sources?)

HackerRank profile page 404

Often the HackerRank profile page will 404, causing a day to be missing in the list and update incorrectly in the main spreadsheet page.

Bifortly visuals are run on the wrong week

HackerRank can be refactored

Break out scrape from update, remove unnecessary request. Also break down scrape into smaller pieces

Codewars honor skewed by achievements, other activity

Honor, the point tracking system in Codewars, is broken out by category. I'd prefer this program only tracked honor awarded for completing exercises.

Add deep work to pullFromEmail

This is the core metric, add compatibility via emails of form: Subject Work, Body deep work two

Update functions are repetitive

DRY. How can update functions be improved?

Undefined key added to daily limber

Where are undefined keys being assigned? Create a To Be Addressed column in xlsx with key in dict.

hackerRank page count is hardcoded

Need to update the page count to a variable to grow with my history on the site.

Duolingo - auto adjust when they add a language

Occasionally Duolingo adds a new language which causes data to be saved to the wrong fields. Short term fix to add a flag whenever they introduce a new language. Long term find a better way that doesn't require maintenance.

Create a test file with a unit test

Needs tests developed and run before commits

Date format is hard coded into each module

This feels like poor practice to maintain. Update to stay DRY.

Update duolingo failed

requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.duolingo.com/users/MattCarmody

Some tables need hardcoded 0's in advance

HackerRank date and total being stored in the wrong row

Now that a granular Hacko history is being stored on the same sheet, max_row + 1 is no longer guaranteed to put the date and total hackos in the correct row.

Create failure notifications

Currently, failures are silent. Set them up to send an email?

except: pass in my_email

Either change flow or narrow down exception handling