metakgp/gyft

Get Your Freaking Timetable

A repository for managing Metakgp issues.

Want to talk? We hang out on Slack: Here is an invite for you.

gyft's Issues

Ask the user about generating ics file

Instead of just printing to use generate_ics.py in the end of gyft.py, prompt the user for confirmation whether they want ics file or not and if yes we can just directly execute the generate_ics.py script.

Same goes for add_events.py

And integrate del_events.py via a cli argument what they want to do. Basically one should only use gyft.py for whatever their need be

Note I am not clear about the role of del_events.py so let's first of al complete the first two tasks and if you know what the other file does please tell me.

Connection Timed out

ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

Not repeating weekly

after adding to Google calendar, its default setting it to repeat till 2018
can be repeated till the week end

POA: WebApp and beyond

• Modularisation of gyft.py into

  Note Time table extractor will be imported in both - obviously.

  • Timetable extractor - @Devansh-bit
  • CLI workflow(login) - @Devansh-bit
  • WebApp workflow (login) [<- This is backend] - @Vector-013
• Frontend in Svelte - @rohan-b-84
• Implement a deployment pipeline
• Archive gyft-serve

Ask User To Enter RollNumber

We currently take roll number as an argument and do not check if it is provided or not.

It would be good to have a check if the argument ("user") is not None and if it is None, ask the user to enter it and then proceed.

Reference: https://stackoverflow.com/questions/30487767/check-if-argparse-optional-argument-is-set-or-not

[Discussion] Increasing the scope of the project

This issue is not about a specific post. I'd rather like to discuss a few things that increase the scope of the project.

• 'Export' calender (*.ics files, I believe) or create a per user link that people can add to their own calender.
• Having worked on naarad, we can scrape events from most of the society pages periodically and create calender events - no need to do anything manually. This, too, can be offered as an exported calender.

I do not know what are the specific issues in implementing these, but I think that the above combined with a resolution of existing issues will really pack a punch.

Ideas?

cc/ @athityakumar @DefCon-007 @icyflame @hargup

Provide option to supply output and input file name in generate_ics.py

Implement optional CLI arguments --output and --input using which the user can supply the path to the output ICS file and the input data file

Provide an option to generate an ICS file

Work begun at: https://github.com/icyflame/gyft/tree/generate-ics-file

Cannot import name 'util'

Add location for classrooms/venues

LIke currently it shows N241 and likewise.
If we add the proper lat-lng, it can be shown in Google Maps.
TODO:

• Add latitude-longitude of all the departments (possibly on wiki)
• Store the same in this repo as a json
• load the json in the program and add it to the google calendar event

All events are not being deleted

After running del_events.py only current month's events are removed from calendar.

AddEvents Not Working Behind Proxy

The script doesn't work behind proxy; I guess the error is in the building of the drive application which uses httplib2 to establish the connection.

Update for Autmn 2022 Dates Wrong

The timetable is read correctly. But the events are added to the wrong months.

Integrate with iitkgp-erp-login properly

• The file of interest is network.py and hence gyft.py

Network.py has various things which are already handled by the package itself, like:

• Specifying cookies separately anywhere (this is handled well enough internally)
• No need to "refresh_cookies" - not sure, test this claim

Thus the functions of interest are:

• refresh_cookies -> Not needed
• post -> Remove usage of cookies
• login -> Update accordingly

no module named bs4

On typing
python3 gyft.py
we get
Traceback (most recent call last):
File "C:\Users\Anindita\OneDrive\Desktop\gyft\gyft.py", line 2, in
from timetable import delete_calendar, create_calendar, build_courses, generate_ics
File "C:\Users\Anindita\OneDrive\Desktop\gyft\timetable_init_.py", line 1, in
from timetable.extractor import *
File "C:\Users\Anindita\OneDrive\Desktop\gyft\timetable\extractor.py", line 4, in
from bs4 import BeautifulSoup
ModuleNotFoundError: No module named 'bs4'

No events for vacations

Get vacation list and exam times from academic calendar and hack it into add_events.py.

codeofconduct

Sync to Google calendar - select dates intelligently

Improvisation in selecting date periods :

(1) The Sync should be made to the Google Calendar, only till beginning of end-semester exams. Currently, the sync is made for all weeks after the current week.
(2) The week of mid-semester / end-semester exams should be left vacant at least, or even better - be filled with the user's mid-semester / end-semester timetable.

Error if the whole day is empty

If there are no events on a given day, the program throws the following error:

Traceback (most recent call last):
  File "gyft.py", line 114, in <module>
    txt = tds[a].find('b').text.strip()
AttributeError: 'NoneType' object has no attribute 'text'

Using insti proxy with httplib2

Currently, line 77 of add_events.py throws socket error due to insti proxy.

Modification required is :
http = credentials.authorize(httplib2.Http(proxy_info = httplib2.ProxyInfo(httplib2.socks.PROXY_TYPE_HTTP_NO_TUNNEL, '10.3.100.207', 8080)))

Import Error in Google Calendar

ICS file generated from Gyft cannot be imported to Google Calendar.

Steps to reproduce:

1. Generate .ics file from gyft.
2. Go to google calendar on desktop. Click Settings icon on the top right.
3. Go to Import and Export tab.
4. Upload the downloaded file.
5. Click import.

Screenshot:

Migrating from the concept of subject.json

The idea is pretty simple, we don't have to maintain a subjects.json for fetching the name of the course. We can directly fetch it from erp itslef.

Possible solutions:

• Using department timetable, with some trickery to get it
• Using the concept from gyfe

Better README

• Changes made in #96 - solved in #98
• Make instructions more organised and concise - using better format, preferably this - solved in #110
• A logo?

Wrong classification of classes & labs

Just because some classes are not included in subjects.json , the class is being classified as a lab. Instead, how about checking the number of hours of the class on that day?

if number_of_hours < 3 => class
else => lab

Add License to the project

Implement REGEX Check With RollNo

Currently, we do not check for the validation of roll numbers entered.

In practicality it is not feasible to verify if the roll number is correct but
we can surely filter wrong formatted rolls numbers using REGEX check.

https://regexone.com/

Add lab lists in subjects.json

Labs are not included in current subjects.json

Only Add Holidays For The Semester

The generated ics file includes institute holidays for the whole year. Due to this, some holidays may be repeated if gyft is used for both semesters. Adding holidays only relevant to the semester will be better.

Additionally, having an option to add holiday events or not would be nice.

Upgrade urllib3

There is a vulnerability in the urllib3 version we currently use.

Update it to urllib3>=1.23

Issue with some first year courses

When logging in with a first year roll number, the following error occurred:

ss:

P.S.: only checked with one first year roll number (mine).

del_events.py giving key error

if ("Class of " in event['summary'] or "Lab of " in event['summary']):

KeyError: 'summary'

Remove `data.txt` as a middleware

It might be useful back then but not now.
If required to create something other than just timetable.ics (Like - time table pdf or timetable CLI representation) we can directly use timetable_dict.

This is just an overhead at this point

Add the requirements.txt file to make pip installation easier

@nishnik
I couldn't track down the dependency apiclient. I used apiclient==1.0.2 from here but it says that apiclient.discovery (which you have imported) doesn't exist. Any ideas?

Upgrade requests

Current request library comes with a security threat. We need to use: requests>=2.20.0.

Update it in the requirements.txt file.

Unable to access timetable

In the 1st format of timetable I am able to store the timetable to data.txt

While in the 2nd format it generates an error

The error is following:

Add offline support - integrate with `Timetable`

If internet connection doesn't exist, store the event to be added to calendar in some json file. And later when there's internet connection, sync it to Google calendar.

Internet connection can be determined by posting a request to Google.com or something (neglecting the probability of Google's server being down) & checking it's response...

Also, is a terminal version of this possible for offline cases? I mean, can ALL the events be stored into json and be accessed with bash commands with tab auto_complete feature?

Make webapp

Current web app is based on the password model which will be replaced with the OCR model and hence we require a new web app.

Under this web app, the user will be able to submit an image and download the ICS file after all the backend work is done.

@ghostwriternr assign me please.

Fix oauth2client error in add_events.py

AttributeError: module 'oauth2client' has no attribute 'file'
while running add_event.py.
Modify add_events.py and del_events.py accordingly

Add more holidays

Currently the timeline only includes endsems and midsems. We can extend that to:

• Durga Pooja and other breaks mentioned in Academic Calendar
• Institute holidays from here. Possibly scrape them directly?

Timetable scraping throws error for misaligned ERP Timetable rows

Test case :

For roll number 14IE10029 , gyft.py fails with error Key error 7 for timetable_dict[days[i]] = {}. So, days is initialized from 1 to 6, and yet due to misalignment of rows in ERP timetable, it tries to access days[7] which throws an error.

Shift To Pipenv Standards

Python standard package manager is Pipenv now, and the gyft requirements should shift to it.

KWoC Project to look out

Unnecessary prompt for password while executing gyft.py

$ python gyft.py --help
Enter your ERP password:

Asking for the password in such scenario is totally irrelevant.

Make it image compatible

Currently we ask the user to input password and, for obvious reasons, it's a bad practice.

A better way to do this would be using OCR and identifying elements by reading the image of time table taken using any device, or in the very least, just the actual timetable.

@ghostwriternr Any other spec you'd like to see? Assign to me :)

User preference file

Add a user preference file which contains the semantics of the message to be added onto the Google Calendar. This will preferably be a yaml / json / md file - which will be gitignore-d.

class: "Class of "
lab: "Lab of "

On the web portal of gyft, this can be taken as input (rather than a file) from the user before syncing.

BUG: Unable to run `add_events.py`

The error is:

$ python3 add_events.py 
Traceback (most recent call last):
  File "add_events.py", line 6, in <module>
    from apiclient import discovery
ImportError: cannot import name 'discovery'

1. apiclient is not listed in the present requirements.txt file. I added the line apiclient==1.0.3 and then ran pip3 install -r requirements.txt

2. I tried to import "discovery" inside a Python 3 shell, but it didn't work there either. I think they have dropped this submodule (?)

This issue has been faced before: shazow/apiclient#9 (comment)

Also, the author says

Possibly? Though I don't recall there ever being a discovery submodule.

Honestly this library is not very maintained anymore. It's very simple in what it does, so I haven't touched > it in years.

So, maybe you can use another library or fix this.

cc @athityakumar @nishnik @DefCon-007

Enable gyft to create the recurrence schedule from given set of date and times

The script will begin with the following list of lists:

[ [ BEGIN_1, END_1 ], [ BEGIN_2, END_2 ], [ BEGIN_3, END_3 ], ...]

The events that are created will be created only in between these dates. i.e. timetable events won't be created for the time between END_1 and BEGIN_2 etc.

Once implemented, this can be easily improved to include both vacations (Durga Puja), mid-term, end-term, holidays (from the holiday list).

Do this in both the available flows:

• ICS generation
• Google Calendar Sync

Update the dates for 2020 Spring Semester

As is obvious by the name of the issue the repo needs to be updated with the dates of the 2020 spring semester.

The academic calendar for 19-20 can be found at http://www.iitkgp.ac.in/files/acad_cal1920.pdf

Del_events.py won't be able to select only gyft events

Previously, we searched for regex Class of or Lab of in del_events.py to choose only events added by gyft and then delete them. But after merging of PR #15 , this regex will no longer be valid. We need some other way to delete gyft events from Google Calendar.

Ping @icyflame @nishnik @DefCon-007 @kshitij10496

delete_events.py doesn't all events

I'm not sure what the problem is, but I think there is some API restriction or something, due to which the program ended (by Nov 11) , whereas it should have deleted all events till Nov 20.