chintan2108/cyanokhoj

This is a web-app which employs the citizen science program by tracking their tweets and subsequent data analysis on Google Earth Engine, aimed at effective CyanoHAB detection and monitoring in water bodies around the world.

Hi there 👋 I'm Chintan B. Maniyar!

• 🔭 Currently working on: Global Water Quality Analysis using Remote Sensing (CyanoHABs, Salinity, TSS Modeling)
• 🌱 Currently learning: Deep learning, Computer Vision, NLP and Geography.
• 👯 Looking to collaborate with AI/ML/DL and/or Water Quality enthusiasts in the Remote Sensing Community.
• ⚡ My Interests: Biophysical Modeling, Satellite Image Processing, Machine/Deep Learning, NLP, Google Earth Engine, Environment Conservation, Astronomy ✨
• 📫 How to reach me: Mail or LinkedIn

---

cyanokhoj's Issues

Fix Frontend List View for list of locations and tweets

• For the list of tweet locations and the list of tweet links, the columns contents are contiguously overflowing from one to another

• This results in a list item broken down - a part of it as last element of nth column and the remaining part as the first element of (n+1)th column

• This also causes mismanagement of URLs

• List Issue 1
  

• List Issue 2
  

• Fix the issue and prevent the breaking down of list items

User Registration and Database Connectivity

• Currently the users are static and there is no database connectivity

• Develop a registration form for new users
• Ask for full name and email id
• Set email id as username and ask for password
• Verify user email by url (Prevent login unless verified)
• Store user details in the database
• Sign in with Google (OAuth2)

Bug: Default server does not redirect to index.php

• Currently website URI http://34.67.7.17/CyanoKhoj
• An index page is already present
• Despite that, whenever the URI is pinged, the redirect is made to the db-error page

• Fix the routing bug so that the URI ping redirects to the index page

Enhance flash message UI on incorrect credentials and logout

• Currently JS alert is used on events of incorrect credentials on login and logout events.

• Create a favorable UI for the same, preferably a flash modal window.

Create and deploy gitignored pipeline to handle sensitive data

• Currently the Google Maps key is exposed in the index.php file on GitHub

• Add a config file in the remote root and store the API keys in it and refer them from the config file in the prod files.

• GitIgnore the config file

Flag/Remove tweets with invalid locations

• Currently the tweets are being filtered using a specific set of keywords
• However, not all filtered tweets have valid locations - a few of them sometimes have invalid locations such as "Earth" etc. These cannot be geocoded correctly and can result into a false potential CyanoHAB location. To solve this issue update this file.

• Identify tweets with such invalid locations and flag them

• Attempt retrieving correct locations from the flagged tweets and report the results

• NOTE: This issue is congruent with issue #8. All changes here should be reflected in this file as well.

Improvements in UI/UX

• General Improvements in the UI/UX of the website are welcome

Make the webapp responsive and mobile-friendly

• Bootstrap enhancements
• UI Improvement
• Content Placement

Not able to enter the password field - Bug

• Currently on the login page the focus is always set on the username field
• Because of this, when the user clicks on the password field, it again goes back to the username field
• Input can be entered in the password field only by using 'Shift' button in the keyboard to navigate to the password field as this does not toggle the focus flag.

• Fix the bug for focus always on username

Update RTDBMS to Firebase

• Currently website hosted on GCP vm
• No database configured for now

• Refer to this MySQL schema and imitate the same in Firebase
• Connect the Firebase db with GCP vm (where CyanoKhoj is hosted) as RTDBMS

Develop a real time tweet scraper and store scraped tweets in real time

• Enhancement to this project as a part of Location Fetcher v1.8
• The above repo already scrapes the tweets in real time (live) and creates a stream of the filtered tweets
• Figure out a way to store this stream - the collection should go on, a file should be saved on disk, appended to every 5 mins or so with the new incoming tweets

Add functionality to close vertical dropdown on clicking outside of it

• Currently the vertical dropdown (containing the internal links and logout button) closes only when clicked on the 'x' or the 'close' option

• Add functionality to close it, when there is a click anywhere outside the dropdown

• Add a slide out from side or slide down from top as it opens

• Add a slide in to side or slide up to top as it closes

Fix icon for show/hide password toggle - Bug

• Currently the show/hide password icon does not toggle - even when clicked to show the password, the icon remains the same instead of a crossed eye

• Fix the bug by adding toggle icon logic on click events to toggle between show/hide password

Minor UI fixes

• Fix icon and text spacing

• Tweet List Alignment

Validations for the user registration form

• Use Client Side Scripting to validate the user registration form from issue #5

Create a modal for user profile information

• There is a link for User Profile in the vertical dropdown

• Create a modal that would pop up on clicking that link

• The modal will contain user profile information

• The background (everything behind the modal) should either be dimmed or blurred - you can use z-index or animation

• Clicking anywhere outside the modal should close it

• The modal should also have a X symbol or a 'Close' button for closing it

Add new keywords for tweet filtering

• Currently the tweets are being filtered using a set of keywords

• Update that set of keywords in the tweet_tracker.py file with the one below:
  BlueGreenAlgae, CyanoBacteria, cyanotracker, anabaena, microcystis, cyanotoxins, toxic algae, algae bloom, algal bloom, '#CyanoBacteria', '#AlgaeBloom', '#CyanoBacteriaBlooms', '#CyanoHABs', '#HABs'

Have a 404 page when site is not reachable

• Currently no 404 page is available in case site is down or unreachable
• A similar error routing has been done in PR #35 in case of db fault

• Create a 404 error page for whenever site is unreachable

Create dummy login credentials for Demo

• Currently website configured for a live database
• It is not possible to have a demo of the website with static dummy credentials

• Create dummy credentials for login purpose
  • User email: [email protected]
  • Password: admin
• Restructure database fetch requests - void any such requests in case of login with dummy credentials
• Update the readme with the new login information
• Link the fix of this issue with issue #43

Add NLP based analysis for Tweet Scraping in the ReadMe

• CyanoKhoj will refine its NLP based approach as mentioned in issue #9

• Conduct experiments using metrics of WMD, Relaxed WMD, Cosine similarity, soft cosine similarity
• Perform a comparative analysis of all metrics for relevant and effective tweet filtering
• Update the readme with various distance metric comparisons and their inferences

• Once this issue is closed, then only proceed to issue #9

API and request management on GCP

• Employ an algorithm similar to page ranking, to manage simultaneous webapp calls to the GCP vm and the consequent API calls for the Google map to avoid timeouts.

Embed tweets within the homepage

• Currently links are being provided to relevant tweets (see snapshot)

• Find a way to embed these tweets within the webpage (all tweets together in a single stream) instead of the user having to click on the link and open a new webpage

UI/UX Enhancements in the Login Page

• General UI/UX enhancements for the login page
• Add toggle for show/hide password

Use NLP to better filter tweets based on keywords

• Currently the words are being filtered using keyword matching Code here
• This approach simply looks for the exact keywords in the tweets and filters them
• It is always possible that some tweets may contain some keywords which might have a similar meaning to algae bloom (such as eutrophication) but are not the exact same
• Such tweets while important are not filtered and instead missed out
• Use NLP and word embedding concepts to process the tweet content and find similarity with the keywords so that the tweets having words which have similar meaning to keywords but are not exact keywords are not missed out