pshahid/customer_hunter

Use Social media analytics to find and convert dissatisfied customers

customer_hunter's Issues

Tweet stream fetch is null

When you first load the page in production sometimes the Tweet page is null. But it works again when you restart the core process.

Notifications

We need a UI and back-end portion for showing users what notifications they have, like new follows, favorites, etc.

Migrate to SQLAlchemy instead of Peewee

SQLAlchemy is a much better ORM for us, and it doesn't have some of the gotchas of Peewee. It's also better for production. But, the learning curve is steep so I gotta wait to do this, can't do it right now.

Allow users to auth to twitter from client-side with multiple accounts

A user must be able to login to any number of their Twitter accounts through our application and authorize it to do actions on their behalf.

Account page

Ability to change account information like username, password, email from when you're logged in to ML Systems.

Store lat, longs

Currently I'm pretty sure we don't store lat, longs in the data base. We need to get on that.

Boomer mentioned that it'd be useful to have the coords of users

Reply to status from stream

Users on the client should be able to reply to a twitter status via an input box. It should be similar to the twitter one, too, where it auto-formats tags, hashes and links.

We want the experience of this app similar to the twitter experience where things are auto-formatted when they're put in

Make ConsumerStrategy's consume methods fully asynchronous

Right now we're blocking whenever we call stream.next(). This is a problem, because it will block Twisted's eventloop from running. Instead, we should make the consume method asynchronous in the concrete strategy implementations

Write text and get images for consumer-facing website

For the consumer-facing website we need:

• Logo and color scheme
• Marketing material describing who we are, what we do, and any relevant information that -our own- potential customers should know
• Images for that marketing material (pls no stock photos if you can help it)

Occasionally doesn't remove a link

Sometimes we see a link being left in a status. I observed 2 instances of this in the wild, but it's hard to find. The conditions appear to be: when it's a retweet/reply, when there's 2 links, 1 is media and the other is an actual link.

Not really sure how to fix until I have more info.

Switch over to site/user streams instead of GetTimelines

We need to use site and user streams to stream in data for any particular connected client. Unfortunately, this is a lot more work on the back-end. The reason why it's necessary is to avoid being rate-limited by Twitter and also allowing us to stream data to users in real-time for their timelines instead of polling.

Saved searches and timeline columns

Similar to Tweetdeck we're going to add a column for saved searches and timelines for their logged in accounts. This will mimic the UI feel for Tweetdeck so it won't feel so foreign

Refactor out angular-ui-router

Angular-ui-router is fine, but we really don't need it and it was a mistake to include it in the first place. It ended up becoming an anti-pattern and difficult to remove since it was so ingrained. It needs to be removed in favor of ngRoute

Resume Tweet classification

The back-end needs to resume classifying tweets. At this point we need to send tweets to clients if they're classified '1' in the database.

Client-side (browser) drops websocket connection after ~5-7 min of inactivity

On appendixg.com server, using Nginx to serve static Test.html, something happens to the browser-side of the connection where it stops receiving events from the server.

I'm not sure as to why this is happening, it could be any of:

• Server drops connection due to TCP-level timeout (this may be an Nginx problem)
• Client drops server connection due to inactivity (Autobahn/server problem?)
• Callback dies in Twisted (seems unlikely due to the continuation of consumption)

This needs to be investigated and triaged so that it doesn't degrade user experience. As a workaround, consider using pings from the client side to give a heartbeat to the TCP connection such that it won't close after a given time.

Need to test this on localhost as well to see if it's just an nginx problem or a websocket problem.

Push out 10 of the most recent tweets when a user connects

Because that would be nice.

Run webapp in WSGI container with Twisted daemon (twistd)

Right now we're using Flask's development server, which is not the way to run in production. It's fine when we do it locally, but not when deployed.

Tweet table needs to be expanded

Expand the tweet table columns to include nearly every field captured by twitter. A lot of this metadata is useful to mine later on for analytics and it'd be better to store it.

Mongo service querying

Need to get our mongo query back in reverse-chronological order, and be able to use a cursor to cycle through data via infinite scroll on the client.

Incorporate Flask, use Twisted as WSGI container

For the Python back-end we need to incorporate the Flask webapp framework.

• Nginx will reverse proxy to the port that Flask is listening on localhost
• Flask should serve statics so we can use Jinja2 templates
• Twisted will be our WSGI container, and we should run it using twistd --web

Move WAMP Server out of core.py

Move it into its own python process. It's much easier to manage if we have multiple python processes doing their own things. Right now we have one which is the Flask webapp that serves the website and one that does both consuming and websocket serving. The websocket server needs to be its own thing.

Trained data set

We need to train the restaurant data set that we've been amassing. Accuracy is of paramount importance so it's good to start early on this. Don't rush it either.

Forgot password workflow

We need to add a workflow for when you forget your password.