matiasvinicius/reddit-in-portuguese

Autorship attribution using comments from brazillian subreddits

reddit-in-portuguese's Issues

Train and test machine learning models

Models:

• Logistic Regression
• Support Vector Machines
• Multinomial Naive Bayes
• Decision Tree
• Random Forest
• AdaBoost
• Gradient Boosting
• Stacking Classifier

Vectorization:

• Bag of Words with range -> (1,3)
• CountVectorizer of char with range -> (1,5), (4,5) e (3,8)
• Tf-idf of words with range -> (1,3)
• Tf-idf of char with range -> (1,5), (4,5) e (3,8)
• Train embeddings from corpus (word2vec)
• Use pre-trained embeddings (BERTimbau)
• Same aproaches for Part-of-Speech if viable

Make pipeline

Create a pipeline that includes preprocessing steps.
To verify in this issue (even if not necessary):

• Scaling / Standardization
• PCA (post vectorization)
• Detection of outliers
• Remove duplicates

Create database

Extract 20 authors from Reddit.
For each author, extract ~1000 comments
Save the comments and metadata in a CSV file

Train and test deep learning models

• MLP (texts Tf-idf)
• MLP (POS Tf-idf)
• MLP (concatenation of POS and text)
• LSTM (embeddings)
• CNN (embeddings)
• Complex architectures (CNN multichannel, LSTM+CNN, use POS etc)

Evaluation (pipeline)

• F1-score
• Accuracy
• Recall (macro, micro, weighted and by class)
• Precision (macro, micro, weighted and by class)
• Area under ROC