yansenhan/nlp.word_embedding

This repository is for independent project on Recent Development in Word Embedding, supervised by Prof. Nevin Zhang.

NLP.Word_Embedding

This repository is for independent project on Recent Developments in Word Embedding, directed by Prof. Nevin Zhang. My independent project is to enhance my understanding of word embedding models, like skip-gram model and GloVe model, by reimplementing those two models. Secondly, I try out some chatbot codes and build a warm chatbot to relief upset people. Finally, I summarize some papers to answer two questions "What kind of space should the languages in?" and "What kind of operator should be used in word embedding?".

Report Here !

Project Details

PART I: The Reimplements of Classical Word Embeddings Models

Project Architecture:

• Data Source: text8.zip
• Google Implementation of GloVe Model: Google GloVe Model Code
• Code - PART I: Skip-gram model and GloVe model in TensorFlow

PART II: Warm ChatBot (Seq2seq)

• Data Source: STC3
• Code - PART II: Warm ChatBot. The final result is very frustrating.
• The code is mainly from the Pytorch tutorial. I only change the dataset and make a little modification.

PART III: Papers Review

• Report
• Presentation Slides

Results

GloVe Word Embeddings (PCA)

Stupid Warm ChatBot

Acknowledgement

I am very grateful to Prof. Nevin Zhang and my friends. Thanks a lot for your support and help.