outsider565/transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Hi there 👋

My name is Shaowen, and I am currently a graduate student at the Institute for Interdisciplinary Information Sciences (IIIS) at Tsinghua University. I had the privilege of obtaining my undergraduate degree in Computer Science from Fudan University.

You can view my cv here: linkedin

My past experience 👨‍🎓

• Interned at the Turing Artificial Intelligence Institute of Nanjing (2023.07 - 2024.06).
• Interned at Microsoft Research Asia (MSRA), working on information extraction from literature (2022.07-2023.06).
• Interned at Apple Shanghai, working on machine learning and data visualization (2022.01-2022.06).
• Developed an Y86-simulator using C++.
• Developed a front-end and back-end separated WeChat applet (微信小程序) using Golang and Docker.
• Engaged in research about NLP in UChicago CHAI lab.

My teaching ✒️

• TA of the object-oriented programming course.

My current work ⌚

• Currently at Tencent's Hunyuan Large Model Research, focusing on efficient fine-tuning and inference of large models, as well as long text processing.

My research interests 🔬

• Efficient fine-tuning and inference of large models.
• Long text processing.

My publications 📄

• Generative Table Pre-training Empowers Models for Tabular Prediction (EMNLP2023)
• LoRA-GA: Low-Rank Adaptation with Gradient Approximation

How to reach me 📭

• Email: [email protected] or [email protected]

Fun fact about me 🤣

• I am a photography lover.
• My favorite movie is Interstellar, and my favorite musical is Hamilton.
• I love talking with different people and making friends. Invite me to eat out!

Thank you for reading!