Giter Site home page Giter Site logo

👋 Welcome to My GitHub Profile!

I'm Abhay Kumar, Principal Research Scientist at Yellow.ai, with a deep passion for training neural networks, particularly language models and large language models (LLMs). With over 8 years of experience in Data Science and NLP.

🌟 Highlights

  • Principal Research Scientist at Yellow.ai
  • Co-Author of Komodo LLM: An open-source, language-specific LLM for Indonesian.
  • 8+ years of experience in Data Science and NLP, with a focus on Language Modeling.

💡 Projects

  • Komodo LLM: A foundational large language model tailored for a specific language.
  • GPT2-TF: Implementation of GPT-2 in TensorFlow 2, recognized as the first repository for GPT-2 in TensorFlow 2.
  • miniLLama: A straightforward and compact implementation of the LLAMA Model, inspired by Andrej Karpathy's minGPT.

Abhay Kumar's Projects

bert icon bert

TensorFlow code and pre-trained models for BERT

bertviz icon bertviz

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

embedding-visualizer icon embedding-visualizer

Word and Position Embedding visualization of all pre-trained transformer models like BERT

manim icon manim

Animation engine for explanatory math videos

mingptf icon mingptf

A TF re-implementation of the Karpathy's minGPT (Generative Pretrained Transformer) training

minillama icon minillama

A simplified LLAMA implementation for training and inference tasks.

ndrm icon ndrm

A repository for Neural Document Ranking Models.

open-assistant icon open-assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

python-is-cool icon python-is-cool

Cool Python features for machine learning that I used to be too afraid to use

pytorch icon pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

setup.py icon setup.py

📦 A Human's Ultimate Guide to setup.py.

stanford_alpaca icon stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

tensorflow icon tensorflow

An Open Source Machine Learning Framework for Everyone

tftokenizers icon tftokenizers

Use Huggingface Transformer and Tokenizers as Tensorflow Reusable SavedModels

transformers icon transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.