Kazuki Fujii's Projects
ゼロから作るシリーズにType Annotationをつけながら学習した記録です
『ゼロから作る Deep Learning ❷』(O'Reilly Japan, 2018)
『ゼロから作る Deep Learning ❸』(O'Reilly Japan, 2020)
O'REILY ゼロから作るDeep Learning
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Example models using DeepSpeed
Deployment Manager samples and templates.
Reference implementation for DPO (Direct Preference Optimization)
Documentation for Computer Science and Blog for Software Engineer Career
This repository is mainly for programming language specifications and tips
Example of using Epochraft to train HuggingFace transformers models with PyTorch FSDP
『実践Terraform』のサンプルコード
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Data-Centric FinGPT. Open-source for open finance! Revolutionize 🔥 We'll soon release the trained model.
Utilities for Training Very Large Models
Tokyo Institue of Technology Workshop on System Design 03
2021-3Q 関数型プログラミング (Tokyo Tech)
GIT: A Generative Image-to-text Transformer for Vision and Language
システム設計演習 Tokyo Institute of Technology
Instruction Tuning with GPT-4
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
Multi-GPU CUDA stress test
PyTorch bindings for CUTLASS grouped GEMM.
The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.
インプレス出版 Professional Python Software Design's Principles and Practices
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent