bramvanroy Goto Github PK

alignment-handbook

Robust recipes to align language models with human and AI preferences

astred

An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For instance useful for comparing a translation with the original text, to find differences and similarities between two different translations, or to see how a machine translation differs from a reference translation.

astred-demo

Demo app to illustrate ASTrED

awesome-align

A word aligner based on multilingual encoders

bert-for-inference

A small repo showing how to easily use BERT (or other transformers) for inference

bicorpus-preprocessing

bitsandbytes

8-bit CUDA functions for PyTorch

blog

Public repo for HF blog posts

bramvanroy.github.io

character

charcut

Character-based MT evaluation and difference highlighting

clin33-zero-shot

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

distilabel

Distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency

distilabel-helm-instruct-adaptable-evaluation-criteria

A repo that implements Stanford CRFM their HELM Instruct with adaptable evaluation criteria

dutch-instruction-datasets

eamt2022-proceedings

Proceedings of EAMT 2022 (23rd Annual Conference of the European Association for Machine Translation)

ebook-to-txt

Extract text from eBooks with Python

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

fietje

An open, efficient LLM for Dutch

gutenberg-processing

lecontra

llm-finetuning

lm-evaluation-harness

lt3-2019-transformer-trainer

Transformer trainer for variety of classification problems that has been used in-house at LT3 for different research topics.

mai-simplification-nl-2023

Sentence-Level Text Simplification for Dutch

mantis

Segmentation interface for the TPR-DB to manually tokenize and sentence segment

mateo-demo

MAchine Translation Evaluation Online (MATEO)

mbart-benchmark

Benchmarking throughput of MBART