profatxuanall/language-model-playground

Language model implementation using PyTorch.

language-model-playground's Issues

Log learning rate for ddp.

run_perplexity_evaluation.py small error

parser.add_argument(
        '--dataset',
        help='Current experiment name.',
        required=True,
        type=str,
    )

dataset's help seems wrong
I guess it should be "Name of the dataset to perform experiment."

Raising error when max sequence length is -1

language-model-playground/lmp/script/generate_text.py

Line 109 in 701dd74

max_seq_len=model_cfg.max_seq_len,

Python implement `list` using array of pointer

language-model-playground/lmp/tokenizer/_base_list_tokenizer.py

Line 33 in be13bcb

single head linked list to implement `list`. But using `list` will

Python implement list using array of pointer, so the comment is incorrect.