instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Organizations

None yet

models 5

instruction-pretrain/InstructLM-500M

Text Generation • 0.6B • Updated Mar 4 • 61 • 34

instruction-pretrain/InstructLM-1.3B

Text Generation • 1B • Updated Mar 4 • 52 • 43

instruction-pretrain/finance-Llama3-8B

Text Generation • 8B • Updated Mar 1 • 1.48k • • 71

instruction-pretrain/medicine-Llama3-8B

Text Generation • 8B • Updated Mar 1 • 76 • 38

instruction-pretrain/instruction-synthesizer

Text Generation • 7B • Updated Mar 1 • 71 • 79

datasets 3

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Mar 1 • 249k • 1.84k • 63

instruction-pretrain/medicine-instruction-augmented-corpora

Preview • Updated Mar 1 • 1.1k • 13

instruction-pretrain/general-instruction-augmented-corpora

Preview • Updated Mar 1 • 6.72k • 20