LLaMA-7B

Researchers propose REP-LIE, a pruning method that estimates weight importance from LoRA low-rank matrix gradients during finetuning, avoiding full gradient computation and prior finetuning. Tests on …

Gorilla, a large language model fine-tuned from LLaMA-7B on machine-generated instruction-API pairs, outperforms GPT-4 on the APIBench benchmark while reducing hallucinated API calls, according to Pat…

Researchers trained decoder-only transformers with up to 4 billion parameters on 1 trillion chronologically filtered tokens from FineWeb, producing monthly point-in-time language model checkpoints fro…