Llama Recipes

利用可组合的 FSDP 和 PEFT 方法对 Llama2 进行微调的脚本，以覆盖单节点/多节点 GPU。支持用于摘要和问题解答等应用的默认和自定义数据集。支持多种坦率推理解决方案，如用于本地或云部署的 HF TGI、VLLM。「Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger」