--- base_model: - KatyTheCutie/LemonadeRP-4.5.3 base_model_relation: quantized pipeline_tag: text-generation library_name: safetensors tags: - exl3 - 4-bit - 6-bit - 8-bit --- # Original model: [LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3) by [KatyTheCutie](https://huggingface.co/KatyTheCutie) ## Available [ExLlamaV3](https://github.com/turboderp-org/exllamav3) 0.0.15 quants | Type | Size | CLI | |------|------|---------| | [H8-4.0BPW](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/tree/H8-4.0BPW) | 3.89 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/resolve/H8-4.0BPW/Download~KatyTheCutie_LemonadeRP-4.5.3_H8-4.0BPW_EXL3.bat) | | [H8-6.0BPW](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/tree/H8-6.0BPW) | 5.64 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/resolve/H8-6.0BPW/Download~KatyTheCutie_LemonadeRP-4.5.3_H8-6.0BPW_EXL3.bat) | | [H8-8.0BPW](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/tree/H8-8.0BPW) | 7.38 GB | [Copy-paste the line / Download the batch file](https://huggingface.co/DeathGodlike/LemonadeRP-4.5.3_EXL3/resolve/H8-8.0BPW/Download~KatyTheCutie_LemonadeRP-4.5.3_H8-8.0BPW_EXL3.bat) | ***Requirements: A python installation with huggingface-hub module to use CLI.***