Text Generation
Transformers
Safetensors
mistral
Merge
mergekit
lazymergekit
Locutusque/TinyMistral-248M-v2-Instruct
text-generation-inference
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("balnazzar/Frankie-tiny")
model = AutoModelForCausalLM.from_pretrained("balnazzar/Frankie-tiny")Quick Links
Frankie-tiny
Frankie-tiny is a (franken)merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: Locutusque/TinyMistral-248M-v2-Instruct
layer_range: [0, 12]
- sources:
- model: Locutusque/TinyMistral-248M-v2-Instruct
layer_range: [8, 12]
merge_method: passthrough
dtype: float16
- Downloads last month
- 2
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="balnazzar/Frankie-tiny")