loubb
/

aria-medium-embedding

Model card Files Files and versions

aria-medium-embedding / tokenizer_config.json

loubb's picture

Upload folder using huggingface_hub

e51eaf7 verified 8 months ago

194 Bytes

	{
	"add_eos_token": true,
	"add_dim_token": false,
	"auto_map": {
	"AutoTokenizer": [
	"tokenization_aria.AriaTokenizer",
	null
	]
	},
	"tokenizer_class": "AriaTokenizer"
	}