Translation
Transformers
PyTorch
TensorFlow
JAX
Rust
ONNX
Safetensors
t5
text2text-generation
summarization
text-generation-inference
Instructions to use google-t5/t5-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google-t5/t5-small with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="google-t5/t5-small")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("google-t5/t5-small") model = AutoModelForSeq2SeqLM.from_pretrained("google-t5/t5-small") - Inference
- Notebooks
- Google Colab
- Kaggle
It seems `T5WithLMHead` is outdated
Browse filesLeaving it for potential older versions of the lib.
But adding it so that `infer_framework_load_model` from the pipeline can load the model directly without needing to refer to the pipeline task.
https://github.com/huggingface/transformers/blob/main/src/transformers/models/t5/modeling_t5.py#L1466
- config.json +2 -1
config.json
CHANGED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
{
|
| 2 |
"architectures": [
|
| 3 |
-
"T5WithLMHeadModel"
|
|
|
|
| 4 |
],
|
| 5 |
"d_ff": 2048,
|
| 6 |
"d_kv": 64,
|
|
|
|
| 1 |
{
|
| 2 |
"architectures": [
|
| 3 |
+
"T5WithLMHeadModel",
|
| 4 |
+
"T5ForConditionalGeneration"
|
| 5 |
],
|
| 6 |
"d_ff": 2048,
|
| 7 |
"d_kv": 64,
|