Instructions to use Nexusflow/Starling-RM-34B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Nexusflow/Starling-RM-34B with Transformers:
# Load model directly from transformers import AutoTokenizer, LLMForSequenceRegression tokenizer = AutoTokenizer.from_pretrained("Nexusflow/Starling-RM-34B") model = LLMForSequenceRegression.from_pretrained("Nexusflow/Starling-RM-34B") - Notebooks
- Google Colab
- Kaggle
Could you share scripts for fast inference?
#3 opened about 2 years ago
by
chujiezheng
fastest inference
1
#2 opened about 2 years ago
by
ehartford
Bug with example code:
2
#1 opened about 2 years ago
by
Asaf-Yehudai