Qubitium commited on
Commit
e5bccf7
·
verified ·
1 Parent(s): 756d7b5

FIX compat with HF transformers save

Browse files

Latest transformers (4.49.0), likely earlier versions too, will now validate the generation config file and since `top_k` and `temperature` non-default values are set, `do_sample` must be set to `True` or eles this configuration is self-conflicting.

Files changed (1) hide show
  1. generation_config.json +1 -1
generation_config.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "max_new_tokens": 1000,
3
- "do_sample": false,
4
  "use_cache": true,
5
  "temperature": 0.3,
6
  "top_k": 5,
 
1
  {
2
  "max_new_tokens": 1000,
3
+ "do_sample": true,
4
  "use_cache": true,
5
  "temperature": 0.3,
6
  "top_k": 5,