mwitiderrick
/

open_llama_3b_glaive_code_v0.1

Text Generation

Eval Results (legacy)

text-generation-inference

Model card Files Files and versions

mwitiderrick commited on Dec 19, 2023

Commit

1d15734

·

1 Parent(s): 104bc94

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -47,7 +47,7 @@ model-index:
         metrics:
           - name: arc_challenge(0-Shot)
             type: arc_challenge (0-Shot)
-            value: 0.
         source:
           name: open_llama_3b_instruct_v_0.2 model card
           url: https://huggingface.co/mwitiderrick/open_llama_3b_instruct_v_0.2
@@ -118,4 +118,8 @@ def quick_sort(arr):
 |  Tasks   |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |----------|-------|------|-----:|------|-----:|---|-----:|
 |winogrande|Yaml   |none  |     0|acc   |0.6322|±  |0.0136|
 ```

         metrics:
           - name: arc_challenge(0-Shot)
             type: arc_challenge (0-Shot)
+            value: 0.3447
         source:
           name: open_llama_3b_instruct_v_0.2 model card
           url: https://huggingface.co/mwitiderrick/open_llama_3b_instruct_v_0.2
 |  Tasks   |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |----------|-------|------|-----:|------|-----:|---|-----:|
 |winogrande|Yaml   |none  |     0|acc   |0.6322|±  |0.0136|
+|    Tasks    |Version|Filter|n-shot| Metric |Value |   |Stderr|
+|-------------|-------|------|-----:|--------|-----:|---|-----:|
+|arc_challenge|Yaml   |none  |     0|acc     |0.3234|±  |0.0137|
+|             |       |none  |     0|acc_norm|0.3447|±  |0.0139|
 ```