Commit
•
83b6426
1
Parent(s):
a400629
Update README.md
Browse files
README.md
CHANGED
|
@@ -40,6 +40,15 @@ The model shows improved proficiency with the Catalan language.
|
|
| 40 |
|
| 41 |
**License** The model uses the llama-3 license available at: [https://llama.meta.com/llama3/license](https://llama.meta.com/llama3/license)
|
| 42 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
### Use with transformers
|
| 44 |
|
| 45 |
See the snippet below for usage with Transformers:
|
|
|
|
| 40 |
|
| 41 |
**License** The model uses the llama-3 license available at: [https://llama.meta.com/llama3/license](https://llama.meta.com/llama3/license)
|
| 42 |
|
| 43 |
+
|
| 44 |
+
## Benchmarks
|
| 45 |
+
|
| 46 |
+
| Benchmark | Value |
|
| 47 |
+
| ------------------ | ------ |
|
| 48 |
+
| MMLU 5 shot | 47.34 |
|
| 49 |
+
| GSM8K cot 8 shot | 43.29 |
|
| 50 |
+
|
| 51 |
+
|
| 52 |
### Use with transformers
|
| 53 |
|
| 54 |
See the snippet below for usage with Transformers:
|