Add evaluation results on the samsum config of samsum

#1
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +38 -3
README.md CHANGED
@@ -5,15 +5,50 @@ tags:
5
  - booksum
6
  - long-document
7
  - long-form
8
- license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
12
  - kmfoda/booksum
13
  metrics:
14
  - rouge
15
- inference: False
16
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ---
18
 
19
 
 
5
  - booksum
6
  - long-document
7
  - long-form
8
+ license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
12
  - kmfoda/booksum
13
  metrics:
14
  - rouge
15
+ inference: false
16
+ model-index:
17
+ - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP13
18
+ results:
19
+ - task:
20
+ type: summarization
21
+ name: Summarization
22
+ dataset:
23
+ name: samsum
24
+ type: samsum
25
+ config: samsum
26
+ split: test
27
+ metrics:
28
+ - name: ROUGE-1
29
+ type: rouge
30
+ value: 24.4101
31
+ verified: true
32
+ - name: ROUGE-2
33
+ type: rouge
34
+ value: 5.003
35
+ verified: true
36
+ - name: ROUGE-L
37
+ type: rouge
38
+ value: 17.2544
39
+ verified: true
40
+ - name: ROUGE-LSUM
41
+ type: rouge
42
+ value: 20.9183
43
+ verified: true
44
+ - name: loss
45
+ type: loss
46
+ value: 3.194674015045166
47
+ verified: true
48
+ - name: gen_len
49
+ type: gen_len
50
+ value: 58.9951
51
+ verified: true
52
  ---
53
 
54