pszemraj autoevaluator HF staff commited on
Commit
17c347a
1 Parent(s): 92f4b6b

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum (#2)

Browse files

- Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum (e0298e9ecd2219d029821b126431ab790b77a5db)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -49,6 +49,39 @@ model-index:
49
  type: gen_len
50
  value: 52.0
51
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
  ---
53
 
54
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15
 
49
  type: gen_len
50
  value: 52.0
51
  verified: true
52
+ - task:
53
+ type: summarization
54
+ name: Summarization
55
+ dataset:
56
+ name: kmfoda/booksum
57
+ type: kmfoda/booksum
58
+ config: kmfoda--booksum
59
+ split: test
60
+ metrics:
61
+ - name: ROUGE-1
62
+ type: rouge
63
+ value: 35.3305
64
+ verified: true
65
+ - name: ROUGE-2
66
+ type: rouge
67
+ value: 5.8001
68
+ verified: true
69
+ - name: ROUGE-L
70
+ type: rouge
71
+ value: 16.0557
72
+ verified: true
73
+ - name: ROUGE-LSUM
74
+ type: rouge
75
+ value: 32.3409
76
+ verified: true
77
+ - name: loss
78
+ type: loss
79
+ value: 3.0063540935516357
80
+ verified: true
81
+ - name: gen_len
82
+ type: gen_len
83
+ value: 268.4032
84
+ verified: true
85
  ---
86
 
87
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15