Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

#6
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -148,6 +148,39 @@ model-index:
148
  type: gen_len
149
  value: 243.3453
150
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
151
  ---
152
 
153
 
 
148
  type: gen_len
149
  value: 243.3453
150
  verified: true
151
+ - task:
152
+ type: summarization
153
+ name: Summarization
154
+ dataset:
155
+ name: kmfoda/booksum
156
+ type: kmfoda/booksum
157
+ config: kmfoda--booksum
158
+ split: test
159
+ metrics:
160
+ - name: ROUGE-1
161
+ type: rouge
162
+ value: 35.2043
163
+ verified: true
164
+ - name: ROUGE-2
165
+ type: rouge
166
+ value: 5.746
167
+ verified: true
168
+ - name: ROUGE-L
169
+ type: rouge
170
+ value: 15.6794
171
+ verified: true
172
+ - name: ROUGE-LSUM
173
+ type: rouge
174
+ value: 32.1129
175
+ verified: true
176
+ - name: loss
177
+ type: loss
178
+ value: 2.945225238800049
179
+ verified: true
180
+ - name: gen_len
181
+ type: gen_len
182
+ value: 307.5493
183
+ verified: true
184
  ---
185
 
186