EryriLabs commited on
Commit
a228e8c
·
verified ·
1 Parent(s): 4fd0382

session 5 artefact: artifacts/session5/session.log

Browse files
Files changed (1) hide show
  1. artifacts/session5/session.log +649 -0
artifacts/session5/session.log ADDED
@@ -0,0 +1,649 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0
  ...ev/session5_artifacts.tgz: 1%| | 524kB / 56.1MB 
 
 
1
  ...ev/session5_artifacts.tgz: 1%| | 524kB / 56.1MB 
 
 
 
2
  ...ev/session5_artifacts.tgz: 11%|█ | 6.29MB / 56.1MB 
 
 
 
3
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
 
4
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
5
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
6
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
7
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
8
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
9
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
10
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
11
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
12
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
 
 
13
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB 
 
 
 
 
 
 
 
 
 
14
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB 
 
 
 
 
 
 
15
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB
 
1
+ seed_mode=pad canvas=64 layers=0.5,0.75
2
+ WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
3
+ WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
4
+ WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
5
+ /usr/local/lib/python3.12/dist-packages/huggingface_hub/constants.py:302: FutureWarning: The `HF_HUB_ENABLE_HF_TRANSFER` environment variable is deprecated as 'hf_transfer' is not used anymore. Please use `HF_XET_HIGH_PERFORMANCE` instead to enable high performance transfer with Xet. Visit https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfxethighperformance for more details.
6
+ warnings.warn(
7
+ torch 2.9.1+cu128 cuda True transformers 5.17.0
8
+ gpu NVIDIA A100-SXM4-80GB 79 GiB
9
+ /usr/local/lib/python3.12/dist-packages/huggingface_hub/constants.py:302: FutureWarning: The `HF_HUB_ENABLE_HF_TRANSFER` environment variable is deprecated as 'hf_transfer' is not used anymore. Please use `HF_XET_HIGH_PERFORMANCE` instead to enable high performance transfer with Xet. Visit https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfxethighperformance for more details.
10
+ warnings.warn(
11
+
12
+ /root/.cache/huggingface/hub/models--google--diffusiongemma-26B-A4B-it/snapshots/f7f5b7f5fa82ffc52addd066915886d497f5517b
13
+ ...................................... [100%]
14
+
15
+
16
+
17
+
18
+
19
+
20
+
21
+
22
+
23
+ skip chaosnli/train: Unknown split "train". Should be one of ['test'].
24
+ skip chaosnli/validation: Unknown split "validation". Should be one of ['test'].
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+
41
+
42
+
43
+
44
+
45
+
46
+
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+
71
+
72
+
73
+ {
74
+ "train": 6465,
75
+ "validation": 1920,
76
+ "test_td": 400,
77
+ "test_jb": 3800,
78
+ "train_sha": "aab43bbb532c3702",
79
+ "validation_sha": "310b38638723d58e",
80
+ "test_td_sha": "189f14ce869a9bba",
81
+ "test_jb_sha": "f15f0bb601f6cf3d",
82
+ "revisions": {
83
+ "LocalLLaMA/typed-decisions": "f7a2487edd7a043a5441a5e9ccc7fe5ddbd9ebe8",
84
+ "Praveenrajus/jev-bench": "18f88da81c28c2bec55edc31f63f2afdfba109ea"
85
+ }
86
+ }
87
+ skip chaosnli/train: Unknown split "train". Should be one of ['test'].
88
+ skip chaosnli/validation: Unknown split "validation". Should be one of ['test'].
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+
98
+
99
+ {
100
+ "train_g": 8135,
101
+ "validation_g": 1750,
102
+ "converted": {
103
+ "banking77": {
104
+ "train": 630,
105
+ "validation": 70,
106
+ "bare": 272
107
+ },
108
+ "clinc150": {
109
+ "train": 720,
110
+ "validation": 80,
111
+ "bare": 318
112
+ },
113
+ "dbpedia": {
114
+ "train": 360,
115
+ "validation": 40,
116
+ "bare": 151
117
+ },
118
+ "ag_news": {
119
+ "train": 270,
120
+ "validation": 30,
121
+ "bare": 130
122
+ },
123
+ "snips": {
124
+ "train": 270,
125
+ "validation": 30,
126
+ "bare": 118
127
+ }
128
+ },
129
+ "train_g_sha": "1fa09f480dadf824",
130
+ "validation_g_sha": "a61a79e720e30441",
131
+ "revisions": {
132
+ "Praveenrajus/jev-bench": "18f88da81c28c2bec55edc31f63f2afdfba109ea",
133
+ "clinc/clinc_oos": "155b9c710419136e17307b80d0a13e68cd46b4ec",
134
+ "fancyzhx/ag_news": "eb185aade064a813bc0b7f42de02595523103ca4",
135
+ "fancyzhx/dbpedia_14": "9abd46cf7fc8b4c64290f26993c540b92aa145ac",
136
+ "legacy-datasets/banking77": "f54121560de48f2852f90be299010d1d6dc612ec",
137
+ "sonos-nlu-benchmark/snips_built_in_intents": "7a3f9329f396a746c867f370c7ab210dff9c789b"
138
+ }
139
+ }
140
+ fast-decisions manifest: 1700 examples
141
+
142
+
143
+ warning: several final-norm candidates, using the last; encoder ['model.encoder.language_model.norm'], decoder ['model.decoder.self_conditioning.pre_norm', 'model.decoder.self_conditioning.post_norm', 'model.decoder.norm']
144
+ 50/8135 examples, 18s
145
+ 100/8135 examples, 36s
146
+ 150/8135 examples, 54s
147
+ 200/8135 examples, 72s
148
+ 250/8135 examples, 89s
149
+ 300/8135 examples, 106s
150
+ 350/8135 examples, 123s
151
+ 400/8135 examples, 141s
152
+ 450/8135 examples, 159s
153
+ 500/8135 examples, 177s
154
+ 550/8135 examples, 195s
155
+ 600/8135 examples, 214s
156
+ 650/8135 examples, 232s
157
+ 700/8135 examples, 250s
158
+ 750/8135 examples, 268s
159
+ 800/8135 examples, 286s
160
+ 850/8135 examples, 304s
161
+ 900/8135 examples, 322s
162
+ 950/8135 examples, 340s
163
+ 1000/8135 examples, 359s
164
+ 1050/8135 examples, 377s
165
+ 1100/8135 examples, 395s
166
+ 1150/8135 examples, 414s
167
+ 1200/8135 examples, 432s
168
+ 1250/8135 examples, 452s
169
+ 1300/8135 examples, 472s
170
+ 1350/8135 examples, 492s
171
+ 1400/8135 examples, 512s
172
+ 1450/8135 examples, 532s
173
+ 1500/8135 examples, 552s
174
+ 1550/8135 examples, 572s
175
+ 1600/8135 examples, 591s
176
+ 1650/8135 examples, 611s
177
+ 1700/8135 examples, 632s
178
+ 1750/8135 examples, 652s
179
+ 1800/8135 examples, 672s
180
+ 1850/8135 examples, 692s
181
+ 1900/8135 examples, 712s
182
+ 1950/8135 examples, 731s
183
+ 2000/8135 examples, 751s
184
+ 2050/8135 examples, 771s
185
+ 2100/8135 examples, 791s
186
+ 2150/8135 examples, 811s
187
+ 2200/8135 examples, 830s
188
+ 2250/8135 examples, 849s
189
+ 2300/8135 examples, 868s
190
+ 2350/8135 examples, 887s
191
+ 2400/8135 examples, 906s
192
+ 2450/8135 examples, 925s
193
+ 2500/8135 examples, 944s
194
+ 2550/8135 examples, 963s
195
+ 2600/8135 examples, 982s
196
+ 2650/8135 examples, 1002s
197
+ 2700/8135 examples, 1022s
198
+ 2750/8135 examples, 1040s
199
+ 2800/8135 examples, 1058s
200
+ 2850/8135 examples, 1076s
201
+ 2900/8135 examples, 1094s
202
+ 2950/8135 examples, 1112s
203
+ 3000/8135 examples, 1131s
204
+ 3050/8135 examples, 1150s
205
+ 3100/8135 examples, 1169s
206
+ 3150/8135 examples, 1188s
207
+ 3200/8135 examples, 1206s
208
+ 3250/8135 examples, 1224s
209
+ 3300/8135 examples, 1242s
210
+ 3350/8135 examples, 1261s
211
+ 3400/8135 examples, 1279s
212
+ 3450/8135 examples, 1298s
213
+ 3500/8135 examples, 1316s
214
+ 3550/8135 examples, 1334s
215
+ 3600/8135 examples, 1352s
216
+ 3650/8135 examples, 1371s
217
+ 3700/8135 examples, 1390s
218
+ 3750/8135 examples, 1408s
219
+ 3800/8135 examples, 1427s
220
+ 3850/8135 examples, 1446s
221
+ 3900/8135 examples, 1465s
222
+ 3950/8135 examples, 1484s
223
+ 4000/8135 examples, 1502s
224
+ 4050/8135 examples, 1521s
225
+ 4100/8135 examples, 1539s
226
+ 4150/8135 examples, 1558s
227
+ 4200/8135 examples, 1577s
228
+ 4250/8135 examples, 1595s
229
+ 4300/8135 examples, 1614s
230
+ 4350/8135 examples, 1632s
231
+ 4400/8135 examples, 1650s
232
+ 4450/8135 examples, 1668s
233
+ 4500/8135 examples, 1687s
234
+ 4550/8135 examples, 1704s
235
+ 4600/8135 examples, 1722s
236
+ 4650/8135 examples, 1741s
237
+ 4700/8135 examples, 1759s
238
+ 4750/8135 examples, 1778s
239
+ 4800/8135 examples, 1797s
240
+ 4850/8135 examples, 1817s
241
+ 4900/8135 examples, 1836s
242
+ 4950/8135 examples, 1854s
243
+ 5000/8135 examples, 1873s
244
+ 5050/8135 examples, 1893s
245
+ 5100/8135 examples, 1912s
246
+ 5150/8135 examples, 1931s
247
+ 5200/8135 examples, 1951s
248
+ 5250/8135 examples, 1970s
249
+ 5300/8135 examples, 1989s
250
+ 5350/8135 examples, 2008s
251
+ 5400/8135 examples, 2026s
252
+ 5450/8135 examples, 2045s
253
+ 5500/8135 examples, 2064s
254
+ 5550/8135 examples, 2083s
255
+ 5600/8135 examples, 2102s
256
+ 5650/8135 examples, 2121s
257
+ 5700/8135 examples, 2140s
258
+ 5750/8135 examples, 2158s
259
+ 5800/8135 examples, 2177s
260
+ 5850/8135 examples, 2197s
261
+ 5900/8135 examples, 2216s
262
+ 5950/8135 examples, 2235s
263
+ 6000/8135 examples, 2253s
264
+ 6050/8135 examples, 2272s
265
+ 6100/8135 examples, 2292s
266
+ 6150/8135 examples, 2311s
267
+ 6200/8135 examples, 2329s
268
+ 6250/8135 examples, 2348s
269
+ 6300/8135 examples, 2366s
270
+ 6350/8135 examples, 2385s
271
+ 6400/8135 examples, 2404s
272
+ 6450/8135 examples, 2422s
273
+ 6500/8135 examples, 2440s
274
+ 6550/8135 examples, 2459s
275
+ 6600/8135 examples, 2477s
276
+ 6650/8135 examples, 2496s
277
+ 6700/8135 examples, 2516s
278
+ 6750/8135 examples, 2535s
279
+ 6800/8135 examples, 2553s
280
+ 6850/8135 examples, 2572s
281
+ 6900/8135 examples, 2591s
282
+ 6950/8135 examples, 2609s
283
+ 7000/8135 examples, 2627s
284
+ 7050/8135 examples, 2646s
285
+ 7100/8135 examples, 2664s
286
+ 7150/8135 examples, 2684s
287
+ 7200/8135 examples, 2703s
288
+ 7250/8135 examples, 2722s
289
+ 7300/8135 examples, 2741s
290
+ 7350/8135 examples, 2761s
291
+ 7400/8135 examples, 2780s
292
+ 7450/8135 examples, 2800s
293
+ 7500/8135 examples, 2819s
294
+ 7550/8135 examples, 2837s
295
+ 7600/8135 examples, 2855s
296
+ 7650/8135 examples, 2873s
297
+ 7700/8135 examples, 2892s
298
+ 7750/8135 examples, 2911s
299
+ 7800/8135 examples, 2931s
300
+ 7850/8135 examples, 2950s
301
+ 7900/8135 examples, 2968s
302
+ 7950/8135 examples, 2987s
303
+ 8000/8135 examples, 3006s
304
+ 8050/8135 examples, 3024s
305
+ 8100/8135 examples, 3043s
306
+ {
307
+ "examples": 8135,
308
+ "decisions": 8135,
309
+ "seed_mode": "pad",
310
+ "canvas_length": 64,
311
+ "seconds": 3056.4,
312
+ "feature_dim": 8448,
313
+ "encoder_norm": "model.encoder.language_model.norm",
314
+ "decoder_norm": "model.decoder.norm",
315
+ "hidden_size": 2816,
316
+ "extra_layers": {
317
+ "encoder": [
318
+ "model.encoder.language_model.layers.14",
319
+ "model.encoder.language_model.layers.22"
320
+ ],
321
+ "decoder": [
322
+ "model.decoder.layers.14",
323
+ "model.decoder.layers.22"
324
+ ]
325
+ }
326
+ }
327
+ zero_shot pad 0.7855
328
+
329
+
330
+ warning: several final-norm candidates, using the last; encoder ['model.encoder.language_model.norm'], decoder ['model.decoder.self_conditioning.pre_norm', 'model.decoder.self_conditioning.post_norm', 'model.decoder.norm']
331
+ 50/1750 examples, 18s
332
+ 100/1750 examples, 37s
333
+ 150/1750 examples, 58s
334
+ 200/1750 examples, 77s
335
+ 250/1750 examples, 97s
336
+ 300/1750 examples, 116s
337
+ 350/1750 examples, 136s
338
+ 400/1750 examples, 156s
339
+ 450/1750 examples, 176s
340
+ 500/1750 examples, 196s
341
+ 550/1750 examples, 216s
342
+ 600/1750 examples, 236s
343
+ 650/1750 examples, 255s
344
+ 700/1750 examples, 275s
345
+ 750/1750 examples, 295s
346
+ 800/1750 examples, 315s
347
+ 850/1750 examples, 335s
348
+ 900/1750 examples, 355s
349
+ 950/1750 examples, 374s
350
+ 1000/1750 examples, 394s
351
+ 1050/1750 examples, 414s
352
+ 1100/1750 examples, 434s
353
+ 1150/1750 examples, 453s
354
+ 1200/1750 examples, 472s
355
+ 1250/1750 examples, 491s
356
+ 1300/1750 examples, 511s
357
+ 1350/1750 examples, 530s
358
+ 1400/1750 examples, 550s
359
+ 1450/1750 examples, 570s
360
+ 1500/1750 examples, 590s
361
+ 1550/1750 examples, 609s
362
+ 1600/1750 examples, 629s
363
+ 1650/1750 examples, 648s
364
+ 1700/1750 examples, 668s
365
+ 1750/1750 examples, 688s
366
+ {
367
+ "examples": 1750,
368
+ "decisions": 1750,
369
+ "seed_mode": "pad",
370
+ "canvas_length": 64,
371
+ "seconds": 687.7,
372
+ "feature_dim": 8448,
373
+ "encoder_norm": "model.encoder.language_model.norm",
374
+ "decoder_norm": "model.decoder.norm",
375
+ "hidden_size": 2816,
376
+ "extra_layers": {
377
+ "encoder": [
378
+ "model.encoder.language_model.layers.14",
379
+ "model.encoder.language_model.layers.22"
380
+ ],
381
+ "decoder": [
382
+ "model.decoder.layers.14",
383
+ "model.decoder.layers.22"
384
+ ]
385
+ }
386
+ }
387
+ zero_shot pad 0.7640
388
+
389
+
390
+ warning: several final-norm candidates, using the last; encoder ['model.encoder.language_model.norm'], decoder ['model.decoder.self_conditioning.pre_norm', 'model.decoder.self_conditioning.post_norm', 'model.decoder.norm']
391
+ 50/400 examples, 19s
392
+ 100/400 examples, 37s
393
+ 150/400 examples, 57s
394
+ 200/400 examples, 76s
395
+ 250/400 examples, 96s
396
+ 300/400 examples, 116s
397
+ 350/400 examples, 136s
398
+ 400/400 examples, 156s
399
+ {
400
+ "examples": 400,
401
+ "decisions": 2000,
402
+ "seed_mode": "pad",
403
+ "canvas_length": 64,
404
+ "seconds": 156.0,
405
+ "feature_dim": 8448,
406
+ "encoder_norm": "model.encoder.language_model.norm",
407
+ "decoder_norm": "model.decoder.norm",
408
+ "hidden_size": 2816,
409
+ "extra_layers": {
410
+ "encoder": [
411
+ "model.encoder.language_model.layers.14",
412
+ "model.encoder.language_model.layers.22"
413
+ ],
414
+ "decoder": [
415
+ "model.decoder.layers.14",
416
+ "model.decoder.layers.22"
417
+ ]
418
+ }
419
+ }
420
+ zero_shot pad 0.7080
421
+
422
+
423
+ warning: several final-norm candidates, using the last; encoder ['model.encoder.language_model.norm'], decoder ['model.decoder.self_conditioning.pre_norm', 'model.decoder.self_conditioning.post_norm', 'model.decoder.norm']
424
+ 50/3800 examples, 18s
425
+ 100/3800 examples, 35s
426
+ 150/3800 examples, 53s
427
+ 200/3800 examples, 71s
428
+ 250/3800 examples, 89s
429
+ 300/3800 examples, 108s
430
+ 350/3800 examples, 127s
431
+ 400/3800 examples, 145s
432
+ 450/3800 examples, 164s
433
+ 500/3800 examples, 183s
434
+ 550/3800 examples, 202s
435
+ 600/3800 examples, 221s
436
+ 650/3800 examples, 241s
437
+ 700/3800 examples, 260s
438
+ 750/3800 examples, 280s
439
+ 800/3800 examples, 300s
440
+ 850/3800 examples, 319s
441
+ 900/3800 examples, 338s
442
+ 950/3800 examples, 357s
443
+ 1000/3800 examples, 377s
444
+ 1050/3800 examples, 396s
445
+ 1100/3800 examples, 414s
446
+ 1150/3800 examples, 433s
447
+ 1200/3800 examples, 452s
448
+ 1250/3800 examples, 472s
449
+ 1300/3800 examples, 491s
450
+ 1350/3800 examples, 511s
451
+ 1400/3800 examples, 531s
452
+ 1450/3800 examples, 551s
453
+ 1500/3800 examples, 572s
454
+ 1550/3800 examples, 592s
455
+ 1600/3800 examples, 612s
456
+ 1650/3800 examples, 632s
457
+ 1700/3800 examples, 653s
458
+ 1750/3800 examples, 674s
459
+ 1800/3800 examples, 693s
460
+ 1850/3800 examples, 712s
461
+ 1900/3800 examples, 730s
462
+ 1950/3800 examples, 748s
463
+ 2000/3800 examples, 768s
464
+ 2050/3800 examples, 787s
465
+ 2100/3800 examples, 805s
466
+ 2150/3800 examples, 824s
467
+ 2200/3800 examples, 842s
468
+ 2250/3800 examples, 861s
469
+ 2300/3800 examples, 878s
470
+ 2350/3800 examples, 897s
471
+ 2400/3800 examples, 915s
472
+ 2450/3800 examples, 933s
473
+ 2500/3800 examples, 950s
474
+ 2550/3800 examples, 969s
475
+ 2600/3800 examples, 986s
476
+ 2650/3800 examples, 1004s
477
+ 2700/3800 examples, 1022s
478
+ 2750/3800 examples, 1042s
479
+ 2800/3800 examples, 1060s
480
+ 2850/3800 examples, 1078s
481
+ 2900/3800 examples, 1096s
482
+ 2950/3800 examples, 1114s
483
+ 3000/3800 examples, 1132s
484
+ 3050/3800 examples, 1150s
485
+ 3100/3800 examples, 1171s
486
+ 3150/3800 examples, 1192s
487
+ 3200/3800 examples, 1212s
488
+ 3250/3800 examples, 1234s
489
+ 3300/3800 examples, 1256s
490
+ 3350/3800 examples, 1276s
491
+ 3400/3800 examples, 1295s
492
+ 3450/3800 examples, 1313s
493
+ 3500/3800 examples, 1330s
494
+ 3550/3800 examples, 1348s
495
+ 3600/3800 examples, 1365s
496
+ 3650/3800 examples, 1382s
497
+ 3700/3800 examples, 1401s
498
+ 3750/3800 examples, 1419s
499
+ 3800/3800 examples, 1437s
500
+ {
501
+ "examples": 3800,
502
+ "decisions": 3800,
503
+ "seed_mode": "pad",
504
+ "canvas_length": 64,
505
+ "seconds": 1437.3,
506
+ "feature_dim": 8448,
507
+ "encoder_norm": "model.encoder.language_model.norm",
508
+ "decoder_norm": "model.decoder.norm",
509
+ "hidden_size": 2816,
510
+ "extra_layers": {
511
+ "encoder": [
512
+ "model.encoder.language_model.layers.14",
513
+ "model.encoder.language_model.layers.22"
514
+ ],
515
+ "decoder": [
516
+ "model.decoder.layers.14",
517
+ "model.decoder.layers.22"
518
+ ]
519
+ }
520
+ }
521
+ zero_shot pad 0.7016
522
+
523
+
524
+ warning: several final-norm candidates, using the last; encoder ['model.encoder.language_model.norm'], decoder ['model.decoder.self_conditioning.pre_norm', 'model.decoder.self_conditioning.post_norm', 'model.decoder.norm']
525
+ 50/1700 examples, 19s
526
+ 100/1700 examples, 37s
527
+ 150/1700 examples, 56s
528
+ 200/1700 examples, 73s
529
+ 250/1700 examples, 92s
530
+ 300/1700 examples, 110s
531
+ 350/1700 examples, 130s
532
+ 400/1700 examples, 149s
533
+ 450/1700 examples, 167s
534
+ 500/1700 examples, 185s
535
+ 550/1700 examples, 204s
536
+ 600/1700 examples, 223s
537
+ 650/1700 examples, 241s
538
+ 700/1700 examples, 259s
539
+ 750/1700 examples, 277s
540
+ 800/1700 examples, 295s
541
+ 850/1700 examples, 313s
542
+ 900/1700 examples, 331s
543
+ 950/1700 examples, 349s
544
+ 1000/1700 examples, 367s
545
+ 1050/1700 examples, 385s
546
+ 1100/1700 examples, 404s
547
+ 1150/1700 examples, 422s
548
+ 1200/1700 examples, 440s
549
+ 1250/1700 examples, 459s
550
+ 1300/1700 examples, 478s
551
+ 1350/1700 examples, 496s
552
+ 1400/1700 examples, 515s
553
+ 1450/1700 examples, 533s
554
+ 1500/1700 examples, 551s
555
+ 1550/1700 examples, 569s
556
+ 1600/1700 examples, 588s
557
+ 1650/1700 examples, 605s
558
+ 1700/1700 examples, 623s
559
+ {
560
+ "examples": 1700,
561
+ "decisions": 2600,
562
+ "seed_mode": "pad",
563
+ "canvas_length": 64,
564
+ "seconds": 623.0,
565
+ "feature_dim": 8448,
566
+ "encoder_norm": "model.encoder.language_model.norm",
567
+ "decoder_norm": "model.decoder.norm",
568
+ "hidden_size": 2816,
569
+ "extra_layers": {
570
+ "encoder": [
571
+ "model.encoder.language_model.layers.14",
572
+ "model.encoder.language_model.layers.22"
573
+ ],
574
+ "decoder": [
575
+ "model.decoder.layers.14",
576
+ "model.decoder.layers.22"
577
+ ]
578
+ }
579
+ }
580
+ zero_shot pad 0.6108
581
+ extra_layers {'encoder': ['model.encoder.language_model.layers.14', 'model.encoder.language_model.layers.22'], 'decoder': ['model.decoder.layers.14', 'model.decoder.layers.22']} feature_dim 8448
582
+ sweep: start h512-s42-screen (4 epochs, wd 0.01)
583
+ epoch 0 train 0.9074 val_nll 0.8506 1179s
584
+ epoch 1 train 0.7055 val_nll 0.8040 2295s
585
+ epoch 2 train 0.5856 val_nll 0.7313 3412s
586
+ epoch 3 train 0.4998 val_nll 0.7078 4552s
587
+ sweep: h512-s42-screen best_epoch 3 val_nll 0.5980 val_brier 0.3052 params 14825622 4930s
588
+ sweep: stopping before h512-s42-confirm: about 9860s needed, 0s left
589
+ sweep: published single (no full run finished; best screening run) -> runs/hev; leaderboard runs/leaderboard.json
590
+ | Model | n | acc | soft_acc | macro_f1 | kl | tv | brier | nll | ece | score_mae | within_1 |
591
+ |---|---|---|---|---|---|---|---|---|---|---|---|
592
+ | DiffusionGemma zero-shot canvas read | 2000 | 0.708 | 0.573 | 0.549 | 1.333 | 0.362 | 0.304 | 2.100 | 0.213 | 0.411 | 0.934 |
593
+ | Hev generalist | 2000 | 0.685 | 0.559 | 0.506 | 0.556 | 0.301 | 0.199 | 1.324 | 0.077 | 0.339 | 0.956 |
594
+ | Model | n | acc | soft_acc | macro_f1 | kl | tv | brier | nll | ece | score_mae | within_1 |
595
+ |---|---|---|---|---|---|---|---|---|---|---|---|
596
+ | DiffusionGemma zero-shot canvas read | 3800 | 0.702 | 0.690 | 0.646 | 1.608 | 0.310 | 0.474 | 1.721 | 0.239 | 0.602 | 0.816 |
597
+ | Hev generalist | 3800 | 0.721 | 0.709 | 0.677 | 0.738 | 0.343 | 0.336 | 0.851 | 0.043 | 0.591 | 0.826 |
598
+ | Model | n | acc | soft_acc | macro_f1 | kl | tv | brier | nll | ece | score_mae | within_1 |
599
+ |---|---|---|---|---|---|---|---|---|---|---|---|
600
+ | DiffusionGemma zero-shot canvas read | 2600 | 0.611 | 0.611 | 0.573 | 2.555 | 0.396 | 0.720 | 2.555 | 0.340 | - | - |
601
+ | Hev generalist | 2600 | 0.593 | 0.593 | 0.554 | 1.411 | 0.472 | 0.626 | 1.411 | 0.190 | - | - |
602
+
603
+
604
+
605
+
606
  ...ev/session5_artifacts.tgz: 1%| | 524kB / 56.1MB 
607
+
608
+
609
  ...ev/session5_artifacts.tgz: 1%| | 524kB / 56.1MB 
610
+
611
+
612
+
613
  ...ev/session5_artifacts.tgz: 11%|█ | 6.29MB / 56.1MB 
614
+
615
+
616
+
617
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
618
+
619
+
620
+
621
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
622
+
623
+
624
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
625
+
626
+
627
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
628
+
629
+
630
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
631
+
632
+
633
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
634
+
635
+
636
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
637
+
638
+
639
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
640
+
641
+
642
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
643
+
644
+
645
  ...ev/session5_artifacts.tgz: 100%|█████████▉| 56.1MB / 56.1MB 
646
+
647
+
648
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB 
649
+
650
+
651
+
652
+
653
+
654
+
655
+
656
+
657
+
658
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB 
659
+
660
+
661
+
662
+
663
+
664
+
665
  ...ev/session5_artifacts.tgz: 100%|██████████| 56.1MB / 56.1MB