-
Notifications
You must be signed in to change notification settings - Fork 0
/
skiing.log
626 lines (626 loc) · 67.1 KB
/
skiing.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
INFO:2022-12-05 01:01:04:flag punishment activated! All rewards will be rectified!
INFO:2022-12-05 01:01:41:epsilon is 0.3, episode is 0
INFO:2022-12-05 01:01:52:running reward: 0.00 at episode 0, frame count 100, epsilon 0.036228897509242894
INFO:2022-12-05 01:02:02:running reward: 0.00 at episode 0, frame count 200, epsilon 0.013125330147352274
INFO:2022-12-05 01:02:14:running reward: 0.00 at episode 0, frame count 300, epsilon 0.004755162406834015
INFO:2022-12-05 01:02:24:running reward: 0.00 at episode 0, frame count 400, epsilon 0.0017227429147699447
INFO:2022-12-05 01:02:35:running reward: 0.00 at episode 0, frame count 500, epsilon 0.06471778159406795
INFO:2022-12-05 01:02:46:running reward: 0.00 at episode 0, frame count 600, epsilon 0.02344653876397055
INFO:2022-12-05 01:02:57:running reward: 0.00 at episode 0, frame count 700, epsilon 0.008494422498263801
INFO:2022-12-05 01:03:09:running reward: 0.00 at episode 0, frame count 800, epsilon 0.003077435620898062
INFO:2022-12-05 01:03:20:running reward: 0.00 at episode 0, frame count 900, epsilon 0.0011149209970080917
INFO:2022-12-05 01:03:32:running reward: 0.00 at episode 0, frame count 1000, epsilon 0.04188391254457482
INFO:2022-12-05 01:03:43:running reward: 0.00 at episode 0, frame count 1100, epsilon 0.015174079748634946
INFO:2022-12-05 01:03:52:running reward: 0.00 at episode 0, frame count 1200, epsilon 0.005497401800103737
INFO:2022-12-05 01:04:04:running reward: 0.00 at episode 0, frame count 1300, epsilon 0.0019916480638308568
INFO:2022-12-05 01:04:14:running reward: 0.00 at episode 0, frame count 1400, epsilon 0.07481966305138833
INFO:2022-12-05 01:04:25:running reward: 0.00 at episode 0, frame count 1500, epsilon 0.027106339043648356
INFO:2022-12-05 01:04:35:running reward: 0.00 at episode 0, frame count 1600, epsilon 0.009820327790631259
INFO:2022-12-05 01:04:46:running reward: 0.00 at episode 0, frame count 1700, epsilon 0.003557796490339496
INFO:2022-12-05 01:04:57:running reward: 0.00 at episode 0, frame count 1800, epsilon 0.001288950444072538
INFO:2022-12-05 01:05:06:running reward: 0.00 at episode 0, frame count 1900, epsilon 0.04842162612301505
INFO:2022-12-05 01:05:17:running reward: 0.00 at episode 0, frame count 2000, epsilon 0.017542621300415916
INFO:2022-12-05 01:05:28:running reward: 0.00 at episode 0, frame count 2100, epsilon 0.006355498291362296
INFO:2022-12-05 01:05:38:running reward: 0.00 at episode 0, frame count 2200, epsilon 0.0023025269621793293
INFO:2022-12-05 01:05:49:running reward: 0.00 at episode 0, frame count 2300, epsilon 0.08649836012976679
INFO:2022-12-05 01:05:59:running reward: 0.00 at episode 0, frame count 2400, epsilon 0.03133740223858905
INFO:2022-12-05 01:06:10:running reward: 0.00 at episode 0, frame count 2500, epsilon 0.011353195339077615
INFO:2022-12-05 01:06:15:running reward: 0.00 at episode 0, frame count 2540, epsilon 0.04842162612301505
INFO:2022-12-05 01:06:15:time per episode 274.0208 seconds
INFO:2022-12-05 01:06:15:epsilon is 0.04842162612301505, episode is 1
INFO:2022-12-05 01:06:22:running reward: -21615.00 at episode 1, frame count 2600, epsilon 0.008494422498263801
INFO:2022-12-05 01:06:33:running reward: -21615.00 at episode 1, frame count 2700, epsilon 0.003077435620898062
INFO:2022-12-05 01:06:43:running reward: -21615.00 at episode 1, frame count 2800, epsilon 0.0011149209970080917
INFO:2022-12-05 01:06:54:running reward: -21615.00 at episode 1, frame count 2900, epsilon 0.04188391254457482
INFO:2022-12-05 01:07:03:running reward: -21615.00 at episode 1, frame count 3000, epsilon 0.015174079748634946
INFO:2022-12-05 01:07:13:running reward: -21615.00 at episode 1, frame count 3100, epsilon 0.005497401800103737
INFO:2022-12-05 01:07:23:running reward: -21615.00 at episode 1, frame count 3200, epsilon 0.0019916480638308568
INFO:2022-12-05 01:07:33:running reward: -21615.00 at episode 1, frame count 3300, epsilon 0.07481966305138833
INFO:2022-12-05 01:07:43:running reward: -21615.00 at episode 1, frame count 3400, epsilon 0.027106339043648356
INFO:2022-12-05 01:07:54:running reward: -21615.00 at episode 1, frame count 3500, epsilon 0.009820327790631259
INFO:2022-12-05 01:08:04:running reward: -21615.00 at episode 1, frame count 3600, epsilon 0.003557796490339496
INFO:2022-12-05 01:08:15:running reward: -21615.00 at episode 1, frame count 3700, epsilon 0.001288950444072538
INFO:2022-12-05 01:08:25:running reward: -21615.00 at episode 1, frame count 3800, epsilon 0.04842162612301505
INFO:2022-12-05 01:08:35:running reward: -21615.00 at episode 1, frame count 3900, epsilon 0.017542621300415916
INFO:2022-12-05 01:08:47:running reward: -21615.00 at episode 1, frame count 4000, epsilon 0.006355498291362296
INFO:2022-12-05 01:08:58:running reward: -21615.00 at episode 1, frame count 4100, epsilon 0.0023025269621793293
INFO:2022-12-05 01:09:08:running reward: -21615.00 at episode 1, frame count 4200, epsilon 0.08649836012976679
INFO:2022-12-05 01:09:19:running reward: -21615.00 at episode 1, frame count 4300, epsilon 0.03133740223858905
INFO:2022-12-05 01:09:29:running reward: -21615.00 at episode 1, frame count 4400, epsilon 0.011353195339077615
INFO:2022-12-05 01:09:41:running reward: -21615.00 at episode 1, frame count 4500, epsilon 0.004113137503418574
INFO:2022-12-05 01:09:51:running reward: -21615.00 at episode 1, frame count 4600, epsilon 0.0014901443705277473
INFO:2022-12-05 01:10:02:running reward: -21615.00 at episode 1, frame count 4700, epsilon 0.05597981979123285
INFO:2022-12-05 01:10:12:running reward: -21615.00 at episode 1, frame count 4800, epsilon 0.020280871538024617
INFO:2022-12-05 01:10:22:running reward: -21615.00 at episode 1, frame count 4900, epsilon 0.007347536163492152
INFO:2022-12-05 01:10:32:running reward: -21615.00 at episode 1, frame count 5000, epsilon 0.002661931346126132
INFO:2022-12-05 01:10:42:running reward: -21615.00 at episode 1, frame count 5100, epsilon 0.0009643883791544461
INFO:2022-12-05 01:10:52:running reward: -21615.00 at episode 1, frame count 5200, epsilon 0.036228897509242894
INFO:2022-12-05 01:11:03:running reward: -21615.00 at episode 1, frame count 5300, epsilon 0.013125330147352274
INFO:2022-12-05 01:11:13:running reward: -21615.00 at episode 1, frame count 5400, epsilon 0.004755162406834015
INFO:2022-12-05 01:11:25:running reward: -21615.00 at episode 1, frame count 5500, epsilon 0.0017227429147699447
INFO:2022-12-05 01:11:36:running reward: -21615.00 at episode 1, frame count 5600, epsilon 0.06471778159406795
INFO:2022-12-05 01:11:46:running reward: -21615.00 at episode 1, frame count 5700, epsilon 0.02344653876397055
INFO:2022-12-05 01:11:56:running reward: -21615.00 at episode 1, frame count 5800, epsilon 0.008494422498263801
INFO:2022-12-05 01:12:09:running reward: -21615.00 at episode 1, frame count 5900, epsilon 0.003077435620898062
INFO:2022-12-05 01:12:19:running reward: -21615.00 at episode 1, frame count 6000, epsilon 0.0011149209970080917
INFO:2022-12-05 01:12:21:running reward: -21615.00 at episode 1, frame count 6021, epsilon 0.0023875515424585823
INFO:2022-12-05 01:12:21:time per episode 366.7103 seconds
INFO:2022-12-05 01:12:21:epsilon is 0.0023875515424585823, episode is 2
INFO:2022-12-05 01:12:30:running reward: -23788.00 at episode 2, frame count 6100, epsilon 0.016917900122028363
INFO:2022-12-05 01:12:39:running reward: -23788.00 at episode 2, frame count 6200, epsilon 0.0061291686959257345
INFO:2022-12-05 01:12:50:running reward: -23788.00 at episode 2, frame count 6300, epsilon 0.0022205302450155335
INFO:2022-12-05 01:13:00:running reward: -23788.00 at episode 2, frame count 6400, epsilon 0.08341801332506335
INFO:2022-12-05 01:13:10:running reward: -23788.00 at episode 2, frame count 6500, epsilon 0.0302214265517838
INFO:2022-12-05 01:13:20:running reward: -23788.00 at episode 2, frame count 6600, epsilon 0.01094888965127687
INFO:2022-12-05 01:13:32:running reward: -23788.00 at episode 2, frame count 6700, epsilon 0.003966662010161204
INFO:2022-12-05 01:13:43:running reward: -23788.00 at episode 2, frame count 6800, epsilon 0.0014370779141993763
INFO:2022-12-05 01:13:54:running reward: -23788.00 at episode 2, frame count 6900, epsilon 0.05398628767382502
INFO:2022-12-05 01:14:06:running reward: -23788.00 at episode 2, frame count 7000, epsilon 0.019558636830395097
INFO:2022-12-05 01:14:17:running reward: -23788.00 at episode 2, frame count 7100, epsilon 0.0070858784914888725
INFO:2022-12-05 01:14:28:running reward: -23788.00 at episode 2, frame count 7200, epsilon 0.0025671356563109903
INFO:2022-12-05 01:14:38:running reward: -23788.00 at episode 2, frame count 7300, epsilon 0.0964388379154446
INFO:2022-12-05 01:14:50:running reward: -23788.00 at episode 2, frame count 7400, epsilon 0.0349387277474913
INFO:2022-12-05 01:14:59:running reward: -23788.00 at episode 2, frame count 7500, epsilon 0.012657915866672044
INFO:2022-12-05 01:15:10:running reward: -23788.00 at episode 2, frame count 7600, epsilon 0.004585823366142809
INFO:2022-12-05 01:15:19:running reward: -23788.00 at episode 2, frame count 7700, epsilon 0.0016613932472747926
INFO:2022-12-05 01:15:31:running reward: -23788.00 at episode 2, frame count 7800, epsilon 0.062413076493974616
INFO:2022-12-05 01:15:42:running reward: -23788.00 at episode 2, frame count 7900, epsilon 0.022611569515367445
INFO:2022-12-05 01:15:54:running reward: -23788.00 at episode 2, frame count 8000, epsilon 0.008191922344953686
INFO:2022-12-05 01:16:04:running reward: -23788.00 at episode 2, frame count 8100, epsilon 0.002967843150390038
INFO:2022-12-05 01:16:15:running reward: -23788.00 at episode 2, frame count 8200, epsilon 0.0010752168531898924
INFO:2022-12-05 01:16:26:running reward: -23788.00 at episode 2, frame count 8300, epsilon 0.04039235853150907
INFO:2022-12-05 01:16:36:running reward: -23788.00 at episode 2, frame count 8400, epsilon 0.014633706173946357
INFO:2022-12-05 01:16:47:running reward: -23788.00 at episode 2, frame count 8500, epsilon 0.005301630411562776
INFO:2022-12-05 01:16:59:running reward: -23788.00 at episode 2, frame count 8600, epsilon 0.0019207222481239302
INFO:2022-12-05 01:17:11:running reward: -23788.00 at episode 2, frame count 8700, epsilon 0.07215521357901018
INFO:2022-12-05 01:17:23:running reward: -23788.00 at episode 2, frame count 8800, epsilon 0.02614103837511491
INFO:2022-12-05 01:17:34:running reward: -23788.00 at episode 2, frame count 8900, epsilon 0.00947061000077224
INFO:2022-12-05 01:17:44:running reward: -23788.00 at episode 2, frame count 8990, epsilon 0.0023875515424585823
INFO:2022-12-05 01:17:44:time per episode 322.9019 seconds
INFO:2022-12-05 01:17:44:epsilon is 0.0023875515424585823, episode is 3
INFO:2022-12-05 01:17:45:running reward: -23641.00 at episode 3, frame count 9000, epsilon 0.0013859012403933883
INFO:2022-12-05 01:17:55:running reward: -23641.00 at episode 3, frame count 9100, epsilon 0.05206374846632575
INFO:2022-12-05 01:18:06:running reward: -23641.00 at episode 3, frame count 9200, epsilon 0.018862122071335176
INFO:2022-12-05 01:18:18:running reward: -23641.00 at episode 3, frame count 9300, epsilon 0.006833538873292304
INFO:2022-12-05 01:18:29:running reward: -23641.00 at episode 3, frame count 9400, epsilon 0.0024757157946593404
INFO:2022-12-05 01:18:40:running reward: -23641.00 at episode 3, frame count 9500, epsilon 0.09300449458481394
INFO:2022-12-05 01:18:53:running reward: -23641.00 at episode 3, frame count 9600, epsilon 0.0336945030221216
INFO:2022-12-05 01:19:05:running reward: -23641.00 at episode 3, frame count 9700, epsilon 0.012207146966133196
INFO:2022-12-05 01:19:16:running reward: -23641.00 at episode 3, frame count 9800, epsilon 0.004422514763163049
INFO:2022-12-05 01:19:26:running reward: -23641.00 at episode 3, frame count 9900, epsilon 0.0016022283408774788
INFO:2022-12-05 01:19:36:running reward: -23641.00 at episode 3, frame count 10000, epsilon 0.06019044567806663
INFO:2022-12-05 01:19:48:running reward: -23641.00 at episode 3, frame count 10100, epsilon 0.02180633487506329
INFO:2022-12-05 01:19:58:running reward: -23641.00 at episode 3, frame count 10200, epsilon 0.007900194712408964
INFO:2022-12-05 01:20:09:running reward: -23641.00 at episode 3, frame count 10300, epsilon 0.0028621534453892733
INFO:2022-12-05 01:20:19:running reward: -23641.00 at episode 3, frame count 10400, epsilon 0.001036926638287344
INFO:2022-12-05 01:20:31:running reward: -23641.00 at episode 3, frame count 10500, epsilon 0.03895392117442729
INFO:2022-12-05 01:20:44:running reward: -23641.00 at episode 3, frame count 10600, epsilon 0.014112576178114535
INFO:2022-12-05 01:20:55:running reward: -23641.00 at episode 3, frame count 10700, epsilon 0.005112830759482943
INFO:2022-12-05 01:21:09:running reward: -23641.00 at episode 3, frame count 10800, epsilon 0.0018523222156741205
INFO:2022-12-05 01:21:21:running reward: -23641.00 at episode 3, frame count 10900, epsilon 0.0695856494710045
INFO:2022-12-05 01:21:33:running reward: -23641.00 at episode 3, frame count 11000, epsilon 0.025210113627991238
INFO:2022-12-05 01:21:44:running reward: -23641.00 at episode 3, frame count 11100, epsilon 0.009133346228248625
INFO:2022-12-05 01:21:56:running reward: -23641.00 at episode 3, frame count 11196, epsilon 0.0028621534453892733
INFO:2022-12-05 01:21:56:time per episode 251.7389 seconds
INFO:2022-12-05 01:21:56:epsilon is 0.0028621534453892733, episode is 4
INFO:2022-12-05 01:21:56:running reward: -22358.00 at episode 4, frame count 11200, epsilon 0.0011149209970080917
INFO:2022-12-05 01:22:08:running reward: -22358.00 at episode 4, frame count 11300, epsilon 0.04188391254457482
INFO:2022-12-05 01:22:20:running reward: -22358.00 at episode 4, frame count 11400, epsilon 0.015174079748634946
INFO:2022-12-05 01:22:32:running reward: -22358.00 at episode 4, frame count 11500, epsilon 0.005497401800103737
INFO:2022-12-05 01:22:43:running reward: -22358.00 at episode 4, frame count 11600, epsilon 0.0019916480638308568
INFO:2022-12-05 01:22:55:running reward: -22358.00 at episode 4, frame count 11700, epsilon 0.07481966305138833
INFO:2022-12-05 01:23:07:running reward: -22358.00 at episode 4, frame count 11800, epsilon 0.027106339043648356
INFO:2022-12-05 01:23:16:running reward: -22358.00 at episode 4, frame count 11900, epsilon 0.009820327790631259
INFO:2022-12-05 01:23:28:running reward: -22358.00 at episode 4, frame count 12000, epsilon 0.003557796490339496
INFO:2022-12-05 01:23:40:running reward: -22358.00 at episode 4, frame count 12100, epsilon 0.001288950444072538
INFO:2022-12-05 01:23:52:running reward: -22358.00 at episode 4, frame count 12200, epsilon 0.04842162612301505
INFO:2022-12-05 01:24:03:running reward: -22358.00 at episode 4, frame count 12300, epsilon 0.017542621300415916
INFO:2022-12-05 01:24:13:running reward: -22358.00 at episode 4, frame count 12400, epsilon 0.006355498291362296
INFO:2022-12-05 01:24:24:running reward: -22358.00 at episode 4, frame count 12500, epsilon 0.0023025269621793293
INFO:2022-12-05 01:24:34:running reward: -22358.00 at episode 4, frame count 12600, epsilon 0.08649836012976679
INFO:2022-12-05 01:24:45:running reward: -22358.00 at episode 4, frame count 12700, epsilon 0.03133740223858905
INFO:2022-12-05 01:24:56:running reward: -22358.00 at episode 4, frame count 12800, epsilon 0.011353195339077615
INFO:2022-12-05 01:25:08:running reward: -22358.00 at episode 4, frame count 12900, epsilon 0.004113137503418574
INFO:2022-12-05 01:25:19:running reward: -22358.00 at episode 4, frame count 13000, epsilon 0.0014901443705277473
INFO:2022-12-05 01:25:30:running reward: -22358.00 at episode 4, frame count 13100, epsilon 0.05597981979123285
INFO:2022-12-05 01:25:42:running reward: -22358.00 at episode 4, frame count 13200, epsilon 0.020280871538024617
INFO:2022-12-05 01:25:54:running reward: -22358.00 at episode 4, frame count 13300, epsilon 0.007347536163492152
INFO:2022-12-05 01:26:01:running reward: -22358.00 at episode 4, frame count 13350, epsilon 0.04503428864545839
INFO:2022-12-05 01:26:01:time per episode 244.7857 seconds
INFO:2022-12-05 01:26:01:epsilon is 0.04503428864545839, episode is 5
INFO:2022-12-05 01:26:07:running reward: -21544.60 at episode 5, frame count 13400, epsilon 0.005910899064227988
INFO:2022-12-05 01:26:20:running reward: -21544.60 at episode 5, frame count 13500, epsilon 0.002141453563853955
INFO:2022-12-05 01:26:32:running reward: -21544.60 at episode 5, frame count 13600, epsilon 0.08044736266284182
INFO:2022-12-05 01:26:43:running reward: -21544.60 at episode 5, frame count 13700, epsilon 0.02914519256800991
INFO:2022-12-05 01:26:54:running reward: -21544.60 at episode 5, frame count 13800, epsilon 0.010558981944335787
INFO:2022-12-05 01:27:05:running reward: -21544.60 at episode 5, frame count 13900, epsilon 0.003825402746632875
INFO:2022-12-05 01:27:16:running reward: -21544.60 at episode 5, frame count 14000, epsilon 0.0013859012403933883
INFO:2022-12-05 01:27:29:running reward: -21544.60 at episode 5, frame count 14100, epsilon 0.05206374846632575
INFO:2022-12-05 01:27:40:running reward: -21544.60 at episode 5, frame count 14200, epsilon 0.018862122071335176
INFO:2022-12-05 01:27:51:running reward: -21544.60 at episode 5, frame count 14300, epsilon 0.006833538873292304
INFO:2022-12-05 01:28:02:running reward: -21544.60 at episode 5, frame count 14400, epsilon 0.0024757157946593404
INFO:2022-12-05 01:28:12:running reward: -21544.60 at episode 5, frame count 14500, epsilon 0.09300449458481394
INFO:2022-12-05 01:28:24:running reward: -21544.60 at episode 5, frame count 14600, epsilon 0.0336945030221216
INFO:2022-12-05 01:28:35:running reward: -21544.60 at episode 5, frame count 14700, epsilon 0.012207146966133196
INFO:2022-12-05 01:28:44:running reward: -21544.60 at episode 5, frame count 14800, epsilon 0.004422514763163049
INFO:2022-12-05 01:28:55:running reward: -21544.60 at episode 5, frame count 14900, epsilon 0.0016022283408774788
INFO:2022-12-05 01:29:05:running reward: -21544.60 at episode 5, frame count 15000, epsilon 0.06019044567806663
INFO:2022-12-05 01:29:15:running reward: -21544.60 at episode 5, frame count 15100, epsilon 0.02180633487506329
INFO:2022-12-05 01:29:25:running reward: -21544.60 at episode 5, frame count 15200, epsilon 0.007900194712408964
INFO:2022-12-05 01:29:35:running reward: -21544.60 at episode 5, frame count 15300, epsilon 0.0028621534453892733
INFO:2022-12-05 01:29:45:running reward: -21544.60 at episode 5, frame count 15400, epsilon 0.001036926638287344
INFO:2022-12-05 01:29:55:running reward: -21544.60 at episode 5, frame count 15500, epsilon 0.03895392117442729
INFO:2022-12-05 01:30:06:running reward: -21544.60 at episode 5, frame count 15600, epsilon 0.014112576178114535
INFO:2022-12-05 01:30:16:running reward: -21544.60 at episode 5, frame count 15700, epsilon 0.005112830759482943
INFO:2022-12-05 01:30:25:running reward: -21544.60 at episode 5, frame count 15786, epsilon 0.0011149209970080917
INFO:2022-12-05 01:30:25:time per episode 263.7489 seconds
INFO:2022-12-05 01:30:25:epsilon is 0.0011149209970080917, episode is 6
INFO:2022-12-05 01:30:27:running reward: -21448.17 at episode 6, frame count 15800, epsilon 0.0016022283408774788
INFO:2022-12-05 01:30:37:running reward: -21448.17 at episode 6, frame count 15900, epsilon 0.06019044567806663
INFO:2022-12-05 01:30:47:running reward: -21448.17 at episode 6, frame count 16000, epsilon 0.02180633487506329
INFO:2022-12-05 01:30:57:running reward: -21448.17 at episode 6, frame count 16100, epsilon 0.007900194712408964
INFO:2022-12-05 01:31:07:running reward: -21448.17 at episode 6, frame count 16200, epsilon 0.0028621534453892733
INFO:2022-12-05 01:31:18:running reward: -21448.17 at episode 6, frame count 16300, epsilon 0.001036926638287344
INFO:2022-12-05 01:31:28:running reward: -21448.17 at episode 6, frame count 16400, epsilon 0.03895392117442729
INFO:2022-12-05 01:31:39:running reward: -21448.17 at episode 6, frame count 16500, epsilon 0.014112576178114535
INFO:2022-12-05 01:31:50:running reward: -21448.17 at episode 6, frame count 16600, epsilon 0.005112830759482943
INFO:2022-12-05 01:32:02:running reward: -21448.17 at episode 6, frame count 16700, epsilon 0.0018523222156741205
INFO:2022-12-05 01:32:14:running reward: -21448.17 at episode 6, frame count 16800, epsilon 0.0695856494710045
INFO:2022-12-05 01:32:27:running reward: -21448.17 at episode 6, frame count 16900, epsilon 0.025210113627991238
INFO:2022-12-05 01:32:43:running reward: -21448.17 at episode 6, frame count 17000, epsilon 0.009133346228248625
INFO:2022-12-05 01:32:55:running reward: -21448.17 at episode 6, frame count 17100, epsilon 0.0033089106441964965
INFO:2022-12-05 01:33:07:running reward: -21448.17 at episode 6, frame count 17200, epsilon 0.0011987818459583788
INFO:2022-12-05 01:33:18:running reward: -21448.17 at episode 6, frame count 17300, epsilon 0.04503428864545839
INFO:2022-12-05 01:33:29:running reward: -21448.17 at episode 6, frame count 17400, epsilon 0.016315426277379738
INFO:2022-12-05 01:33:40:running reward: -21448.17 at episode 6, frame count 17500, epsilon 0.005910899064227988
INFO:2022-12-05 01:33:51:running reward: -21448.17 at episode 6, frame count 17600, epsilon 0.002141453563853955
INFO:2022-12-05 01:34:05:running reward: -21448.17 at episode 6, frame count 17700, epsilon 0.08044736266284182
INFO:2022-12-05 01:34:17:running reward: -21448.17 at episode 6, frame count 17800, epsilon 0.02914519256800991
INFO:2022-12-05 01:34:28:running reward: -21448.17 at episode 6, frame count 17900, epsilon 0.010558981944335787
INFO:2022-12-05 01:34:41:running reward: -21448.17 at episode 6, frame count 18000, epsilon 0.003825402746632875
INFO:2022-12-05 01:34:54:running reward: -21448.17 at episode 6, frame count 18100, epsilon 0.0013859012403933883
INFO:2022-12-05 01:35:05:running reward: -21448.17 at episode 6, frame count 18200, epsilon 0.05206374846632575
INFO:2022-12-05 01:35:18:running reward: -21448.17 at episode 6, frame count 18300, epsilon 0.018862122071335176
INFO:2022-12-05 01:35:31:running reward: -21448.17 at episode 6, frame count 18400, epsilon 0.006833538873292304
INFO:2022-12-05 01:35:42:running reward: -21448.17 at episode 6, frame count 18500, epsilon 0.0024757157946593404
INFO:2022-12-05 01:35:55:running reward: -21448.17 at episode 6, frame count 18600, epsilon 0.09300449458481394
INFO:2022-12-05 01:36:08:running reward: -21448.17 at episode 6, frame count 18700, epsilon 0.0336945030221216
INFO:2022-12-05 01:36:14:running reward: -21448.17 at episode 6, frame count 18747, epsilon 0.001786358019245739
INFO:2022-12-05 01:36:14:time per episode 349.6505 seconds
INFO:2022-12-05 01:36:14:epsilon is 0.001786358019245739, episode is 7
INFO:2022-12-05 01:36:20:running reward: -21641.29 at episode 7, frame count 18800, epsilon 0.006590185477903263
INFO:2022-12-05 01:36:34:running reward: -21641.29 at episode 7, frame count 18900, epsilon 0.0023875515424585823
INFO:2022-12-05 01:36:49:running reward: -21641.29 at episode 7, frame count 19000, epsilon 0.08969245378672715
INFO:2022-12-05 01:37:02:running reward: -21641.29 at episode 7, frame count 19100, epsilon 0.03249458715591843
INFO:2022-12-05 01:37:17:running reward: -21641.29 at episode 7, frame count 19200, epsilon 0.011772430676769304
INFO:2022-12-05 01:37:28:running reward: -21641.29 at episode 7, frame count 19300, epsilon 0.004265021844233421
INFO:2022-12-05 01:37:42:running reward: -21641.29 at episode 7, frame count 19400, epsilon 0.001545170392694149
INFO:2022-12-05 01:37:56:running reward: -21641.29 at episode 7, frame count 19500, epsilon 0.0580469663480544
INFO:2022-12-05 01:38:10:running reward: -21641.29 at episode 7, frame count 19600, epsilon 0.02102977594546134
INFO:2022-12-05 01:38:24:running reward: -21641.29 at episode 7, frame count 19700, epsilon 0.0076188559737046056
INFO:2022-12-05 01:38:37:running reward: -21641.29 at episode 7, frame count 19800, epsilon 0.002760227522090274
INFO:2022-12-05 01:38:50:running reward: -21641.29 at episode 7, frame count 19900, epsilon 0.0010000000000000002
INFO:2022-12-05 01:39:02:running reward: -21641.29 at episode 7, frame count 20000, epsilon 0.03756670890311598
INFO:2022-12-05 01:39:15:running reward: -21641.29 at episode 7, frame count 20100, epsilon 0.013610004466105522
INFO:2022-12-05 01:39:29:running reward: -21641.29 at episode 7, frame count 20200, epsilon 0.00493075456902875
INFO:2022-12-05 01:39:41:running reward: -21641.29 at episode 7, frame count 20300, epsilon 0.001786358019245739
INFO:2022-12-05 01:39:54:running reward: -21641.29 at episode 7, frame count 20400, epsilon 0.06710759170575145
INFO:2022-12-05 01:40:07:running reward: -21641.29 at episode 7, frame count 20500, epsilon 0.024312340619997878
INFO:2022-12-05 01:40:22:running reward: -21641.29 at episode 7, frame count 20600, epsilon 0.008808092965317064
INFO:2022-12-05 01:40:35:running reward: -21641.29 at episode 7, frame count 20700, epsilon 0.0031910749729235524
INFO:2022-12-05 01:40:50:running reward: -21641.29 at episode 7, frame count 20800, epsilon 0.0011560912813835744
INFO:2022-12-05 01:41:02:running reward: -21641.29 at episode 7, frame count 20900, epsilon 0.043430544633167076
INFO:2022-12-05 01:41:15:running reward: -21641.29 at episode 7, frame count 21000, epsilon 0.0157344075028561
INFO:2022-12-05 01:41:28:running reward: -21641.29 at episode 7, frame count 21100, epsilon 0.00570040236789636
INFO:2022-12-05 01:41:40:running reward: -21641.29 at episode 7, frame count 21200, epsilon 0.0020651929314796274
INFO:2022-12-05 01:41:56:running reward: -21641.29 at episode 7, frame count 21300, epsilon 0.07758250168566791
INFO:2022-12-05 01:42:11:running reward: -21641.29 at episode 7, frame count 21400, epsilon 0.028107285020807282
INFO:2022-12-05 01:42:24:running reward: -21641.29 at episode 7, frame count 21500, epsilon 0.01018295948281905
INFO:2022-12-05 01:42:38:running reward: -21641.29 at episode 7, frame count 21600, epsilon 0.0036891739544382437
INFO:2022-12-05 01:42:55:running reward: -21641.29 at episode 7, frame count 21700, epsilon 0.001336547050891116
INFO:2022-12-05 01:43:08:running reward: -21641.29 at episode 7, frame count 21800, epsilon 0.05020967399614466
INFO:2022-12-05 01:43:22:running reward: -21641.29 at episode 7, frame count 21900, epsilon 0.01819041133178823
INFO:2022-12-05 01:43:35:running reward: -21641.29 at episode 7, frame count 22000, epsilon 0.006590185477903263
INFO:2022-12-05 01:43:48:running reward: -21641.29 at episode 7, frame count 22100, epsilon 0.0023875515424585823
INFO:2022-12-05 01:44:00:running reward: -21641.29 at episode 7, frame count 22200, epsilon 0.08969245378672715
INFO:2022-12-05 01:44:12:running reward: -21641.29 at episode 7, frame count 22300, epsilon 0.03249458715591843
INFO:2022-12-05 01:44:18:running reward: -21641.29 at episode 7, frame count 22346, epsilon 0.0016613932472747926
INFO:2022-12-05 01:44:18:time per episode 483.7027 seconds
INFO:2022-12-05 01:44:18:epsilon is 0.0016613932472747926, episode is 8
INFO:2022-12-05 01:44:25:running reward: -21173.88 at episode 8, frame count 22400, epsilon 0.006833538873292304
INFO:2022-12-05 01:44:38:running reward: -21173.88 at episode 8, frame count 22500, epsilon 0.0024757157946593404
INFO:2022-12-05 01:44:50:running reward: -21173.88 at episode 8, frame count 22600, epsilon 0.09300449458481394
INFO:2022-12-05 01:45:02:running reward: -21173.88 at episode 8, frame count 22700, epsilon 0.0336945030221216
INFO:2022-12-05 01:45:14:running reward: -21173.88 at episode 8, frame count 22800, epsilon 0.012207146966133196
INFO:2022-12-05 01:45:26:running reward: -21173.88 at episode 8, frame count 22900, epsilon 0.004422514763163049
INFO:2022-12-05 01:45:38:running reward: -21173.88 at episode 8, frame count 23000, epsilon 0.0016022283408774788
INFO:2022-12-05 01:45:50:running reward: -21173.88 at episode 8, frame count 23100, epsilon 0.06019044567806663
INFO:2022-12-05 01:46:03:running reward: -21173.88 at episode 8, frame count 23200, epsilon 0.02180633487506329
INFO:2022-12-05 01:46:17:running reward: -21173.88 at episode 8, frame count 23300, epsilon 0.007900194712408964
INFO:2022-12-05 01:46:30:running reward: -21173.88 at episode 8, frame count 23400, epsilon 0.0028621534453892733
INFO:2022-12-05 01:46:43:running reward: -21173.88 at episode 8, frame count 23500, epsilon 0.001036926638287344
INFO:2022-12-05 01:46:56:running reward: -21173.88 at episode 8, frame count 23600, epsilon 0.03895392117442729
INFO:2022-12-05 01:47:09:running reward: -21173.88 at episode 8, frame count 23700, epsilon 0.014112576178114535
INFO:2022-12-05 01:47:22:running reward: -21173.88 at episode 8, frame count 23800, epsilon 0.005112830759482943
INFO:2022-12-05 01:47:35:running reward: -21173.88 at episode 8, frame count 23900, epsilon 0.0018523222156741205
INFO:2022-12-05 01:47:47:running reward: -21173.88 at episode 8, frame count 24000, epsilon 0.0695856494710045
INFO:2022-12-05 01:48:02:running reward: -21173.88 at episode 8, frame count 24100, epsilon 0.025210113627991238
INFO:2022-12-05 01:48:16:running reward: -21173.88 at episode 8, frame count 24200, epsilon 0.009133346228248625
INFO:2022-12-05 01:48:30:running reward: -21173.88 at episode 8, frame count 24300, epsilon 0.0033089106441964965
INFO:2022-12-05 01:48:45:running reward: -21173.88 at episode 8, frame count 24400, epsilon 0.0011987818459583788
INFO:2022-12-05 01:48:59:running reward: -21173.88 at episode 8, frame count 24500, epsilon 0.04503428864545839
INFO:2022-12-05 01:49:13:running reward: -21173.88 at episode 8, frame count 24600, epsilon 0.016315426277379738
INFO:2022-12-05 01:49:26:running reward: -21173.88 at episode 8, frame count 24700, epsilon 0.005910899064227988
INFO:2022-12-05 01:49:40:running reward: -21173.88 at episode 8, frame count 24800, epsilon 0.002141453563853955
INFO:2022-12-05 01:49:53:running reward: -21173.88 at episode 8, frame count 24900, epsilon 0.08044736266284182
INFO:2022-12-05 01:50:05:running reward: -21173.88 at episode 8, frame count 25000, epsilon 0.02914519256800991
INFO:2022-12-05 01:50:19:running reward: -21173.88 at episode 8, frame count 25100, epsilon 0.010558981944335787
INFO:2022-12-05 01:50:32:running reward: -21173.88 at episode 8, frame count 25200, epsilon 0.003825402746632875
INFO:2022-12-05 01:50:45:running reward: -21173.88 at episode 8, frame count 25300, epsilon 0.0013859012403933883
INFO:2022-12-05 01:50:59:running reward: -21173.88 at episode 8, frame count 25400, epsilon 0.05206374846632575
INFO:2022-12-05 01:51:12:running reward: -21173.88 at episode 8, frame count 25500, epsilon 0.018862122071335176
INFO:2022-12-05 01:51:14:running reward: -21173.88 at episode 8, frame count 25516, epsilon 0.0336945030221216
INFO:2022-12-05 01:51:14:time per episode 415.9328 seconds
INFO:2022-12-05 01:51:14:epsilon is 0.0336945030221216, episode is 9
INFO:2022-12-05 01:51:25:running reward: -21364.33 at episode 9, frame count 25600, epsilon 0.020280871538024617
INFO:2022-12-05 01:51:38:running reward: -21364.33 at episode 9, frame count 25700, epsilon 0.007347536163492152
INFO:2022-12-05 01:51:52:running reward: -21364.33 at episode 9, frame count 25800, epsilon 0.002661931346126132
INFO:2022-12-05 01:52:05:running reward: -21364.33 at episode 9, frame count 25900, epsilon 0.0009643883791544461
INFO:2022-12-05 01:52:17:running reward: -21364.33 at episode 9, frame count 26000, epsilon 0.036228897509242894
INFO:2022-12-05 01:52:30:running reward: -21364.33 at episode 9, frame count 26100, epsilon 0.013125330147352274
INFO:2022-12-05 01:52:42:running reward: -21364.33 at episode 9, frame count 26200, epsilon 0.004755162406834015
INFO:2022-12-05 01:52:53:running reward: -21364.33 at episode 9, frame count 26300, epsilon 0.0017227429147699447
INFO:2022-12-05 01:53:03:running reward: -21364.33 at episode 9, frame count 26400, epsilon 0.06471778159406795
INFO:2022-12-05 01:53:17:running reward: -21364.33 at episode 9, frame count 26500, epsilon 0.02344653876397055
INFO:2022-12-05 01:53:28:running reward: -21364.33 at episode 9, frame count 26600, epsilon 0.008494422498263801
INFO:2022-12-05 01:53:40:running reward: -21364.33 at episode 9, frame count 26700, epsilon 0.003077435620898062
INFO:2022-12-05 01:53:50:running reward: -21364.33 at episode 9, frame count 26800, epsilon 0.0011149209970080917
INFO:2022-12-05 01:54:02:running reward: -21364.33 at episode 9, frame count 26900, epsilon 0.04188391254457482
INFO:2022-12-05 01:54:14:running reward: -21364.33 at episode 9, frame count 27000, epsilon 0.015174079748634946
INFO:2022-12-05 01:54:26:running reward: -21364.33 at episode 9, frame count 27100, epsilon 0.005497401800103737
INFO:2022-12-05 01:54:39:running reward: -21364.33 at episode 9, frame count 27200, epsilon 0.0019916480638308568
INFO:2022-12-05 01:54:53:running reward: -21364.33 at episode 9, frame count 27300, epsilon 0.07481966305138833
INFO:2022-12-05 01:55:05:running reward: -21364.33 at episode 9, frame count 27400, epsilon 0.027106339043648356
INFO:2022-12-05 01:55:19:running reward: -21364.33 at episode 9, frame count 27500, epsilon 0.009820327790631259
INFO:2022-12-05 01:55:33:running reward: -21364.33 at episode 9, frame count 27600, epsilon 0.003557796490339496
INFO:2022-12-05 01:55:45:running reward: -21364.33 at episode 9, frame count 27700, epsilon 0.001288950444072538
INFO:2022-12-05 01:55:59:running reward: -21364.33 at episode 9, frame count 27800, epsilon 0.04842162612301505
INFO:2022-12-05 01:56:11:running reward: -21364.33 at episode 9, frame count 27900, epsilon 0.017542621300415916
INFO:2022-12-05 01:56:24:running reward: -21364.33 at episode 9, frame count 28000, epsilon 0.006355498291362296
INFO:2022-12-05 01:56:40:running reward: -21364.33 at episode 9, frame count 28100, epsilon 0.0023025269621793293
INFO:2022-12-05 01:56:54:running reward: -21364.33 at episode 9, frame count 28200, epsilon 0.08649836012976679
INFO:2022-12-05 01:57:09:running reward: -21364.33 at episode 9, frame count 28300, epsilon 0.03133740223858905
INFO:2022-12-05 01:57:21:running reward: -21364.33 at episode 9, frame count 28400, epsilon 0.011353195339077615
INFO:2022-12-05 01:57:34:running reward: -21364.33 at episode 9, frame count 28500, epsilon 0.004113137503418574
INFO:2022-12-05 01:57:47:running reward: -21364.33 at episode 9, frame count 28600, epsilon 0.0014901443705277473
INFO:2022-12-05 01:57:59:running reward: -21364.33 at episode 9, frame count 28700, epsilon 0.05597981979123285
INFO:2022-12-05 01:58:09:running reward: -21364.33 at episode 9, frame count 28800, epsilon 0.020280871538024617
INFO:2022-12-05 01:58:22:running reward: -21364.33 at episode 9, frame count 28900, epsilon 0.007347536163492152
INFO:2022-12-05 01:58:34:running reward: -21364.33 at episode 9, frame count 29000, epsilon 0.002661931346126132
INFO:2022-12-05 01:58:46:running reward: -21364.33 at episode 9, frame count 29100, epsilon 0.0009643883791544461
INFO:2022-12-05 01:58:48:running reward: -21364.33 at episode 9, frame count 29115, epsilon 0.0016613932472747926
INFO:2022-12-05 01:58:48:time per episode 453.6001 seconds
INFO:2022-12-05 01:58:48:epsilon is 0.0016613932472747926, episode is 10
INFO:2022-12-05 01:58:59:running reward: -21016.10 at episode 10, frame count 29200, epsilon 0.02102977594546134
INFO:2022-12-05 01:59:10:running reward: -21016.10 at episode 10, frame count 29300, epsilon 0.0076188559737046056
INFO:2022-12-05 01:59:21:running reward: -21016.10 at episode 10, frame count 29400, epsilon 0.002760227522090274
INFO:2022-12-05 01:59:36:running reward: -21016.10 at episode 10, frame count 29500, epsilon 0.0010000000000000002
INFO:2022-12-05 01:59:47:running reward: -21016.10 at episode 10, frame count 29600, epsilon 0.03756670890311598
INFO:2022-12-05 02:00:00:running reward: -21016.10 at episode 10, frame count 29700, epsilon 0.013610004466105522
INFO:2022-12-05 02:00:12:running reward: -21016.10 at episode 10, frame count 29800, epsilon 0.00493075456902875
INFO:2022-12-05 02:00:24:running reward: -21016.10 at episode 10, frame count 29900, epsilon 0.001786358019245739
INFO:2022-12-05 02:00:35:running reward: -21016.10 at episode 10, frame count 30000, epsilon 0.06710759170575145
INFO:2022-12-05 02:00:48:running reward: -21016.10 at episode 10, frame count 30100, epsilon 0.024312340619997878
INFO:2022-12-05 02:00:59:running reward: -21016.10 at episode 10, frame count 30200, epsilon 0.008808092965317064
INFO:2022-12-05 02:01:11:running reward: -21016.10 at episode 10, frame count 30300, epsilon 0.0031910749729235524
INFO:2022-12-05 02:01:23:running reward: -21016.10 at episode 10, frame count 30400, epsilon 0.0011560912813835744
INFO:2022-12-05 02:01:34:running reward: -21016.10 at episode 10, frame count 30500, epsilon 0.043430544633167076
INFO:2022-12-05 02:01:46:running reward: -21016.10 at episode 10, frame count 30600, epsilon 0.0157344075028561
INFO:2022-12-05 02:01:58:running reward: -21016.10 at episode 10, frame count 30700, epsilon 0.00570040236789636
INFO:2022-12-05 02:02:11:running reward: -21016.10 at episode 10, frame count 30800, epsilon 0.0020651929314796274
INFO:2022-12-05 02:02:24:running reward: -21016.10 at episode 10, frame count 30900, epsilon 0.07758250168566791
INFO:2022-12-05 02:02:35:running reward: -21016.10 at episode 10, frame count 31000, epsilon 0.028107285020807282
INFO:2022-12-05 02:02:46:running reward: -21016.10 at episode 10, frame count 31100, epsilon 0.01018295948281905
INFO:2022-12-05 02:02:59:running reward: -21016.10 at episode 10, frame count 31200, epsilon 0.0036891739544382437
INFO:2022-12-05 02:03:13:running reward: -21016.10 at episode 10, frame count 31300, epsilon 0.001336547050891116
INFO:2022-12-05 02:03:25:running reward: -21016.10 at episode 10, frame count 31400, epsilon 0.05020967399614466
INFO:2022-12-05 02:03:39:running reward: -21016.10 at episode 10, frame count 31500, epsilon 0.01819041133178823
INFO:2022-12-05 02:03:56:running reward: -21016.10 at episode 10, frame count 31600, epsilon 0.006590185477903263
INFO:2022-12-05 02:04:11:running reward: -21016.10 at episode 10, frame count 31700, epsilon 0.0023875515424585823
INFO:2022-12-05 02:04:23:running reward: -21016.10 at episode 10, frame count 31800, epsilon 0.08969245378672715
INFO:2022-12-05 02:04:34:running reward: -21016.10 at episode 10, frame count 31900, epsilon 0.03249458715591843
INFO:2022-12-05 02:04:45:running reward: -21016.10 at episode 10, frame count 32000, epsilon 0.011772430676769304
INFO:2022-12-05 02:04:57:running reward: -21016.10 at episode 10, frame count 32100, epsilon 0.004265021844233421
INFO:2022-12-05 02:05:07:running reward: -21016.10 at episode 10, frame count 32200, epsilon 0.001545170392694149
INFO:2022-12-05 02:05:19:running reward: -21016.10 at episode 10, frame count 32300, epsilon 0.0580469663480544
INFO:2022-12-05 02:05:30:running reward: -21016.10 at episode 10, frame count 32400, epsilon 0.02102977594546134
INFO:2022-12-05 02:05:41:running reward: -21016.10 at episode 10, frame count 32500, epsilon 0.0076188559737046056
INFO:2022-12-05 02:05:53:running reward: -21016.10 at episode 10, frame count 32600, epsilon 0.002760227522090274
INFO:2022-12-05 02:06:04:running reward: -21016.10 at episode 10, frame count 32700, epsilon 0.0010000000000000002
INFO:2022-12-05 02:06:06:running reward: -21016.10 at episode 10, frame count 32714, epsilon 0.0016613932472747926
INFO:2022-12-05 02:06:06:time per episode 437.8095 seconds
INFO:2022-12-05 02:06:06:epsilon is 0.0016613932472747926, episode is 11
INFO:2022-12-05 02:06:16:running reward: -20741.36 at episode 11, frame count 32800, epsilon 0.02180633487506329
INFO:2022-12-05 02:06:27:running reward: -20741.36 at episode 11, frame count 32900, epsilon 0.007900194712408964
INFO:2022-12-05 02:06:38:running reward: -20741.36 at episode 11, frame count 33000, epsilon 0.0028621534453892733
INFO:2022-12-05 02:06:49:running reward: -20741.36 at episode 11, frame count 33100, epsilon 0.001036926638287344
INFO:2022-12-05 02:06:59:running reward: -20741.36 at episode 11, frame count 33200, epsilon 0.03895392117442729
INFO:2022-12-05 02:07:09:running reward: -20741.36 at episode 11, frame count 33300, epsilon 0.014112576178114535
INFO:2022-12-05 02:07:20:running reward: -20741.36 at episode 11, frame count 33400, epsilon 0.005112830759482943
INFO:2022-12-05 02:07:31:running reward: -20741.36 at episode 11, frame count 33500, epsilon 0.0018523222156741205
INFO:2022-12-05 02:07:42:running reward: -20741.36 at episode 11, frame count 33600, epsilon 0.0695856494710045
INFO:2022-12-05 02:07:52:running reward: -20741.36 at episode 11, frame count 33700, epsilon 0.025210113627991238
INFO:2022-12-05 02:08:04:running reward: -20741.36 at episode 11, frame count 33800, epsilon 0.009133346228248625
INFO:2022-12-05 02:08:16:running reward: -20741.36 at episode 11, frame count 33900, epsilon 0.0033089106441964965
INFO:2022-12-05 02:08:26:running reward: -20741.36 at episode 11, frame count 34000, epsilon 0.0011987818459583788
INFO:2022-12-05 02:08:38:running reward: -20741.36 at episode 11, frame count 34100, epsilon 0.04503428864545839
INFO:2022-12-05 02:08:51:running reward: -20741.36 at episode 11, frame count 34200, epsilon 0.016315426277379738
INFO:2022-12-05 02:09:02:running reward: -20741.36 at episode 11, frame count 34300, epsilon 0.005910899064227988
INFO:2022-12-05 02:09:14:running reward: -20741.36 at episode 11, frame count 34400, epsilon 0.002141453563853955
INFO:2022-12-05 02:09:25:running reward: -20741.36 at episode 11, frame count 34500, epsilon 0.08044736266284182
INFO:2022-12-05 02:09:37:running reward: -20741.36 at episode 11, frame count 34600, epsilon 0.02914519256800991
INFO:2022-12-05 02:09:49:running reward: -20741.36 at episode 11, frame count 34700, epsilon 0.010558981944335787
INFO:2022-12-05 02:10:00:running reward: -20741.36 at episode 11, frame count 34800, epsilon 0.003825402746632875
INFO:2022-12-05 02:10:10:running reward: -20741.36 at episode 11, frame count 34900, epsilon 0.0013859012403933883
INFO:2022-12-05 02:10:21:running reward: -20741.36 at episode 11, frame count 35000, epsilon 0.05206374846632575
INFO:2022-12-05 02:10:31:running reward: -20741.36 at episode 11, frame count 35100, epsilon 0.018862122071335176
INFO:2022-12-05 02:10:43:running reward: -20741.36 at episode 11, frame count 35200, epsilon 0.006833538873292304
INFO:2022-12-05 02:10:54:running reward: -20741.36 at episode 11, frame count 35300, epsilon 0.0024757157946593404
INFO:2022-12-05 02:11:05:running reward: -20741.36 at episode 11, frame count 35400, epsilon 0.09300449458481394
INFO:2022-12-05 02:11:16:running reward: -20741.36 at episode 11, frame count 35500, epsilon 0.0336945030221216
INFO:2022-12-05 02:11:27:running reward: -20741.36 at episode 11, frame count 35600, epsilon 0.012207146966133196
INFO:2022-12-05 02:11:37:running reward: -20741.36 at episode 11, frame count 35700, epsilon 0.004422514763163049
INFO:2022-12-05 02:11:48:running reward: -20741.36 at episode 11, frame count 35800, epsilon 0.0016022283408774788
INFO:2022-12-05 02:11:58:running reward: -20741.36 at episode 11, frame count 35900, epsilon 0.06019044567806663
INFO:2022-12-05 02:12:08:running reward: -20741.36 at episode 11, frame count 36000, epsilon 0.02180633487506329
INFO:2022-12-05 02:12:19:running reward: -20741.36 at episode 11, frame count 36100, epsilon 0.007900194712408964
INFO:2022-12-05 02:12:32:running reward: -20741.36 at episode 11, frame count 36200, epsilon 0.0028621534453892733
INFO:2022-12-05 02:12:44:running reward: -20741.36 at episode 11, frame count 36300, epsilon 0.001036926638287344
INFO:2022-12-05 02:12:45:running reward: -20741.36 at episode 11, frame count 36313, epsilon 0.0016613932472747926
INFO:2022-12-05 02:12:45:time per episode 399.5311 seconds
INFO:2022-12-05 02:12:45:epsilon is 0.0016613932472747926, episode is 12
INFO:2022-12-05 02:12:55:running reward: -20508.08 at episode 12, frame count 36400, epsilon 0.022611569515367445
INFO:2022-12-05 02:13:06:running reward: -20508.08 at episode 12, frame count 36500, epsilon 0.008191922344953686
INFO:2022-12-05 02:13:17:running reward: -20508.08 at episode 12, frame count 36600, epsilon 0.002967843150390038
INFO:2022-12-05 02:13:28:running reward: -20508.08 at episode 12, frame count 36700, epsilon 0.0010752168531898924
INFO:2022-12-05 02:13:40:running reward: -20508.08 at episode 12, frame count 36800, epsilon 0.04039235853150907
INFO:2022-12-05 02:13:50:running reward: -20508.08 at episode 12, frame count 36900, epsilon 0.014633706173946357
INFO:2022-12-05 02:14:01:running reward: -20508.08 at episode 12, frame count 37000, epsilon 0.005301630411562776
INFO:2022-12-05 02:14:12:running reward: -20508.08 at episode 12, frame count 37100, epsilon 0.0019207222481239302
INFO:2022-12-05 02:14:23:running reward: -20508.08 at episode 12, frame count 37200, epsilon 0.07215521357901018
INFO:2022-12-05 02:14:35:running reward: -20508.08 at episode 12, frame count 37300, epsilon 0.02614103837511491
INFO:2022-12-05 02:14:45:running reward: -20508.08 at episode 12, frame count 37400, epsilon 0.00947061000077224
INFO:2022-12-05 02:14:57:running reward: -20508.08 at episode 12, frame count 37500, epsilon 0.0034310975906798823
INFO:2022-12-05 02:15:07:running reward: -20508.08 at episode 12, frame count 37600, epsilon 0.0012430488295695182
INFO:2022-12-05 02:15:19:running reward: -20508.08 at episode 12, frame count 37700, epsilon 0.046697253532797064
INFO:2022-12-05 02:15:30:running reward: -20508.08 at episode 12, frame count 37800, epsilon 0.016917900122028363
INFO:2022-12-05 02:15:42:running reward: -20508.08 at episode 12, frame count 37900, epsilon 0.0061291686959257345
INFO:2022-12-05 02:15:52:running reward: -20508.08 at episode 12, frame count 38000, epsilon 0.0022205302450155335
INFO:2022-12-05 02:16:03:running reward: -20508.08 at episode 12, frame count 38100, epsilon 0.08341801332506335
INFO:2022-12-05 02:16:14:running reward: -20508.08 at episode 12, frame count 38200, epsilon 0.0302214265517838
INFO:2022-12-05 02:16:25:running reward: -20508.08 at episode 12, frame count 38300, epsilon 0.01094888965127687
INFO:2022-12-05 02:16:37:running reward: -20508.08 at episode 12, frame count 38400, epsilon 0.003966662010161204
INFO:2022-12-05 02:16:48:running reward: -20508.08 at episode 12, frame count 38500, epsilon 0.0014370779141993763
INFO:2022-12-05 02:16:59:running reward: -20508.08 at episode 12, frame count 38600, epsilon 0.05398628767382502
INFO:2022-12-05 02:17:09:running reward: -20508.08 at episode 12, frame count 38700, epsilon 0.019558636830395097
INFO:2022-12-05 02:17:21:running reward: -20508.08 at episode 12, frame count 38800, epsilon 0.0070858784914888725
INFO:2022-12-05 02:17:31:running reward: -20508.08 at episode 12, frame count 38900, epsilon 0.0025671356563109903
INFO:2022-12-05 02:17:41:running reward: -20508.08 at episode 12, frame count 39000, epsilon 0.0964388379154446
INFO:2022-12-05 02:17:52:running reward: -20508.08 at episode 12, frame count 39100, epsilon 0.0349387277474913
INFO:2022-12-05 02:18:03:running reward: -20508.08 at episode 12, frame count 39200, epsilon 0.012657915866672044
INFO:2022-12-05 02:18:14:running reward: -20508.08 at episode 12, frame count 39300, epsilon 0.004585823366142809
INFO:2022-12-05 02:18:24:running reward: -20508.08 at episode 12, frame count 39400, epsilon 0.0016613932472747926
INFO:2022-12-05 02:18:36:running reward: -20508.08 at episode 12, frame count 39500, epsilon 0.062413076493974616
INFO:2022-12-05 02:18:47:running reward: -20508.08 at episode 12, frame count 39600, epsilon 0.022611569515367445
INFO:2022-12-05 02:18:58:running reward: -20508.08 at episode 12, frame count 39700, epsilon 0.008191922344953686
INFO:2022-12-05 02:19:10:running reward: -20508.08 at episode 12, frame count 39800, epsilon 0.002967843150390038
INFO:2022-12-05 02:19:21:running reward: -20508.08 at episode 12, frame count 39900, epsilon 0.0010752168531898924
INFO:2022-12-05 02:19:22:running reward: -20508.08 at episode 12, frame count 39912, epsilon 0.0016613932472747926
INFO:2022-12-05 02:19:22:time per episode 396.8530 seconds
INFO:2022-12-05 02:19:22:epsilon is 0.0016613932472747926, episode is 13
INFO:2022-12-05 02:19:31:running reward: -20307.00 at episode 13, frame count 40000, epsilon 0.02344653876397055
INFO:2022-12-05 02:19:41:running reward: -20307.00 at episode 13, frame count 40100, epsilon 0.008494422498263801
INFO:2022-12-05 02:19:53:running reward: -20307.00 at episode 13, frame count 40200, epsilon 0.003077435620898062
INFO:2022-12-05 02:20:05:running reward: -20307.00 at episode 13, frame count 40300, epsilon 0.0011149209970080917
INFO:2022-12-05 02:20:16:running reward: -20307.00 at episode 13, frame count 40400, epsilon 0.04188391254457482
INFO:2022-12-05 02:20:27:running reward: -20307.00 at episode 13, frame count 40500, epsilon 0.015174079748634946
INFO:2022-12-05 02:20:38:running reward: -20307.00 at episode 13, frame count 40600, epsilon 0.005497401800103737
INFO:2022-12-05 02:20:49:running reward: -20307.00 at episode 13, frame count 40700, epsilon 0.0019916480638308568
INFO:2022-12-05 02:21:01:running reward: -20307.00 at episode 13, frame count 40800, epsilon 0.07481966305138833
INFO:2022-12-05 02:21:12:running reward: -20307.00 at episode 13, frame count 40900, epsilon 0.027106339043648356
INFO:2022-12-05 02:21:24:running reward: -20307.00 at episode 13, frame count 41000, epsilon 0.009820327790631259
INFO:2022-12-05 02:21:35:running reward: -20307.00 at episode 13, frame count 41100, epsilon 0.003557796490339496
INFO:2022-12-05 02:21:46:running reward: -20307.00 at episode 13, frame count 41200, epsilon 0.001288950444072538
INFO:2022-12-05 02:21:57:running reward: -20307.00 at episode 13, frame count 41300, epsilon 0.04842162612301505
INFO:2022-12-05 02:22:08:running reward: -20307.00 at episode 13, frame count 41400, epsilon 0.017542621300415916
INFO:2022-12-05 02:22:19:running reward: -20307.00 at episode 13, frame count 41500, epsilon 0.006355498291362296
INFO:2022-12-05 02:22:30:running reward: -20307.00 at episode 13, frame count 41600, epsilon 0.0023025269621793293
INFO:2022-12-05 02:22:42:running reward: -20307.00 at episode 13, frame count 41700, epsilon 0.08649836012976679
INFO:2022-12-05 02:22:54:running reward: -20307.00 at episode 13, frame count 41800, epsilon 0.03133740223858905
INFO:2022-12-05 02:23:04:running reward: -20307.00 at episode 13, frame count 41900, epsilon 0.011353195339077615
INFO:2022-12-05 02:23:15:running reward: -20307.00 at episode 13, frame count 42000, epsilon 0.004113137503418574
INFO:2022-12-05 02:23:27:running reward: -20307.00 at episode 13, frame count 42100, epsilon 0.0014901443705277473
INFO:2022-12-05 02:23:37:running reward: -20307.00 at episode 13, frame count 42200, epsilon 0.05597981979123285
INFO:2022-12-05 02:23:49:running reward: -20307.00 at episode 13, frame count 42300, epsilon 0.020280871538024617
INFO:2022-12-05 02:23:57:running reward: -20307.00 at episode 13, frame count 42376, epsilon 0.003077435620898062
INFO:2022-12-05 02:23:57:time per episode 274.3681 seconds
INFO:2022-12-05 02:23:57:epsilon is 0.003077435620898062, episode is 14
INFO:2022-12-05 02:23:58:running reward: -20194.79 at episode 14, frame count 42400, epsilon 0.0023025269621793293
INFO:2022-12-05 02:24:10:running reward: -20194.79 at episode 14, frame count 42500, epsilon 0.08649836012976679
INFO:2022-12-05 02:24:21:running reward: -20194.79 at episode 14, frame count 42600, epsilon 0.03133740223858905
INFO:2022-12-05 02:24:31:running reward: -20194.79 at episode 14, frame count 42700, epsilon 0.011353195339077615
INFO:2022-12-05 02:24:42:running reward: -20194.79 at episode 14, frame count 42800, epsilon 0.004113137503418574
INFO:2022-12-05 02:24:52:running reward: -20194.79 at episode 14, frame count 42900, epsilon 0.0014901443705277473
INFO:2022-12-05 02:25:03:running reward: -20194.79 at episode 14, frame count 43000, epsilon 0.05597981979123285
INFO:2022-12-05 02:25:15:running reward: -20194.79 at episode 14, frame count 43100, epsilon 0.020280871538024617
INFO:2022-12-05 02:25:26:running reward: -20194.79 at episode 14, frame count 43200, epsilon 0.007347536163492152
INFO:2022-12-05 02:25:38:running reward: -20194.79 at episode 14, frame count 43300, epsilon 0.002661931346126132
INFO:2022-12-05 02:25:50:running reward: -20194.79 at episode 14, frame count 43400, epsilon 0.0009643883791544461
INFO:2022-12-05 02:26:00:running reward: -20194.79 at episode 14, frame count 43500, epsilon 0.036228897509242894
INFO:2022-12-05 02:26:12:running reward: -20194.79 at episode 14, frame count 43600, epsilon 0.013125330147352274
INFO:2022-12-05 02:26:22:running reward: -20194.79 at episode 14, frame count 43700, epsilon 0.004755162406834015
INFO:2022-12-05 02:26:33:running reward: -20194.79 at episode 14, frame count 43800, epsilon 0.0017227429147699447
INFO:2022-12-05 02:26:44:running reward: -20194.79 at episode 14, frame count 43900, epsilon 0.06471778159406795
INFO:2022-12-05 02:26:54:running reward: -20194.79 at episode 14, frame count 44000, epsilon 0.02344653876397055
INFO:2022-12-05 02:27:05:running reward: -20194.79 at episode 14, frame count 44100, epsilon 0.008494422498263801
INFO:2022-12-05 02:27:15:running reward: -20194.79 at episode 14, frame count 44200, epsilon 0.003077435620898062
INFO:2022-12-05 02:27:26:running reward: -20194.79 at episode 14, frame count 44300, epsilon 0.0011149209970080917
INFO:2022-12-05 02:27:38:running reward: -20194.79 at episode 14, frame count 44400, epsilon 0.04188391254457482
INFO:2022-12-05 02:27:48:running reward: -20194.79 at episode 14, frame count 44500, epsilon 0.015174079748634946
INFO:2022-12-05 02:28:00:running reward: -20194.79 at episode 14, frame count 44600, epsilon 0.005497401800103737
INFO:2022-12-05 02:28:09:running reward: -20194.79 at episode 14, frame count 44683, epsilon 0.0010752168531898924
INFO:2022-12-05 02:28:09:time per episode 252.3418 seconds
INFO:2022-12-05 02:28:09:epsilon is 0.0010752168531898924, episode is 15
INFO:2022-12-05 02:28:11:running reward: -20214.60 at episode 15, frame count 44700, epsilon 0.001786358019245739
INFO:2022-12-05 02:28:22:running reward: -20214.60 at episode 15, frame count 44800, epsilon 0.06710759170575145
INFO:2022-12-05 02:28:33:running reward: -20214.60 at episode 15, frame count 44900, epsilon 0.024312340619997878
INFO:2022-12-05 02:28:44:running reward: -20214.60 at episode 15, frame count 45000, epsilon 0.008808092965317064
INFO:2022-12-05 02:28:55:running reward: -20214.60 at episode 15, frame count 45100, epsilon 0.0031910749729235524
INFO:2022-12-05 02:29:07:running reward: -20214.60 at episode 15, frame count 45200, epsilon 0.0011560912813835744
INFO:2022-12-05 02:29:18:running reward: -20214.60 at episode 15, frame count 45300, epsilon 0.043430544633167076
INFO:2022-12-05 02:29:29:running reward: -20214.60 at episode 15, frame count 45400, epsilon 0.0157344075028561
INFO:2022-12-05 02:29:40:running reward: -20214.60 at episode 15, frame count 45500, epsilon 0.00570040236789636
INFO:2022-12-05 02:29:51:running reward: -20214.60 at episode 15, frame count 45600, epsilon 0.0020651929314796274
INFO:2022-12-05 02:30:02:running reward: -20214.60 at episode 15, frame count 45700, epsilon 0.07758250168566791
INFO:2022-12-05 02:30:15:running reward: -20214.60 at episode 15, frame count 45800, epsilon 0.028107285020807282
INFO:2022-12-05 02:30:25:running reward: -20214.60 at episode 15, frame count 45900, epsilon 0.01018295948281905
INFO:2022-12-05 02:30:37:running reward: -20214.60 at episode 15, frame count 46000, epsilon 0.0036891739544382437
INFO:2022-12-05 02:30:48:running reward: -20214.60 at episode 15, frame count 46100, epsilon 0.001336547050891116
INFO:2022-12-05 02:30:58:running reward: -20214.60 at episode 15, frame count 46200, epsilon 0.05020967399614466
INFO:2022-12-05 02:31:09:running reward: -20214.60 at episode 15, frame count 46300, epsilon 0.01819041133178823
INFO:2022-12-05 02:31:20:running reward: -20214.60 at episode 15, frame count 46400, epsilon 0.006590185477903263
INFO:2022-12-05 02:31:30:running reward: -20214.60 at episode 15, frame count 46500, epsilon 0.0023875515424585823
INFO:2022-12-05 02:31:41:running reward: -20214.60 at episode 15, frame count 46600, epsilon 0.08969245378672715
INFO:2022-12-05 02:31:52:running reward: -20214.60 at episode 15, frame count 46700, epsilon 0.03249458715591843
INFO:2022-12-05 02:32:02:running reward: -20214.60 at episode 15, frame count 46800, epsilon 0.011772430676769304
INFO:2022-12-05 02:32:13:running reward: -20214.60 at episode 15, frame count 46900, epsilon 0.004265021844233421
INFO:2022-12-05 02:32:24:running reward: -20214.60 at episode 15, frame count 47000, epsilon 0.001545170392694149
INFO:2022-12-05 02:32:34:running reward: -20214.60 at episode 15, frame count 47100, epsilon 0.0580469663480544
INFO:2022-12-05 02:32:43:running reward: -20214.60 at episode 15, frame count 47200, epsilon 0.02102977594546134
INFO:2022-12-05 02:32:51:running reward: -20214.60 at episode 15, frame count 47268, epsilon 0.0023875515424585823
INFO:2022-12-05 02:32:51:time per episode 281.8468 seconds
INFO:2022-12-05 02:32:51:epsilon is 0.0023875515424585823, episode is 16
INFO:2022-12-05 02:32:55:running reward: -20162.94 at episode 16, frame count 47300, epsilon 0.003077435620898062
INFO:2022-12-05 02:33:06:running reward: -20162.94 at episode 16, frame count 47400, epsilon 0.0011149209970080917
INFO:2022-12-05 02:33:17:running reward: -20162.94 at episode 16, frame count 47500, epsilon 0.04188391254457482
INFO:2022-12-05 02:33:27:running reward: -20162.94 at episode 16, frame count 47600, epsilon 0.015174079748634946
INFO:2022-12-05 02:33:38:running reward: -20162.94 at episode 16, frame count 47700, epsilon 0.005497401800103737
INFO:2022-12-05 02:33:47:running reward: -20162.94 at episode 16, frame count 47800, epsilon 0.0019916480638308568
INFO:2022-12-05 02:33:58:running reward: -20162.94 at episode 16, frame count 47900, epsilon 0.07481966305138833
INFO:2022-12-05 02:34:09:running reward: -20162.94 at episode 16, frame count 48000, epsilon 0.027106339043648356
INFO:2022-12-05 02:34:20:running reward: -20162.94 at episode 16, frame count 48100, epsilon 0.009820327790631259
INFO:2022-12-05 02:34:30:running reward: -20162.94 at episode 16, frame count 48200, epsilon 0.003557796490339496
INFO:2022-12-05 02:34:41:running reward: -20162.94 at episode 16, frame count 48300, epsilon 0.001288950444072538
INFO:2022-12-05 02:34:52:running reward: -20162.94 at episode 16, frame count 48400, epsilon 0.04842162612301505
INFO:2022-12-05 02:35:02:running reward: -20162.94 at episode 16, frame count 48500, epsilon 0.017542621300415916
INFO:2022-12-05 02:35:13:running reward: -20162.94 at episode 16, frame count 48600, epsilon 0.006355498291362296
INFO:2022-12-05 02:35:25:running reward: -20162.94 at episode 16, frame count 48700, epsilon 0.0023025269621793293
INFO:2022-12-05 02:35:36:running reward: -20162.94 at episode 16, frame count 48800, epsilon 0.08649836012976679
INFO:2022-12-05 02:35:47:running reward: -20162.94 at episode 16, frame count 48900, epsilon 0.03133740223858905
INFO:2022-12-05 02:35:57:running reward: -20162.94 at episode 16, frame count 49000, epsilon 0.011353195339077615
INFO:2022-12-05 02:36:08:running reward: -20162.94 at episode 16, frame count 49100, epsilon 0.004113137503418574
INFO:2022-12-05 02:36:11:running reward: -20162.94 at episode 16, frame count 49129, epsilon 0.011772430676769304
INFO:2022-12-05 02:36:11:time per episode 200.0415 seconds
INFO:2022-12-05 02:36:11:epsilon is 0.011772430676769304, episode is 17
INFO:2022-12-05 02:36:19:running reward: -19873.47 at episode 17, frame count 49200, epsilon 0.012657915866672044
INFO:2022-12-05 02:36:32:running reward: -19873.47 at episode 17, frame count 49300, epsilon 0.004585823366142809
INFO:2022-12-05 02:36:41:running reward: -19873.47 at episode 17, frame count 49400, epsilon 0.0016613932472747926
INFO:2022-12-05 02:36:52:running reward: -19873.47 at episode 17, frame count 49500, epsilon 0.062413076493974616
INFO:2022-12-05 02:37:04:running reward: -19873.47 at episode 17, frame count 49600, epsilon 0.022611569515367445
INFO:2022-12-05 02:37:15:running reward: -19873.47 at episode 17, frame count 49700, epsilon 0.008191922344953686
INFO:2022-12-05 02:37:26:running reward: -19873.47 at episode 17, frame count 49800, epsilon 0.002967843150390038
INFO:2022-12-05 02:37:37:running reward: -19873.47 at episode 17, frame count 49900, epsilon 0.0010752168531898924
INFO:2022-12-05 02:37:47:running reward: -19873.47 at episode 17, frame count 50000, epsilon 0.04039235853150907
INFO:2022-12-05 02:37:58:running reward: -19873.47 at episode 17, frame count 50100, epsilon 0.014633706173946357
INFO:2022-12-05 02:38:08:running reward: -19873.47 at episode 17, frame count 50200, epsilon 0.005301630411562776
INFO:2022-12-05 02:38:18:running reward: -19873.47 at episode 17, frame count 50300, epsilon 0.0019207222481239302
INFO:2022-12-05 02:38:30:running reward: -19873.47 at episode 17, frame count 50400, epsilon 0.07215521357901018
INFO:2022-12-05 02:38:41:running reward: -19873.47 at episode 17, frame count 50500, epsilon 0.02614103837511491
INFO:2022-12-05 02:38:52:running reward: -19873.47 at episode 17, frame count 50600, epsilon 0.00947061000077224
INFO:2022-12-05 02:39:03:running reward: -19873.47 at episode 17, frame count 50700, epsilon 0.0034310975906798823
INFO:2022-12-05 02:39:13:running reward: -19873.47 at episode 17, frame count 50800, epsilon 0.0012430488295695182
INFO:2022-12-05 02:39:25:running reward: -19873.47 at episode 17, frame count 50900, epsilon 0.046697253532797064
INFO:2022-12-05 02:39:35:running reward: -19873.47 at episode 17, frame count 51000, epsilon 0.016917900122028363
INFO:2022-12-05 02:39:45:running reward: -19873.47 at episode 17, frame count 51100, epsilon 0.0061291686959257345
INFO:2022-12-05 02:39:55:running reward: -19873.47 at episode 17, frame count 51200, epsilon 0.0022205302450155335
INFO:2022-12-05 02:40:05:running reward: -19873.47 at episode 17, frame count 51300, epsilon 0.08341801332506335
INFO:2022-12-05 02:40:16:running reward: -19873.47 at episode 17, frame count 51400, epsilon 0.0302214265517838
INFO:2022-12-05 02:40:27:running reward: -19873.47 at episode 17, frame count 51500, epsilon 0.01094888965127687
INFO:2022-12-05 02:40:37:running reward: -19873.47 at episode 17, frame count 51600, epsilon 0.003966662010161204
INFO:2022-12-05 02:40:47:running reward: -19873.47 at episode 17, frame count 51700, epsilon 0.0014370779141993763
INFO:2022-12-05 02:40:58:running reward: -19873.47 at episode 17, frame count 51800, epsilon 0.05398628767382502
INFO:2022-12-05 02:41:00:running reward: -19873.47 at episode 17, frame count 51821, epsilon 0.0011149209970080917
INFO:2022-12-05 02:41:00:time per episode 289.0482 seconds
INFO:2022-12-05 02:41:00:epsilon is 0.0011149209970080917, episode is 18
INFO:2022-12-05 02:41:08:running reward: -19901.17 at episode 18, frame count 51900, epsilon 0.016917900122028363
INFO:2022-12-05 02:41:19:running reward: -19901.17 at episode 18, frame count 52000, epsilon 0.0061291686959257345
INFO:2022-12-05 02:41:29:running reward: -19901.17 at episode 18, frame count 52100, epsilon 0.0022205302450155335
INFO:2022-12-05 02:41:39:running reward: -19901.17 at episode 18, frame count 52200, epsilon 0.08341801332506335
INFO:2022-12-05 02:41:50:running reward: -19901.17 at episode 18, frame count 52300, epsilon 0.0302214265517838
INFO:2022-12-05 02:42:02:running reward: -19901.17 at episode 18, frame count 52400, epsilon 0.01094888965127687
INFO:2022-12-05 02:42:11:running reward: -19901.17 at episode 18, frame count 52500, epsilon 0.003966662010161204
INFO:2022-12-05 02:42:22:running reward: -19901.17 at episode 18, frame count 52600, epsilon 0.0014370779141993763
INFO:2022-12-05 02:42:33:running reward: -19901.17 at episode 18, frame count 52700, epsilon 0.05398628767382502
INFO:2022-12-05 02:42:43:running reward: -19901.17 at episode 18, frame count 52800, epsilon 0.019558636830395097
INFO:2022-12-05 02:42:55:running reward: -19901.17 at episode 18, frame count 52900, epsilon 0.0070858784914888725
INFO:2022-12-05 02:43:06:running reward: -19901.17 at episode 18, frame count 53000, epsilon 0.0025671356563109903
INFO:2022-12-05 02:43:17:running reward: -19901.17 at episode 18, frame count 53100, epsilon 0.0964388379154446
INFO:2022-12-05 02:43:28:running reward: -19901.17 at episode 18, frame count 53200, epsilon 0.0349387277474913
INFO:2022-12-05 02:43:39:running reward: -19901.17 at episode 18, frame count 53300, epsilon 0.012657915866672044
INFO:2022-12-05 02:43:50:running reward: -19901.17 at episode 18, frame count 53400, epsilon 0.004585823366142809
INFO:2022-12-05 02:44:01:running reward: -19901.17 at episode 18, frame count 53500, epsilon 0.0016613932472747926
INFO:2022-12-05 02:44:12:running reward: -19901.17 at episode 18, frame count 53600, epsilon 0.062413076493974616
INFO:2022-12-05 02:44:23:running reward: -19901.17 at episode 18, frame count 53700, epsilon 0.022611569515367445
INFO:2022-12-05 02:44:33:running reward: -19901.17 at episode 18, frame count 53800, epsilon 0.008191922344953686
INFO:2022-12-05 02:44:40:running reward: -19901.17 at episode 18, frame count 53859, epsilon 0.0695856494710045
INFO:2022-12-05 02:44:40:time per episode 220.3924 seconds
INFO:2022-12-05 02:44:40:epsilon is 0.0695856494710045, episode is 19
INFO:2022-12-05 02:44:45:running reward: -19780.47 at episode 19, frame count 53900, epsilon 0.004265021844233421
INFO:2022-12-05 02:44:55:running reward: -19780.47 at episode 19, frame count 54000, epsilon 0.001545170392694149
INFO:2022-12-05 02:45:05:running reward: -19780.47 at episode 19, frame count 54100, epsilon 0.0580469663480544
INFO:2022-12-05 02:45:16:running reward: -19780.47 at episode 19, frame count 54200, epsilon 0.02102977594546134
INFO:2022-12-05 02:45:27:running reward: -19780.47 at episode 19, frame count 54300, epsilon 0.0076188559737046056
INFO:2022-12-05 02:45:39:running reward: -19780.47 at episode 19, frame count 54400, epsilon 0.002760227522090274
INFO:2022-12-05 02:45:49:running reward: -19780.47 at episode 19, frame count 54500, epsilon 0.0010000000000000002
INFO:2022-12-05 02:46:01:running reward: -19780.47 at episode 19, frame count 54600, epsilon 0.03756670890311598
INFO:2022-12-05 02:46:13:running reward: -19780.47 at episode 19, frame count 54700, epsilon 0.013610004466105522
INFO:2022-12-05 02:46:23:running reward: -19780.47 at episode 19, frame count 54800, epsilon 0.00493075456902875
INFO:2022-12-05 02:46:33:running reward: -19780.47 at episode 19, frame count 54900, epsilon 0.001786358019245739
INFO:2022-12-05 02:46:44:running reward: -19780.47 at episode 19, frame count 55000, epsilon 0.06710759170575145
INFO:2022-12-05 02:46:54:running reward: -19780.47 at episode 19, frame count 55100, epsilon 0.024312340619997878
INFO:2022-12-05 02:47:04:running reward: -19780.47 at episode 19, frame count 55200, epsilon 0.008808092965317064
INFO:2022-12-05 02:47:14:running reward: -19780.47 at episode 19, frame count 55300, epsilon 0.0031910749729235524
INFO:2022-12-05 02:47:25:running reward: -19780.47 at episode 19, frame count 55400, epsilon 0.0011560912813835744
INFO:2022-12-05 02:47:35:running reward: -19780.47 at episode 19, frame count 55500, epsilon 0.043430544633167076
INFO:2022-12-05 02:47:45:running reward: -19780.47 at episode 19, frame count 55600, epsilon 0.0157344075028561
INFO:2022-12-05 02:47:56:running reward: -19780.47 at episode 19, frame count 55700, epsilon 0.00570040236789636
INFO:2022-12-05 02:48:06:running reward: -19780.47 at episode 19, frame count 55800, epsilon 0.0020651929314796274
INFO:2022-12-05 02:48:16:running reward: -19780.47 at episode 19, frame count 55900, epsilon 0.07758250168566791
INFO:2022-12-05 02:48:27:running reward: -19780.47 at episode 19, frame count 56000, epsilon 0.028107285020807282
INFO:2022-12-05 02:48:38:running reward: -19780.47 at episode 19, frame count 56100, epsilon 0.01018295948281905
INFO:2022-12-05 02:48:48:running reward: -19780.47 at episode 19, frame count 56200, epsilon 0.0036891739544382437
INFO:2022-12-05 02:48:58:running reward: -19780.47 at episode 19, frame count 56300, epsilon 0.001336547050891116
INFO:2022-12-05 02:49:09:running reward: -19780.47 at episode 19, frame count 56400, epsilon 0.05020967399614466
INFO:2022-12-05 02:49:19:running reward: -19780.47 at episode 19, frame count 56500, epsilon 0.01819041133178823
INFO:2022-12-05 02:49:22:running reward: -19780.47 at episode 19, frame count 56526, epsilon 0.046697253532797064
INFO:2022-12-05 02:49:22:time per episode 281.1414 seconds