main_output

Download start
Files already downloaded and verified
Download end
[0.49139968 0.48215841 0.44653091]
[0.24703223 0.24348513 0.26158784]
Files already downloaded and verified
Files already downloaded and verified
Epoch 0, Train loss 2.3436457948251204, Train accuracy 0.23205965909768234, Validation loss 1.8368772923946382, Validation accuracy 0.3383961394429207
Validation accuracy increased from 0.00 to 0.34
Epoch 1, Train loss 1.631156435744329, Train accuracy 0.3914506391368129, Validation loss 1.5508225560188293, Validation accuracy 0.4149931073188782
Validation accuracy increased from 0.34 to 0.41
Epoch 2, Train loss 1.392763616009192, Train accuracy 0.4876997514881871, Validation loss 1.4325124680995942, Validation accuracy 0.48965992629528043
Validation accuracy increased from 0.41 to 0.49
Epoch 3, Train loss 1.21999694745649, Train accuracy 0.5604723011228171, Validation loss 1.144394624233246, Validation accuracy 0.6007697612047196
Validation accuracy increased from 0.49 to 0.60
Epoch 4, Train loss 1.095654425973242, Train accuracy 0.6069975139742548, Validation loss 0.9752583295106888, Validation accuracy 0.6495634198188782
Validation accuracy increased from 0.60 to 0.65
Epoch 5, Train loss 0.9691054773601618, Train accuracy 0.6566326347264376, Validation loss 0.9848445594310761, Validation accuracy 0.664280790090561
Validation accuracy increased from 0.65 to 0.66
Epoch 6, Train loss 0.8565919578752734, Train accuracy 0.6963725140826269, Validation loss 0.9242273837327957, Validation accuracy 0.6886029422283173
Validation accuracy increased from 0.66 to 0.69
Epoch 7, Train loss 0.7733363902026956, Train accuracy 0.7304909446022727, Validation loss 0.7765829265117645, Validation accuracy 0.7410386025905609
Validation accuracy increased from 0.69 to 0.74
Epoch 8, Train loss 0.7074926465072415, Train accuracy 0.7533087713474577, Validation loss 0.8166069030761719, Validation accuracy 0.7292394310235977
Epoch 9, Train loss 0.6527382216670297, Train accuracy 0.7726029828190804, Validation loss 0.6965086132287979, Validation accuracy 0.765234375
Validation accuracy increased from 0.74 to 0.77
Epoch 10, Train loss 0.6152314597910101, Train accuracy 0.7863378904082559, Validation loss 0.644538739323616, Validation accuracy 0.7818818926811218
Validation accuracy increased from 0.77 to 0.78
Epoch 11, Train loss 0.5740735432641073, Train accuracy 0.7986878549510782, Validation loss 0.5603141456842422, Validation accuracy 0.8123621314764022
Validation accuracy increased from 0.78 to 0.81
Epoch 12, Train loss 0.5442576208575205, Train accuracy 0.8090110082517971, Validation loss 0.4997681513428688, Validation accuracy 0.8284122258424759
Validation accuracy increased from 0.81 to 0.83
Epoch 13, Train loss 0.531786953353069, Train accuracy 0.8172665126621723, Validation loss 0.5796727150678634, Validation accuracy 0.8100068926811218
Epoch 14, Train loss 0.49145909974520857, Train accuracy 0.829861505465074, Validation loss 0.5451171070337295, Validation accuracy 0.8197380512952804
Epoch 15, Train loss 0.47390432689677586, Train accuracy 0.8353710936551745, Validation loss 0.5461321189999581, Validation accuracy 0.8205652564764023
Epoch 16, Train loss 0.45712852308695967, Train accuracy 0.8429802910170772, Validation loss 0.5679224878549576, Validation accuracy 0.8182444840669632
Epoch 17, Train loss 0.43465130556036125, Train accuracy 0.8498517400161787, Validation loss 0.5276256173849105, Validation accuracy 0.8299977034330368
Validation accuracy increased from 0.83 to 0.83
Epoch 18, Train loss 0.418949509378184, Train accuracy 0.8547114699401639, Validation loss 0.5482546910643578, Validation accuracy 0.8226907163858413
Epoch 19, Train loss 0.4106322538784959, Train accuracy 0.856562499972907, Validation loss 0.4615340352058411, Validation accuracy 0.8470588237047195
Validation accuracy increased from 0.83 to 0.85
Epoch 20, Train loss 0.3134978177364577, Train accuracy 0.8900257457386364, Validation loss 0.3987163782119751, Validation accuracy 0.8756318926811218
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.2872631988403472, Train accuracy 0.9004216973077167, Validation loss 0.37984649091959, Validation accuracy 0.8807789534330368
Validation accuracy increased from 0.88 to 0.88
Epoch 22, Train loss 0.27042043962600554, Train accuracy 0.9055806107141755, Validation loss 0.4087361186742783, Validation accuracy 0.8727251827716828
Epoch 23, Train loss 0.2590693867850033, Train accuracy 0.9100541546940804, Validation loss 0.40315486639738085, Validation accuracy 0.8705537676811218
Epoch 24, Train loss 0.24717496894299984, Train accuracy 0.9137792966582559, Validation loss 0.4094338059425354, Validation accuracy 0.8695772051811218
Epoch 25, Train loss 0.24784730654209852, Train accuracy 0.9132057882168076, Validation loss 0.39082677066326144, Validation accuracy 0.879124540090561
Epoch 26, Train loss 0.24135515610264105, Train accuracy 0.9140642756088213, Validation loss 0.4266552165150642, Validation accuracy 0.8700597435235977
Epoch 27, Train loss 0.22956034194000743, Train accuracy 0.9185005324808034, Validation loss 0.3995420813560486, Validation accuracy 0.8763901650905609
Epoch 28, Train loss 0.21927468931641092, Train accuracy 0.9217782315205444, Validation loss 0.4046857178211212, Validation accuracy 0.8799057900905609
Epoch 29, Train loss 0.22056891261176628, Train accuracy 0.9222167967395349, Validation loss 0.38674264699220656, Validation accuracy 0.8815372258424758
Validation accuracy increased from 0.88 to 0.88
Epoch 30, Train loss 0.21048677107319236, Train accuracy 0.925395951690999, Validation loss 0.41254793405532836, Validation accuracy 0.8789751827716827
Epoch 31, Train loss 0.20545138249343092, Train accuracy 0.9277583452110941, Validation loss 0.3988938838243484, Validation accuracy 0.8839613974094391
Validation accuracy increased from 0.88 to 0.88
Epoch 32, Train loss 0.1996892811730504, Train accuracy 0.9292959872294556, Validation loss 0.43361801505088804, Validation accuracy 0.8724839150905609
Epoch 33, Train loss 0.1952657780017365, Train accuracy 0.9307066760957241, Validation loss 0.41943078935146333, Validation accuracy 0.8778262883424759
Epoch 34, Train loss 0.18727842506698586, Train accuracy 0.9336843040179122, Validation loss 0.40076099038124086, Validation accuracy 0.883030790090561
Epoch 35, Train loss 0.1779876731505448, Train accuracy 0.9366867897862737, Validation loss 0.4262526035308838, Validation accuracy 0.8760914534330368
Epoch 36, Train loss 0.17744937441735106, Train accuracy 0.938006036660888, Validation loss 0.4076725110411644, Validation accuracy 0.8840762883424759
Validation accuracy increased from 0.88 to 0.88
Epoch 37, Train loss 0.1690837356515906, Train accuracy 0.9399928975511681, Validation loss 0.4088290110230446, Validation accuracy 0.8815831810235977
Epoch 38, Train loss 0.16937142580916936, Train accuracy 0.9398801489309832, Validation loss 0.43351516872644424, Validation accuracy 0.8774356633424759
Epoch 39, Train loss 0.16182550152933056, Train accuracy 0.9424698153002695, Validation loss 0.42426684945821763, Validation accuracy 0.8829848349094391
Epoch 40, Train loss 0.12427828160368583, Train accuracy 0.9562491120939905, Validation loss 0.38984759896993637, Validation accuracy 0.8950942099094391
Validation accuracy increased from 0.88 to 0.90
Epoch 41, Train loss 0.10814701678993349, Train accuracy 0.9619664417749102, Validation loss 0.39851830899715424, Validation accuracy 0.8987132340669632
Validation accuracy increased from 0.90 to 0.90
Epoch 42, Train loss 0.10193635993213816, Train accuracy 0.964242720129815, Validation loss 0.41354055255651473, Validation accuracy 0.8935317099094391
Epoch 43, Train loss 0.09764317653819242, Train accuracy 0.9654509943317283, Validation loss 0.409578375518322, Validation accuracy 0.8943818926811218
Epoch 44, Train loss 0.09553247994997284, Train accuracy 0.9659667966718023, Validation loss 0.4130309410393238, Validation accuracy 0.8964384198188782
Epoch 45, Train loss 0.09320971602573991, Train accuracy 0.966937144710259, Validation loss 0.41578262895345686, Validation accuracy 0.8951171875
Epoch 46, Train loss 0.08929876430722122, Train accuracy 0.9677015268667177, Validation loss 0.42473036497831346, Validation accuracy 0.8963350176811218
Epoch 47, Train loss 0.088555724571713, Train accuracy 0.9682910154488954, Validation loss 0.4387800991535187, Validation accuracy 0.8958524823188782
Epoch 48, Train loss 0.08429914844137701, Train accuracy 0.9700665836307135, Validation loss 0.44841698557138443, Validation accuracy 0.8937959551811219
Epoch 49, Train loss 0.08305465142157945, Train accuracy 0.9715118960223414, Validation loss 0.43317012712359426, Validation accuracy 0.895726102590561
Epoch 50, Train loss 0.08330798008352179, Train accuracy 0.9700639203868129, Validation loss 0.4414339780807495, Validation accuracy 0.8939682900905609
Epoch 51, Train loss 0.08123901513913138, Train accuracy 0.9712491120127115, Validation loss 0.4508598044514656, Validation accuracy 0.8936006426811218
Epoch 52, Train loss 0.07778438183860006, Train accuracy 0.972444069317796, Validation loss 0.4474801316857338, Validation accuracy 0.8962890625
Epoch 53, Train loss 0.07522340603596107, Train accuracy 0.9740616120398045, Validation loss 0.4484008677303791, Validation accuracy 0.8958984375
Epoch 54, Train loss 0.07143537747800689, Train accuracy 0.9745019528676163, Validation loss 0.4584856674075127, Validation accuracy 0.8984834551811218
Epoch 55, Train loss 0.06924539365255358, Train accuracy 0.9762935011901639, Validation loss 0.44995453804731367, Validation accuracy 0.898219209909439
Epoch 56, Train loss 0.07223244464363564, Train accuracy 0.9733957739716227, Validation loss 0.47452287971973417, Validation accuracy 0.8964384198188782
Epoch 57, Train loss 0.06868468918202614, Train accuracy 0.9757040126079862, Validation loss 0.4618359714746475, Validation accuracy 0.8959214150905609
Epoch 58, Train loss 0.06539179404816506, Train accuracy 0.9770099429244344, Validation loss 0.4680944114923477, Validation accuracy 0.897242647409439
Epoch 59, Train loss 0.063257385246371, Train accuracy 0.9776100851595402, Validation loss 0.4583980217576027, Validation accuracy 0.8984604775905609
Epoch 60, Train loss 0.056901408401741224, Train accuracy 0.9804474430328066, Validation loss 0.4481380470097065, Validation accuracy 0.9029756426811218
Validation accuracy increased from 0.90 to 0.90
Epoch 61, Train loss 0.05106041506356136, Train accuracy 0.9823588420721617, Validation loss 0.4611909091472626, Validation accuracy 0.9008042275905609
Epoch 62, Train loss 0.051419480830769644, Train accuracy 0.9825115410441702, Validation loss 0.4562716022133827, Validation accuracy 0.9007352948188782
Epoch 63, Train loss 0.0452302363965745, Train accuracy 0.9847904829816385, Validation loss 0.458242729306221, Validation accuracy 0.9008042275905609
Epoch 64, Train loss 0.048253959944387054, Train accuracy 0.9826757809655233, Validation loss 0.46355066895484925, Validation accuracy 0.9047334551811218
Validation accuracy increased from 0.90 to 0.90
Epoch 65, Train loss 0.04739559574624185, Train accuracy 0.9831898080354388, Validation loss 0.4612072378396988, Validation accuracy 0.9017807900905609
Epoch 66, Train loss 0.04766958919142119, Train accuracy 0.9834783378649842, Validation loss 0.4687676951289177, Validation accuracy 0.8994370400905609
Epoch 67, Train loss 0.04493995937942104, Train accuracy 0.9841850139200687, Validation loss 0.4646437630057335, Validation accuracy 0.9023667275905609
Epoch 68, Train loss 0.04412060701394115, Train accuracy 0.9847620735791597, Validation loss 0.477803535759449, Validation accuracy 0.9017348349094391
Epoch 69, Train loss 0.04315079072363336, Train accuracy 0.9854216971857981, Validation loss 0.47962677031755446, Validation accuracy 0.9021484375
Epoch 0, Train loss 2.6580793376673353, Train accuracy 0.18219193883917548, Validation loss 2.031553876399994, Validation accuracy 0.2651079960167408
Validation accuracy increased from 0.00 to 0.27
Epoch 1, Train loss 1.8690076199444858, Train accuracy 0.30313831669363106, Validation loss 1.7729069948196412, Validation accuracy 0.3590188413858414
Validation accuracy increased from 0.27 to 0.36
Epoch 2, Train loss 1.7361374897035686, Train accuracy 0.3594371447847648, Validation loss 1.6652949333190918, Validation accuracy 0.3785500913858414
Validation accuracy increased from 0.36 to 0.38
Epoch 3, Train loss 1.660960620099848, Train accuracy 0.38391601565209305, Validation loss 1.6579984724521637, Validation accuracy 0.38305376917123796
Validation accuracy increased from 0.38 to 0.38
Epoch 4, Train loss 1.5917028324170546, Train accuracy 0.412991832264445, Validation loss 1.5922754287719727, Validation accuracy 0.4213120400905609
Validation accuracy increased from 0.38 to 0.42
Epoch 5, Train loss 1.5215373398228125, Train accuracy 0.4405575282871723, Validation loss 1.521777218580246, Validation accuracy 0.45518152564764025
Validation accuracy increased from 0.42 to 0.46
Epoch 6, Train loss 1.4228983413089404, Train accuracy 0.4838796163147146, Validation loss 1.3918669521808624, Validation accuracy 0.5006778493523598
Validation accuracy increased from 0.46 to 0.50
Epoch 7, Train loss 1.3107607953927733, Train accuracy 0.5221679688177325, Validation loss 1.3958094418048859, Validation accuracy 0.511937040090561
Validation accuracy increased from 0.50 to 0.51
Epoch 8, Train loss 1.1926840855316683, Train accuracy 0.5698437497697093, Validation loss 1.061991611123085, Validation accuracy 0.6222311586141587
Validation accuracy increased from 0.51 to 0.62
Epoch 9, Train loss 1.0766222951087085, Train accuracy 0.6139754971319978, Validation loss 1.0465322852134704, Validation accuracy 0.6370289534330368
Validation accuracy increased from 0.62 to 0.64
Epoch 10, Train loss 0.9965960342775692, Train accuracy 0.6421679685061629, Validation loss 0.9114615857601166, Validation accuracy 0.6803538590669632
Validation accuracy increased from 0.64 to 0.68
Epoch 11, Train loss 0.8991603512655605, Train accuracy 0.6798828125677325, Validation loss 0.9614026546478271, Validation accuracy 0.6688993573188782
Epoch 12, Train loss 0.8243031505156647, Train accuracy 0.7077006389471617, Validation loss 0.8241535067558289, Validation accuracy 0.7229664534330368
Validation accuracy increased from 0.68 to 0.72
Epoch 13, Train loss 0.7482963478700682, Train accuracy 0.7383549359034408, Validation loss 0.7178104132413864, Validation accuracy 0.7551470577716828
Validation accuracy increased from 0.72 to 0.76
Epoch 14, Train loss 0.695573952049017, Train accuracy 0.7577201703732664, Validation loss 0.9159085601568222, Validation accuracy 0.7084673702716827
Epoch 15, Train loss 0.649858208373189, Train accuracy 0.773333629085259, Validation loss 0.6484355062246323, Validation accuracy 0.7805721521377563
Validation accuracy increased from 0.76 to 0.78
Epoch 16, Train loss 0.6010712471536614, Train accuracy 0.7927743250673468, Validation loss 0.6522377222776413, Validation accuracy 0.7802504599094391
Epoch 17, Train loss 0.5671289844269102, Train accuracy 0.8053417967801745, Validation loss 0.583008760213852, Validation accuracy 0.8021829038858413
Validation accuracy increased from 0.78 to 0.80
Epoch 18, Train loss 0.5242600601843812, Train accuracy 0.8193093037063425, Validation loss 0.703746247291565, Validation accuracy 0.7800666362047195
Epoch 19, Train loss 0.5073381509970535, Train accuracy 0.8263574218885466, Validation loss 0.5838801085948944, Validation accuracy 0.8036534935235977
Validation accuracy increased from 0.80 to 0.80
Epoch 20, Train loss 0.38958745263516903, Train accuracy 0.8661754260008986, Validation loss 0.3885342121124268, Validation accuracy 0.8649931073188781
Validation accuracy increased from 0.80 to 0.86
Epoch 21, Train loss 0.3580975267528133, Train accuracy 0.8763947087255392, Validation loss 0.4136256217956543, Validation accuracy 0.8582490801811218
Epoch 22, Train loss 0.33656482373110275, Train accuracy 0.8833638138391755, Validation loss 0.38370331674814223, Validation accuracy 0.8690946698188782
Validation accuracy increased from 0.86 to 0.87
Epoch 23, Train loss 0.3177465670318766, Train accuracy 0.8901358307762579, Validation loss 0.41289233714342116, Validation accuracy 0.8629595577716828
Epoch 24, Train loss 0.3134320047260685, Train accuracy 0.8913725140419874, Validation loss 0.40655546337366105, Validation accuracy 0.8651999086141586
Epoch 25, Train loss 0.29729644099081104, Train accuracy 0.8976411575620825, Validation loss 0.3862786814570427, Validation accuracy 0.8686695784330368
Epoch 26, Train loss 0.28623436306687916, Train accuracy 0.9003204899755392, Validation loss 0.38168193995952604, Validation accuracy 0.8731617659330368
Validation accuracy increased from 0.87 to 0.87
Epoch 27, Train loss 0.27354236505925655, Train accuracy 0.9061479046940804, Validation loss 0.3749668002128601, Validation accuracy 0.8757352948188781
Validation accuracy increased from 0.87 to 0.88
Epoch 28, Train loss 0.26747373440726235, Train accuracy 0.9080726206302643, Validation loss 0.3888163059949875, Validation accuracy 0.874609375
Epoch 29, Train loss 0.2569240142845295, Train accuracy 0.910517578097907, Validation loss 0.37044512778520583, Validation accuracy 0.8762408077716828
Validation accuracy increased from 0.88 to 0.88
Epoch 30, Train loss 0.2506865364584056, Train accuracy 0.9124636006626216, Validation loss 0.42448004633188247, Validation accuracy 0.8613970577716827
Epoch 31, Train loss 0.23867318948561494, Train accuracy 0.9160466973077167, Validation loss 0.3915939971804619, Validation accuracy 0.8761259198188782
Epoch 32, Train loss 0.22892619025978175, Train accuracy 0.921151455830444, Validation loss 0.41551333963871, Validation accuracy 0.8690602034330368
Epoch 33, Train loss 0.22044085160913793, Train accuracy 0.9223055751486258, Validation loss 0.4232830986380577, Validation accuracy 0.8664751827716828
Epoch 34, Train loss 0.21510252724824983, Train accuracy 0.9242862215773626, Validation loss 0.3814990907907486, Validation accuracy 0.8783203125
Validation accuracy increased from 0.88 to 0.88
Epoch 35, Train loss 0.20795042114332318, Train accuracy 0.9272860437631607, Validation loss 0.4059451773762703, Validation accuracy 0.8754136025905609
Epoch 36, Train loss 0.2014545538801361, Train accuracy 0.9299742542207241, Validation loss 0.3845412902534008, Validation accuracy 0.8794921875
Validation accuracy increased from 0.88 to 0.88
Epoch 37, Train loss 0.1954063639806753, Train accuracy 0.9316983307627115, Validation loss 0.394793775677681, Validation accuracy 0.8827435672283173
Validation accuracy increased from 0.88 to 0.88
Epoch 38, Train loss 0.18090721875937146, Train accuracy 0.9370223720642653, Validation loss 0.4396684989333153, Validation accuracy 0.8768841922283173
Epoch 39, Train loss 0.18113700258122248, Train accuracy 0.936898970129815, Validation loss 0.43513502180576324, Validation accuracy 0.8755399823188782
Epoch 40, Train loss 0.11950560614720664, Train accuracy 0.9574636007574472, Validation loss 0.3634623557329178, Validation accuracy 0.8982536762952804
Validation accuracy increased from 0.88 to 0.90
Epoch 41, Train loss 0.10148559779521417, Train accuracy 0.9643057527189905, Validation loss 0.378127846121788, Validation accuracy 0.8979549646377564
Epoch 42, Train loss 0.09582471211483194, Train accuracy 0.9671972654759884, Validation loss 0.3894601173698902, Validation accuracy 0.8994485288858414
Validation accuracy increased from 0.90 to 0.90
Epoch 43, Train loss 0.09222561850170181, Train accuracy 0.9681551845913584, Validation loss 0.3919204041361809, Validation accuracy 0.8986443012952805
Epoch 44, Train loss 0.08529046196913855, Train accuracy 0.9701873223212633, Validation loss 0.40173839777708054, Validation accuracy 0.8942899823188781
Epoch 45, Train loss 0.08388395437081768, Train accuracy 0.9699840196831659, Validation loss 0.4108344651758671, Validation accuracy 0.8985179215669632
Epoch 46, Train loss 0.0784596272066913, Train accuracy 0.972453834996982, Validation loss 0.40193148255348204, Validation accuracy 0.8991268396377563
Epoch 47, Train loss 0.0764246674318036, Train accuracy 0.9736177199943499, Validation loss 0.42074021250009536, Validation accuracy 0.8961971521377563
Epoch 48, Train loss 0.07464507639154115, Train accuracy 0.9736115055328066, Validation loss 0.4441745474934578, Validation accuracy 0.8927045047283173
Epoch 49, Train loss 0.07286330025156283, Train accuracy 0.9750355112959038, Validation loss 0.4111690387129784, Validation accuracy 0.8982766538858413
Epoch 50, Train loss 0.06831957495094022, Train accuracy 0.9757510650564324, Validation loss 0.42423438280820847, Validation accuracy 0.8971737146377563
Epoch 51, Train loss 0.06665565979413011, Train accuracy 0.9768705608492548, Validation loss 0.4506463661789894, Validation accuracy 0.8952665448188781
Epoch 52, Train loss 0.06551362850322304, Train accuracy 0.9773845879191702, Validation loss 0.42501009702682496, Validation accuracy 0.9010799646377563
Validation accuracy increased from 0.90 to 0.90
Epoch 53, Train loss 0.062447487863458016, Train accuracy 0.9780761718072675, Validation loss 0.43487470895051955, Validation accuracy 0.8986213237047196
Epoch 54, Train loss 0.06080337954600426, Train accuracy 0.9787757457657293, Validation loss 0.4206816598773003, Validation accuracy 0.8991727948188781
Epoch 55, Train loss 0.06140093352984299, Train accuracy 0.9788778407329862, Validation loss 0.45521425306797025, Validation accuracy 0.8981043189764023
Epoch 56, Train loss 0.05686160210858692, Train accuracy 0.98047230087898, Validation loss 0.432341368496418, Validation accuracy 0.9038602948188782
Validation accuracy increased from 0.90 to 0.90
Epoch 57, Train loss 0.05501077241602947, Train accuracy 0.9811763136901639, Validation loss 0.44184859842061996, Validation accuracy 0.9018612146377564
Epoch 58, Train loss 0.05483587017409842, Train accuracy 0.9809064275839112, Validation loss 0.45806282237172125, Validation accuracy 0.8973920047283173
Epoch 59, Train loss 0.04923085843752646, Train accuracy 0.9833860082382505, Validation loss 0.44579378962516786, Validation accuracy 0.9037913590669632
Epoch 60, Train loss 0.03908257798651572, Train accuracy 0.9870543324134566, Validation loss 0.4257857412099838, Validation accuracy 0.9029871314764023
Epoch 61, Train loss 0.03408537202366543, Train accuracy 0.9891060011630709, Validation loss 0.43605059683322905, Validation accuracy 0.9057444840669632
Validation accuracy increased from 0.90 to 0.91
Epoch 62, Train loss 0.030602251290640033, Train accuracy 0.9895658733492548, Validation loss 0.43839929401874544, Validation accuracy 0.9028607547283173
Epoch 63, Train loss 0.029400626655181193, Train accuracy 0.9904092682356184, Validation loss 0.4508988127112389, Validation accuracy 0.9052045047283173
Epoch 64, Train loss 0.02786605050311085, Train accuracy 0.9903897372159091, Validation loss 0.45009003579616547, Validation accuracy 0.9057215064764023
Epoch 65, Train loss 0.027731284853705965, Train accuracy 0.9904501065611839, Validation loss 0.4626805350184441, Validation accuracy 0.9046415448188782
Epoch 66, Train loss 0.028119390589629555, Train accuracy 0.9906658377837051, Validation loss 0.46078228652477266, Validation accuracy 0.9047449439764023
Epoch 67, Train loss 0.026862551513741808, Train accuracy 0.9906720525839112, Validation loss 0.4522846803069115, Validation accuracy 0.9071116715669632
Validation accuracy increased from 0.91 to 0.91
Epoch 68, Train loss 0.027302723155695607, Train accuracy 0.9906152341176163, Validation loss 0.4668548688292503, Validation accuracy 0.9051815271377563
Epoch 69, Train loss 0.025856541272580878, Train accuracy 0.9911700991744344, Validation loss 0.4623537391424179, Validation accuracy 0.9075022965669632
Validation accuracy increased from 0.91 to 0.91
Epoch 0, Train loss 2.0690267119895327, Train accuracy 0.2272176845845851, Validation loss 1.8673506081104279, Validation accuracy 0.2818704038858414
Validation accuracy increased from 0.00 to 0.28
Epoch 1, Train loss 1.7328730740330436, Train accuracy 0.3332013494589112, Validation loss 1.806375116109848, Validation accuracy 0.33759191185235976
Validation accuracy increased from 0.28 to 0.34
Epoch 2, Train loss 1.5180404687469655, Train accuracy 0.4305593039501797, Validation loss 1.4705136716365814, Validation accuracy 0.44069393426179887
Validation accuracy increased from 0.34 to 0.44
Epoch 3, Train loss 1.3162295141003348, Train accuracy 0.5188396661119028, Validation loss 1.8118408381938935, Validation accuracy 0.3965418204665184
Epoch 4, Train loss 1.1603138812563636, Train accuracy 0.5790678266097199, Validation loss 1.2883353769779204, Validation accuracy 0.5399701297283173
Validation accuracy increased from 0.44 to 0.54
Epoch 5, Train loss 1.0627845038067212, Train accuracy 0.6143776632168076, Validation loss 1.4055171847343444, Validation accuracy 0.5399931073188782
Validation accuracy increased from 0.54 to 0.54
Epoch 6, Train loss 0.9840306409380652, Train accuracy 0.6458123224702749, Validation loss 1.1179980963468552, Validation accuracy 0.624781709909439
Validation accuracy increased from 0.54 to 0.62
Epoch 7, Train loss 0.924717453731732, Train accuracy 0.6666175425052643, Validation loss 1.924456787109375, Validation accuracy 0.4709558829665184
Epoch 8, Train loss 0.880111179229888, Train accuracy 0.6855965906923468, Validation loss 1.4718293607234956, Validation accuracy 0.5515050560235977
Epoch 9, Train loss 0.8498427925462072, Train accuracy 0.6943208449943499, Validation loss 1.0511474281549453, Validation accuracy 0.6643612146377563
Validation accuracy increased from 0.62 to 0.66
Epoch 10, Train loss 0.8055567660114982, Train accuracy 0.7122105823999102, Validation loss 0.8282243847846985, Validation accuracy 0.7035041362047195
Validation accuracy increased from 0.66 to 0.70
Epoch 11, Train loss 0.7804914397949522, Train accuracy 0.7201305041936311, Validation loss 0.8579431295394897, Validation accuracy 0.7147403508424759
Validation accuracy increased from 0.70 to 0.71
Epoch 12, Train loss 0.7562579874965277, Train accuracy 0.7317720170725476, Validation loss 0.8593598693609238, Validation accuracy 0.7156479775905609
Validation accuracy increased from 0.71 to 0.72
Epoch 13, Train loss 0.7314498705620115, Train accuracy 0.7414240054786205, Validation loss 0.748944154381752, Validation accuracy 0.7445542275905609
Validation accuracy increased from 0.72 to 0.74
Epoch 14, Train loss 0.7184051403945143, Train accuracy 0.7485058592124418, Validation loss 0.8562339693307877, Validation accuracy 0.7268956810235977
Epoch 15, Train loss 0.7050993923436512, Train accuracy 0.7521990412338213, Validation loss 0.7225761920213699, Validation accuracy 0.7531939327716828
Validation accuracy increased from 0.74 to 0.75
Epoch 16, Train loss 0.6912529986690391, Train accuracy 0.7571688565340909, Validation loss 0.7455960571765899, Validation accuracy 0.7424517452716828
Epoch 17, Train loss 0.6763658764010126, Train accuracy 0.7624449574134566, Validation loss 0.9592251658439637, Validation accuracy 0.6877987146377563
Epoch 18, Train loss 0.6638960863717578, Train accuracy 0.7673393108628013, Validation loss 0.7317281931638717, Validation accuracy 0.767359834909439
Validation accuracy increased from 0.75 to 0.77
Epoch 19, Train loss 0.6452678286216476, Train accuracy 0.7751109728758986, Validation loss 0.853256818652153, Validation accuracy 0.719140625
Epoch 20, Train loss 0.5775030146945607, Train accuracy 0.7980877130546353, Validation loss 0.597672937810421, Validation accuracy 0.8029067099094391
Validation accuracy increased from 0.77 to 0.80
Epoch 21, Train loss 0.5580784846097231, Train accuracy 0.805437677285888, Validation loss 0.5827912598848343, Validation accuracy 0.8019646137952805
Epoch 22, Train loss 0.5528385908427563, Train accuracy 0.8062100495127115, Validation loss 0.5617995217442513, Validation accuracy 0.8047909021377564
Validation accuracy increased from 0.80 to 0.80
Epoch 23, Train loss 0.5465699231082742, Train accuracy 0.8079376776110042, Validation loss 0.5975611701607704, Validation accuracy 0.7958524823188782
Epoch 24, Train loss 0.5435846580023115, Train accuracy 0.8089985793287103, Validation loss 0.5766314208507538, Validation accuracy 0.8026654422283173
Epoch 25, Train loss 0.5419144046238877, Train accuracy 0.8092933236197992, Validation loss 0.5878210142254829, Validation accuracy 0.8056525737047195
Validation accuracy increased from 0.80 to 0.81
Epoch 26, Train loss 0.5363604472103444, Train accuracy 0.8126322796398943, Validation loss 0.619393664598465, Validation accuracy 0.7920036762952805
Epoch 27, Train loss 0.5200573478571393, Train accuracy 0.817659801041538, Validation loss 0.5804259151220321, Validation accuracy 0.8090877771377564
Validation accuracy increased from 0.81 to 0.81
Epoch 28, Train loss 0.5199383161962032, Train accuracy 0.8170330253514376, Validation loss 0.623185646533966, Validation accuracy 0.7948529422283173
Epoch 29, Train loss 0.5207221022045071, Train accuracy 0.8168386007574472, Validation loss 0.5804943889379501, Validation accuracy 0.8053308814764023
Epoch 30, Train loss 0.5138465013693679, Train accuracy 0.8192072087390856, Validation loss 0.585611729323864, Validation accuracy 0.8088465064764023
Epoch 31, Train loss 0.5098769818855957, Train accuracy 0.819927201690999, Validation loss 0.5799269139766693, Validation accuracy 0.8053079038858414
Epoch 32, Train loss 0.5065585478124294, Train accuracy 0.8222700638527219, Validation loss 0.6838448703289032, Validation accuracy 0.7758042275905609
Epoch 33, Train loss 0.5056145147166469, Train accuracy 0.8236390267583457, Validation loss 0.5239291101694107, Validation accuracy 0.8240349262952804
Validation accuracy increased from 0.81 to 0.82
Epoch 34, Train loss 0.5004893678494475, Train accuracy 0.8251997513527219, Validation loss 0.6022816509008407, Validation accuracy 0.8091452211141587
Epoch 35, Train loss 0.49779122847725044, Train accuracy 0.8248561790043657, Validation loss 0.5308344796299934, Validation accuracy 0.8209099262952805
Epoch 36, Train loss 0.49600341949950566, Train accuracy 0.8256906958466227, Validation loss 0.5623892724514008, Validation accuracy 0.8137752771377563
Epoch 37, Train loss 0.4880945887416601, Train accuracy 0.8306685012172569, Validation loss 0.5754184573888779, Validation accuracy 0.8130974262952805
Epoch 38, Train loss 0.48729962787844916, Train accuracy 0.8273242187093605, Validation loss 0.5572261542081833, Validation accuracy 0.8197150737047195
Epoch 39, Train loss 0.48502503318542783, Train accuracy 0.8291139914230867, Validation loss 0.5612529590725899, Validation accuracy 0.8180491715669632
Epoch 40, Train loss 0.45050534402782266, Train accuracy 0.8422061435200952, Validation loss 0.5034890785813332, Validation accuracy 0.8335363060235977
Validation accuracy increased from 0.82 to 0.83
Epoch 41, Train loss 0.4417937806045467, Train accuracy 0.846430220048536, Validation loss 0.4985544249415398, Validation accuracy 0.8337545961141586
Validation accuracy increased from 0.83 to 0.83
Epoch 42, Train loss 0.43748673813586886, Train accuracy 0.8465403054248203, Validation loss 0.5131264477968216, Validation accuracy 0.8322610288858414
Epoch 43, Train loss 0.43777326443655923, Train accuracy 0.8475585935468023, Validation loss 0.5070450276136398, Validation accuracy 0.8387408077716827
Validation accuracy increased from 0.83 to 0.84
Epoch 44, Train loss 0.4358628908680244, Train accuracy 0.8462650921534408, Validation loss 0.4968671053647995, Validation accuracy 0.8335133284330368
Epoch 45, Train loss 0.43524346907030453, Train accuracy 0.8485893109305338, Validation loss 0.49848141372203825, Validation accuracy 0.8380055159330368
Epoch 46, Train loss 0.436400722542947, Train accuracy 0.8471724076027219, Validation loss 0.5162650004029274, Validation accuracy 0.8290211409330368
Epoch 47, Train loss 0.43240433575754816, Train accuracy 0.8496200283142653, Validation loss 0.5122744515538216, Validation accuracy 0.8347541362047195
Epoch 48, Train loss 0.43054012124511326, Train accuracy 0.8505229045721617, Validation loss 0.49497831612825394, Validation accuracy 0.8404986202716828
Validation accuracy increased from 0.84 to 0.84
Epoch 49, Train loss 0.42911447144367476, Train accuracy 0.849768288094889, Validation loss 0.4954577341675758, Validation accuracy 0.8381548702716828
Epoch 50, Train loss 0.42923020385205746, Train accuracy 0.8503240411254492, Validation loss 0.48726523369550706, Validation accuracy 0.8389820784330368
Epoch 51, Train loss 0.42407975684512744, Train accuracy 0.8527263849973679, Validation loss 0.4949381113052368, Validation accuracy 0.8383731633424759
Epoch 52, Train loss 0.4218346754258329, Train accuracy 0.85181019150398, Validation loss 0.5002255454659462, Validation accuracy 0.8327780336141586
Epoch 53, Train loss 0.42237332717261533, Train accuracy 0.8520516688850793, Validation loss 0.4836965262889862, Validation accuracy 0.8405216008424758
Validation accuracy increased from 0.84 to 0.84
Epoch 54, Train loss 0.4206699940629981, Train accuracy 0.8522150211713531, Validation loss 0.48976207375526426, Validation accuracy 0.8418198525905609
Validation accuracy increased from 0.84 to 0.84
Epoch 55, Train loss 0.42185008170252497, Train accuracy 0.8521084870127115, Validation loss 0.49868236631155016, Validation accuracy 0.8359260112047195
Epoch 56, Train loss 0.4186349209736694, Train accuracy 0.8527299358763478, Validation loss 0.5087059244513512, Validation accuracy 0.8328239887952804
Epoch 57, Train loss 0.41718462050299754, Train accuracy 0.8535253906791861, Validation loss 0.4999082997441292, Validation accuracy 0.8350988060235978
Epoch 58, Train loss 0.41633367487652734, Train accuracy 0.8539470881223679, Validation loss 0.4902837038040161, Validation accuracy 0.8368106633424759
Epoch 59, Train loss 0.41861583825878124, Train accuracy 0.8543235083872621, Validation loss 0.49245316386222837, Validation accuracy 0.8374425560235977
Epoch 60, Train loss 0.40177861448716035, Train accuracy 0.8582626063038002, Validation loss 0.48220455199480056, Validation accuracy 0.8392463237047195
Epoch 61, Train loss 0.39862475730478764, Train accuracy 0.8605797229842707, Validation loss 0.4878735452890396, Validation accuracy 0.8403492659330368
Epoch 62, Train loss 0.3984984068030661, Train accuracy 0.8605459870939905, Validation loss 0.47926910072565077, Validation accuracy 0.8409122258424759
Epoch 63, Train loss 0.39745719476856967, Train accuracy 0.861478160389445, Validation loss 0.48438110053539274, Validation accuracy 0.8399816185235978
Epoch 64, Train loss 0.3965922338380055, Train accuracy 0.861328125, Validation loss 0.4786691009998322, Validation accuracy 0.8413258284330368
Epoch 65, Train loss 0.39455501904541795, Train accuracy 0.8628062853081659, Validation loss 0.4785903498530388, Validation accuracy 0.8445772051811218
Validation accuracy increased from 0.84 to 0.84
Epoch 66, Train loss 0.3933673507787965, Train accuracy 0.8638290126215328, Validation loss 0.48164345026016236, Validation accuracy 0.8432329952716827
Epoch 67, Train loss 0.3933853908357295, Train accuracy 0.8619060722941702, Validation loss 0.4809084102511406, Validation accuracy 0.8461626827716827
Validation accuracy increased from 0.84 to 0.85
Epoch 68, Train loss 0.3923724918541583, Train accuracy 0.8626162995668974, Validation loss 0.4757357776165009, Validation accuracy 0.8430147051811219
Epoch 69, Train loss 0.3919379365715114, Train accuracy 0.862435191531073, Validation loss 0.4813288182020187, Validation accuracy 0.8386144310235977
Epoch 0, Train loss 2.6229109946977007, Train accuracy 0.18626065340570427, Validation loss 2.037346625328064, Validation accuracy 0.22433363944292067
Validation accuracy increased from 0.00 to 0.22
Epoch 1, Train loss 1.9200979748910123, Train accuracy 0.2632927911525423, Validation loss 1.7919011056423186, Validation accuracy 0.3194738045334816
Validation accuracy increased from 0.22 to 0.32
Epoch 2, Train loss 1.743622063235803, Train accuracy 0.3311665483157743, Validation loss 1.6325493097305297, Validation accuracy 0.39196920990943906
Validation accuracy increased from 0.32 to 0.39
Epoch 3, Train loss 1.5537201355804096, Train accuracy 0.41598721576685255, Validation loss 1.445681744813919, Validation accuracy 0.4714269295334816
Validation accuracy increased from 0.39 to 0.47
Epoch 4, Train loss 1.3494372767480938, Train accuracy 0.5030806108631871, Validation loss 1.3707111120223998, Validation accuracy 0.5132352948188782
Validation accuracy increased from 0.47 to 0.51
Epoch 5, Train loss 1.1892754205248572, Train accuracy 0.5667356178164482, Validation loss 1.291400384902954, Validation accuracy 0.5711282163858413
Validation accuracy increased from 0.51 to 0.57
Epoch 6, Train loss 1.0842173563485795, Train accuracy 0.6103568889878013, Validation loss 1.5679794549942017, Validation accuracy 0.4960363045334816
Epoch 7, Train loss 0.9927231689745729, Train accuracy 0.6425239701162685, Validation loss 0.9278690546751023, Validation accuracy 0.6681181073188782
Validation accuracy increased from 0.57 to 0.67
Epoch 8, Train loss 0.9043669070709836, Train accuracy 0.6784801134331659, Validation loss 0.948098036646843, Validation accuracy 0.6715533077716828
Validation accuracy increased from 0.67 to 0.67
Epoch 9, Train loss 0.831364553083073, Train accuracy 0.706176313825629, Validation loss 0.8793893069028854, Validation accuracy 0.7154411762952805
Validation accuracy increased from 0.67 to 0.72
Epoch 10, Train loss 0.7722895514558662, Train accuracy 0.72951083088463, Validation loss 1.1533468157052993, Validation accuracy 0.6471737146377563
Epoch 11, Train loss 0.7378824177113447, Train accuracy 0.7437411221590909, Validation loss 0.8404403060674668, Validation accuracy 0.7208639711141587
Validation accuracy increased from 0.72 to 0.72
Epoch 12, Train loss 0.6897531722418286, Train accuracy 0.7613263492557135, Validation loss 0.8838683515787125, Validation accuracy 0.7117761939764022
Epoch 13, Train loss 0.6565501942214641, Train accuracy 0.7723837000402537, Validation loss 0.6568427443504333, Validation accuracy 0.7742417275905609
Validation accuracy increased from 0.72 to 0.77
Epoch 14, Train loss 0.6296052568676797, Train accuracy 0.7808691405437209, Validation loss 0.6686032801866532, Validation accuracy 0.7823644310235978
Validation accuracy increased from 0.77 to 0.78
Epoch 15, Train loss 0.602578857744282, Train accuracy 0.7902698862281713, Validation loss 0.6261615186929703, Validation accuracy 0.7937844663858413
Validation accuracy increased from 0.78 to 0.79
Epoch 16, Train loss 0.5885360906408592, Train accuracy 0.795785688879815, Validation loss 0.6043248116970062, Validation accuracy 0.7996897965669632
Validation accuracy increased from 0.79 to 0.80
Epoch 17, Train loss 0.5564606543630362, Train accuracy 0.8074529472399842, Validation loss 0.6123705685138703, Validation accuracy 0.7959558814764023
Epoch 18, Train loss 0.5358498634939844, Train accuracy 0.8146803975105286, Validation loss 0.6245998740196228, Validation accuracy 0.7901654422283173
Epoch 19, Train loss 0.5242372029884295, Train accuracy 0.8179314630952749, Validation loss 0.5639593169093132, Validation accuracy 0.8151999086141586
Validation accuracy increased from 0.80 to 0.82
Epoch 20, Train loss 0.4333160514519973, Train accuracy 0.8508114344017073, Validation loss 0.46768943071365354, Validation accuracy 0.8392693012952804
Validation accuracy increased from 0.82 to 0.84
Epoch 21, Train loss 0.4061827552928166, Train accuracy 0.8597283380275423, Validation loss 0.4566465124487877, Validation accuracy 0.8503102034330368
Validation accuracy increased from 0.84 to 0.85
Epoch 22, Train loss 0.3947925694625486, Train accuracy 0.8622567470778119, Validation loss 0.4513073995709419, Validation accuracy 0.8467486202716827
Epoch 23, Train loss 0.38176325234499847, Train accuracy 0.8669779829003594, Validation loss 0.4992803126573563, Validation accuracy 0.8405445784330368
Epoch 24, Train loss 0.3692886627871882, Train accuracy 0.8720507811416279, Validation loss 0.4690039113163948, Validation accuracy 0.8449908077716828
Epoch 25, Train loss 0.3614178855310787, Train accuracy 0.8743217330087315, Validation loss 0.4599324479699135, Validation accuracy 0.8468405336141587
Epoch 26, Train loss 0.355343027125028, Train accuracy 0.8755672939799048, Validation loss 0.4889006122946739, Validation accuracy 0.8389591008424759
Epoch 27, Train loss 0.3490274335173043, Train accuracy 0.87915394150398, Validation loss 0.4803995341062546, Validation accuracy 0.8514820784330368
Validation accuracy increased from 0.85 to 0.85
Epoch 28, Train loss 0.3354100298813798, Train accuracy 0.8819495737552643, Validation loss 0.5129345715045929, Validation accuracy 0.8382697612047195
Epoch 29, Train loss 0.3284874055534601, Train accuracy 0.8843066404488954, Validation loss 0.4763834744691849, Validation accuracy 0.8469898909330368
Epoch 30, Train loss 0.3270018585026264, Train accuracy 0.8856312144886364, Validation loss 0.4746458277106285, Validation accuracy 0.8518267452716828
Validation accuracy increased from 0.85 to 0.85
Epoch 31, Train loss 0.31664484764703293, Train accuracy 0.8878977271643552, Validation loss 0.44903534501791, Validation accuracy 0.8580537676811218
Validation accuracy increased from 0.85 to 0.86
Epoch 32, Train loss 0.3072824345224283, Train accuracy 0.8921280184930022, Validation loss 0.4526990830898285, Validation accuracy 0.8573184758424759
Epoch 33, Train loss 0.2993611613796516, Train accuracy 0.8948215554383668, Validation loss 0.5145402669906616, Validation accuracy 0.8435776650905609
Epoch 34, Train loss 0.2965427466922186, Train accuracy 0.8944034088741649, Validation loss 0.46349692046642305, Validation accuracy 0.8530216008424759
Epoch 35, Train loss 0.28509722861715336, Train accuracy 0.9001331674781713, Validation loss 0.4609134331345558, Validation accuracy 0.8576631426811219
Epoch 36, Train loss 0.2820061905817552, Train accuracy 0.9002379260279916, Validation loss 0.4662189170718193, Validation accuracy 0.855859375
Epoch 37, Train loss 0.2726286075670611, Train accuracy 0.9025719104842707, Validation loss 0.47280385047197343, Validation accuracy 0.8548828125
Epoch 38, Train loss 0.2735708581114357, Train accuracy 0.9037926136092707, Validation loss 0.4686575666069984, Validation accuracy 0.8610064327716828
Validation accuracy increased from 0.86 to 0.86
Epoch 39, Train loss 0.2608419631353833, Train accuracy 0.9078702059659091, Validation loss 0.4854200527071953, Validation accuracy 0.8541934758424758
Epoch 40, Train loss 0.2160749318162826, Train accuracy 0.9232484017583457, Validation loss 0.43915368244051933, Validation accuracy 0.8707261025905609
Validation accuracy increased from 0.86 to 0.87
Epoch 41, Train loss 0.20191782911900769, Train accuracy 0.9285671162334356, Validation loss 0.44624713659286497, Validation accuracy 0.8693244487047196
Epoch 42, Train loss 0.19254453264346177, Train accuracy 0.9328444600105286, Validation loss 0.44174554795026777, Validation accuracy 0.8695772051811218
Epoch 43, Train loss 0.18710510110990566, Train accuracy 0.9347904829139059, Validation loss 0.4428260512650013, Validation accuracy 0.8715533077716827
Validation accuracy increased from 0.87 to 0.87
Epoch 44, Train loss 0.1821582417681136, Train accuracy 0.9356622868640856, Validation loss 0.45307893231511115, Validation accuracy 0.8733111202716828
Validation accuracy increased from 0.87 to 0.87
Epoch 45, Train loss 0.17941358626227488, Train accuracy 0.9354598721997305, Validation loss 0.47992690801620486, Validation accuracy 0.8664981633424759
Epoch 46, Train loss 0.17701304001225668, Train accuracy 0.9384818889878013, Validation loss 0.4601898446679115, Validation accuracy 0.8705997258424759
Epoch 47, Train loss 0.1667022967965088, Train accuracy 0.9414737214418974, Validation loss 0.4741245836019516, Validation accuracy 0.8703814327716828
Epoch 48, Train loss 0.17150280269032175, Train accuracy 0.9396067116070878, Validation loss 0.4946984738111496, Validation accuracy 0.8647633284330368
Epoch 49, Train loss 0.16541698697785084, Train accuracy 0.9417027698999102, Validation loss 0.460362858325243, Validation accuracy 0.8746323525905609
Validation accuracy increased from 0.87 to 0.87
Epoch 50, Train loss 0.1631687259386209, Train accuracy 0.9420516690747305, Validation loss 0.4903700888156891, Validation accuracy 0.8700597435235977
Epoch 51, Train loss 0.1611008163626221, Train accuracy 0.9436079544777219, Validation loss 0.4568223901093006, Validation accuracy 0.8758731633424759
Validation accuracy increased from 0.87 to 0.88
Epoch 52, Train loss 0.16013096006248484, Train accuracy 0.9435253905301745, Validation loss 0.48109216541051864, Validation accuracy 0.8730928301811218
Epoch 53, Train loss 0.1575580008581958, Train accuracy 0.9439914771779017, Validation loss 0.49645987898111343, Validation accuracy 0.8704273909330368
Epoch 54, Train loss 0.15280897013673728, Train accuracy 0.9455735084008087, Validation loss 0.48443528190255164, Validation accuracy 0.8737017452716828
Epoch 55, Train loss 0.15030267102305184, Train accuracy 0.9464648437093605, Validation loss 0.4837515503168106, Validation accuracy 0.8735294133424759
Epoch 56, Train loss 0.14755034243518655, Train accuracy 0.946674360809001, Validation loss 0.4912824511528015, Validation accuracy 0.8688878685235977
Epoch 57, Train loss 0.14759339756247672, Train accuracy 0.9473206675188108, Validation loss 0.4823836639523506, Validation accuracy 0.8744370400905609
Epoch 58, Train loss 0.13756710108877582, Train accuracy 0.9505681815472516, Validation loss 0.4968617886304855, Validation accuracy 0.8729204952716827
Epoch 59, Train loss 0.1391527567228133, Train accuracy 0.9498987926000898, Validation loss 0.49941286444664, Validation accuracy 0.8725988060235977
Epoch 60, Train loss 0.12205398734658957, Train accuracy 0.9565447443588213, Validation loss 0.4946349889039993, Validation accuracy 0.8771943926811219
Validation accuracy increased from 0.88 to 0.88
Epoch 61, Train loss 0.11862401295961304, Train accuracy 0.9582368606193499, Validation loss 0.5051690116524696, Validation accuracy 0.8707720577716828
Epoch 62, Train loss 0.11010019707662816, Train accuracy 0.9605007100511681, Validation loss 0.5158620111644268, Validation accuracy 0.8758272051811218
Epoch 63, Train loss 0.11432314634492452, Train accuracy 0.9594611149619926, Validation loss 0.5044274650514126, Validation accuracy 0.8750229775905609
Epoch 64, Train loss 0.11037919215265322, Train accuracy 0.9604376774619926, Validation loss 0.5200244382023811, Validation accuracy 0.8750459551811218
Epoch 65, Train loss 0.10756544597362253, Train accuracy 0.9621333449401639, Validation loss 0.5226449057459831, Validation accuracy 0.8732881426811219
Epoch 66, Train loss 0.10933603909374638, Train accuracy 0.9622354402460835, Validation loss 0.5253496527671814, Validation accuracy 0.8735064327716827
Epoch 67, Train loss 0.10598156364126639, Train accuracy 0.9629270241341807, Validation loss 0.5244492426514625, Validation accuracy 0.8729434758424759
Epoch 68, Train loss 0.10524525768546895, Train accuracy 0.9625994315878912, Validation loss 0.5510560974478722, Validation accuracy 0.8696231633424759
Epoch 69, Train loss 0.10478397075679492, Train accuracy 0.9627805396237157, Validation loss 0.5328083500266075, Validation accuracy 0.8700367659330368
Epoch 0, Train loss 2.2809988002885473, Train accuracy 0.21767223008315673, Validation loss 1.9138419926166534, Validation accuracy 0.26303998231887815
Validation accuracy increased from 0.00 to 0.26
Epoch 1, Train loss 1.8693192953413182, Train accuracy 0.285550426014445, Validation loss 1.9725302517414094, Validation accuracy 0.27265625
Validation accuracy increased from 0.26 to 0.27
Epoch 2, Train loss 1.6971175331961026, Train accuracy 0.36574129963463003, Validation loss 1.7455998182296752, Validation accuracy 0.36971507370471957
Validation accuracy increased from 0.27 to 0.37
Epoch 3, Train loss 1.5633031698790463, Train accuracy 0.4203071733090011, Validation loss 1.5757295489311218, Validation accuracy 0.41181066185235976
Validation accuracy increased from 0.37 to 0.41
Epoch 4, Train loss 1.4625713229179382, Train accuracy 0.45571910505267704, Validation loss 1.4306441247463226, Validation accuracy 0.4903492644429207
Validation accuracy increased from 0.41 to 0.49
Epoch 5, Train loss 1.379013758491386, Train accuracy 0.48635653406381607, Validation loss 1.3371958196163178, Validation accuracy 0.5116957724094391
Validation accuracy increased from 0.49 to 0.51
Epoch 6, Train loss 1.2904197553342038, Train accuracy 0.5267649147320878, Validation loss 1.2828656733036041, Validation accuracy 0.5360409021377563
Validation accuracy increased from 0.51 to 0.54
Epoch 7, Train loss 1.1963243078101764, Train accuracy 0.5638201348483562, Validation loss 1.3851915180683136, Validation accuracy 0.5154296875
Epoch 8, Train loss 1.1020753508941694, Train accuracy 0.6023934659632769, Validation loss 1.1470882833003997, Validation accuracy 0.6034237146377563
Validation accuracy increased from 0.54 to 0.60
Epoch 9, Train loss 1.012452676553618, Train accuracy 0.6365545097399842, Validation loss 1.081612256169319, Validation accuracy 0.6303193926811218
Validation accuracy increased from 0.60 to 0.63
Epoch 10, Train loss 0.9344941536811265, Train accuracy 0.6687917258929122, Validation loss 0.9013491660356522, Validation accuracy 0.6832146137952805
Validation accuracy increased from 0.63 to 0.68
Epoch 11, Train loss 0.8555612117052078, Train accuracy 0.6994895240799948, Validation loss 0.967360007762909, Validation accuracy 0.6731502771377563
Epoch 12, Train loss 0.8005297363481738, Train accuracy 0.7181187854571776, Validation loss 0.8937251687049865, Validation accuracy 0.6800551474094391
Epoch 13, Train loss 0.7435037900101055, Train accuracy 0.739549005573446, Validation loss 0.7718372285366059, Validation accuracy 0.7356158077716828
Validation accuracy increased from 0.68 to 0.74
Epoch 14, Train loss 0.6984071829779581, Train accuracy 0.7569140622561629, Validation loss 0.7731244772672653, Validation accuracy 0.7378791362047196
Validation accuracy increased from 0.74 to 0.74
Epoch 15, Train loss 0.670359307392077, Train accuracy 0.7671670808710835, Validation loss 0.8053470432758332, Validation accuracy 0.7369600176811218
Epoch 16, Train loss 0.6335527331314303, Train accuracy 0.7794797583059832, Validation loss 0.8076303213834762, Validation accuracy 0.7471737146377564
Validation accuracy increased from 0.74 to 0.75
Epoch 17, Train loss 0.6030516805635258, Train accuracy 0.7917089841582559, Validation loss 0.7282483249902725, Validation accuracy 0.7558823525905609
Validation accuracy increased from 0.75 to 0.76
Epoch 18, Train loss 0.5751682186329906, Train accuracy 0.7999707030301745, Validation loss 0.5932991430163383, Validation accuracy 0.7998736202716827
Validation accuracy increased from 0.76 to 0.80
Epoch 19, Train loss 0.5563662041994658, Train accuracy 0.8063006035306237, Validation loss 0.6655824720859528, Validation accuracy 0.7899471521377563
Epoch 20, Train loss 0.44339507835155184, Train accuracy 0.8461408025839112, Validation loss 0.4829918548464775, Validation accuracy 0.8324103862047195
Validation accuracy increased from 0.80 to 0.83
Epoch 21, Train loss 0.4140669501979243, Train accuracy 0.8566992188041861, Validation loss 0.47010060101747514, Validation accuracy 0.8393956810235977
Validation accuracy increased from 0.83 to 0.84
Epoch 22, Train loss 0.39621811495585874, Train accuracy 0.86255237900398, Validation loss 0.49597135484218596, Validation accuracy 0.8351447612047196
Epoch 23, Train loss 0.38854121713137085, Train accuracy 0.8641344105655496, Validation loss 0.5159356132149696, Validation accuracy 0.8268382340669632
Epoch 24, Train loss 0.37167286229404534, Train accuracy 0.8711479048837315, Validation loss 0.4931092396378517, Validation accuracy 0.8348805159330368
Epoch 25, Train loss 0.3636255537752401, Train accuracy 0.8738467683168974, Validation loss 0.4850290670990944, Validation accuracy 0.8417164534330368
Validation accuracy increased from 0.84 to 0.84
Epoch 26, Train loss 0.35282090374014596, Train accuracy 0.8764204545454546, Validation loss 0.49286241084337234, Validation accuracy 0.8382467836141586
Epoch 27, Train loss 0.3417374079369686, Train accuracy 0.8801083094017073, Validation loss 0.4820252224802971, Validation accuracy 0.8445427387952804
Validation accuracy increased from 0.84 to 0.84
Epoch 28, Train loss 0.3337843170897527, Train accuracy 0.8820676492019133, Validation loss 0.4803166314959526, Validation accuracy 0.8430032163858414
Epoch 29, Train loss 0.3237836322831837, Train accuracy 0.8859667967666279, Validation loss 0.4923855349421501, Validation accuracy 0.8430032163858414
Epoch 30, Train loss 0.3119377080689777, Train accuracy 0.8900932171805338, Validation loss 0.4946684405207634, Validation accuracy 0.8393727034330368
Epoch 31, Train loss 0.30155648341910407, Train accuracy 0.8938751776110042, Validation loss 0.4991867244243622, Validation accuracy 0.8404181987047196
Epoch 32, Train loss 0.2963828860189427, Train accuracy 0.8955291191285307, Validation loss 0.48014897406101226, Validation accuracy 0.8456686586141586
Validation accuracy increased from 0.84 to 0.85
Epoch 33, Train loss 0.28577302277765493, Train accuracy 0.8988911577246406, Validation loss 0.5285431921482087, Validation accuracy 0.8413028508424759
Epoch 34, Train loss 0.27633540400049905, Train accuracy 0.9024405184794556, Validation loss 0.6106725215911866, Validation accuracy 0.8256433814764023
Epoch 35, Train loss 0.2721290126950903, Train accuracy 0.9048961292613636, Validation loss 0.5206666305661202, Validation accuracy 0.8401999086141586
Epoch 36, Train loss 0.258426712656563, Train accuracy 0.9093599075620825, Validation loss 0.4864570751786232, Validation accuracy 0.8440831810235977
Epoch 37, Train loss 0.2511646764522249, Train accuracy 0.9104216972535307, Validation loss 0.45733456760644914, Validation accuracy 0.8572380512952804
Validation accuracy increased from 0.85 to 0.86
Epoch 38, Train loss 0.24834443891251629, Train accuracy 0.9113662994720719, Validation loss 0.47318498939275744, Validation accuracy 0.8513786762952804
Epoch 39, Train loss 0.24070073139261117, Train accuracy 0.9147585227408193, Validation loss 0.49770292192697524, Validation accuracy 0.854710477590561
Epoch 40, Train loss 0.18135776184499264, Train accuracy 0.9366583807224577, Validation loss 0.4206901952624321, Validation accuracy 0.8764131426811218
Validation accuracy increased from 0.86 to 0.88
Epoch 41, Train loss 0.15889239577915182, Train accuracy 0.9445969459008087, Validation loss 0.41240033209323884, Validation accuracy 0.8759995400905609
Epoch 42, Train loss 0.15012677615000444, Train accuracy 0.9476855468343605, Validation loss 0.44260289818048476, Validation accuracy 0.8676240801811218
Epoch 43, Train loss 0.14692097724500028, Train accuracy 0.9481551846997305, Validation loss 0.42651606649160384, Validation accuracy 0.8737247258424758
Epoch 44, Train loss 0.14018595303324136, Train accuracy 0.9497620737688108, Validation loss 0.45440028309822084, Validation accuracy 0.8764131426811218
Validation accuracy increased from 0.88 to 0.88
Epoch 45, Train loss 0.1386791489679705, Train accuracy 0.9510813209820878, Validation loss 0.4650248110294342, Validation accuracy 0.8734375
Epoch 46, Train loss 0.13256205681880767, Train accuracy 0.9524263136766173, Validation loss 0.4477994844317436, Validation accuracy 0.8792279422283172
Validation accuracy increased from 0.88 to 0.88
Epoch 47, Train loss 0.12862567853351886, Train accuracy 0.9539160156114534, Validation loss 0.45621109902858736, Validation accuracy 0.8732881426811219
Epoch 48, Train loss 0.12463108433241193, Train accuracy 0.9557137783955444, Validation loss 0.47062297314405444, Validation accuracy 0.8790785849094391
Epoch 49, Train loss 0.12218733902343294, Train accuracy 0.956908735700629, Validation loss 0.4667332202196121, Validation accuracy 0.8790211409330368
Epoch 50, Train loss 0.11890967524695126, Train accuracy 0.9579705253920772, Validation loss 0.4691536322236061, Validation accuracy 0.8792164534330368
Epoch 51, Train loss 0.11272192210890353, Train accuracy 0.9604465551674366, Validation loss 0.4798969477415085, Validation accuracy 0.8764820784330368
Epoch 52, Train loss 0.1103279624472965, Train accuracy 0.9605930396779017, Validation loss 0.4873561874032021, Validation accuracy 0.8713350176811219
Epoch 53, Train loss 0.11013015681369738, Train accuracy 0.9595498933710835, Validation loss 0.5003647089004517, Validation accuracy 0.8682559758424759
Epoch 54, Train loss 0.10544934174553915, Train accuracy 0.9623206674375318, Validation loss 0.48370644450187683, Validation accuracy 0.8771943926811219
Epoch 55, Train loss 0.10062233568169177, Train accuracy 0.9644486860118129, Validation loss 0.5023128375411033, Validation accuracy 0.8751263797283173
Epoch 56, Train loss 0.10200945007487792, Train accuracy 0.9631862569261681, Validation loss 0.4858323559165001, Validation accuracy 0.872828584909439
Epoch 57, Train loss 0.09808908210305328, Train accuracy 0.9644611149348996, Validation loss 0.5062797978520394, Validation accuracy 0.8766888797283172
Epoch 58, Train loss 0.09684447685933927, Train accuracy 0.9644611149348996, Validation loss 0.5153730034828186, Validation accuracy 0.876953125
Epoch 59, Train loss 0.09281885187903588, Train accuracy 0.9667666903273626, Validation loss 0.5136042609810829, Validation accuracy 0.8703814327716828
Epoch 60, Train loss 0.07397242843977768, Train accuracy 0.9745365767316385, Validation loss 0.49362518787384035, Validation accuracy 0.8787798702716827
Epoch 61, Train loss 0.06641569001261484, Train accuracy 0.9766299714418974, Validation loss 0.502284599840641, Validation accuracy 0.8791704952716828
Epoch 62, Train loss 0.06649593202481893, Train accuracy 0.9768359373238954, Validation loss 0.5107013046741485, Validation accuracy 0.8769990801811218
Epoch 63, Train loss 0.06319589509671046, Train accuracy 0.9784348366612737, Validation loss 0.5119066312909126, Validation accuracy 0.8779526650905609
Epoch 64, Train loss 0.06167200973934748, Train accuracy 0.978059303692796, Validation loss 0.5205086544156075, Validation accuracy 0.8807329952716827
Validation accuracy increased from 0.88 to 0.88
Epoch 65, Train loss 0.059989165821620685, Train accuracy 0.9792835580354388, Validation loss 0.5250296652317047, Validation accuracy 0.8824678301811218
Validation accuracy increased from 0.88 to 0.88
Epoch 66, Train loss 0.05592586269432848, Train accuracy 0.9804190339689905, Validation loss 0.5226007521152496, Validation accuracy 0.8809283077716827
Epoch 67, Train loss 0.056539280392991546, Train accuracy 0.9804758520966227, Validation loss 0.5345741465687752, Validation accuracy 0.8804917275905609
Epoch 68, Train loss 0.053707359147004106, Train accuracy 0.9818519174375318, Validation loss 0.5440341889858246, Validation accuracy 0.8798023909330368
Epoch 69, Train loss 0.05479485321451317, Train accuracy 0.9807990054515275, Validation loss 0.5470972046256065, Validation accuracy 0.8778033077716827
Test loss: 0.5212614640593529 Test accuracy: 0.890625  resnet10_Adam_0.1
Test loss: 0.5543786838650704 Test accuracy: 0.8970703125  resnet18_Adam_0.1
Test loss: 0.5137842662632466 Test accuracy: 0.82978515625  resnet12_Adam_0.1
Test loss: 0.5237751759588718 Test accuracy: 0.87158203125  resnet14_4_Adam_0.1
Test loss: 0.6165254317224026 Test accuracy: 0.86806640625  resnet14_5_Adam_0.1
Epoch 0, Train loss 1.6705299446528608, Train accuracy 0.40477894161912525, Validation loss 1.2773069083690642, Validation accuracy 0.5494485288858414
Validation accuracy increased from 0.00 to 0.55
Epoch 1, Train loss 1.1689835112880578, Train accuracy 0.5756152343343605, Validation loss 1.0485955119132995, Validation accuracy 0.6333065271377564
Validation accuracy increased from 0.55 to 0.63
Epoch 2, Train loss 0.9305996380069039, Train accuracy 0.6682634942910888, Validation loss 0.8380906403064727, Validation accuracy 0.6988396137952805
Validation accuracy increased from 0.63 to 0.70
Epoch 3, Train loss 0.7845678109336983, Train accuracy 0.7210964133793657, Validation loss 0.7219833046197891, Validation accuracy 0.7464613974094391
Validation accuracy increased from 0.70 to 0.75
Epoch 4, Train loss 0.667329878969626, Train accuracy 0.764521484347907, Validation loss 0.7030892074108124, Validation accuracy 0.7703929215669632
Validation accuracy increased from 0.75 to 0.77
Epoch 5, Train loss 0.5888043005358089, Train accuracy 0.7940465198321776, Validation loss 0.6397010505199432, Validation accuracy 0.7880974262952805
Validation accuracy increased from 0.77 to 0.79
Epoch 6, Train loss 0.5342683836140416, Train accuracy 0.8131409798833457, Validation loss 0.6175524070858955, Validation accuracy 0.7909696698188782
Validation accuracy increased from 0.79 to 0.79
Epoch 7, Train loss 0.48516025055538525, Train accuracy 0.8307705965231765, Validation loss 0.48961887657642367, Validation accuracy 0.8347771137952804
Validation accuracy increased from 0.79 to 0.83
Epoch 8, Train loss 0.449683684178374, Train accuracy 0.8420090553435412, Validation loss 0.6858625531196594, Validation accuracy 0.7826976090669632
Epoch 9, Train loss 0.4071791937405413, Train accuracy 0.8573686077513478, Validation loss 0.5454470217227936, Validation accuracy 0.8213235288858414
Epoch 10, Train loss 0.3799321644685485, Train accuracy 0.8683203123509884, Validation loss 0.4306464955210686, Validation accuracy 0.8596392452716828
Validation accuracy increased from 0.83 to 0.86
Epoch 11, Train loss 0.35126184003258293, Train accuracy 0.87672762775963, Validation loss 0.4049691319465637, Validation accuracy 0.8639591008424758
Validation accuracy increased from 0.86 to 0.86
Epoch 12, Train loss 0.32446257693862374, Train accuracy 0.8853400210765275, Validation loss 0.42610924541950224, Validation accuracy 0.8581456810235977
Epoch 13, Train loss 0.30628362509676, Train accuracy 0.8932785865935412, Validation loss 0.4244173660874367, Validation accuracy 0.8613511025905609
Epoch 14, Train loss 0.2836891836063428, Train accuracy 0.9015101207928224, Validation loss 0.45103113502264025, Validation accuracy 0.8522403508424758
Epoch 15, Train loss 0.2687585044821555, Train accuracy 0.905630326745185, Validation loss 0.37818330675363543, Validation accuracy 0.8744600176811218
Validation accuracy increased from 0.86 to 0.87
Epoch 16, Train loss 0.25293823636390944, Train accuracy 0.910756391896443, Validation loss 0.434531632065773, Validation accuracy 0.8588120400905609
Epoch 17, Train loss 0.23844924797727304, Train accuracy 0.9154216972264376, Validation loss 0.3773046493530273, Validation accuracy 0.8728975176811218
Epoch 18, Train loss 0.2266545151360333, Train accuracy 0.9214550781656395, Validation loss 0.4445470854640007, Validation accuracy 0.8642003685235977
Epoch 19, Train loss 0.21203630904413082, Train accuracy 0.9253435724160888, Validation loss 0.3569328635931015, Validation accuracy 0.8851102948188782
Validation accuracy increased from 0.87 to 0.89
Epoch 20, Train loss 0.14051122980361636, Train accuracy 0.953392222862352, Validation loss 0.2753434874117374, Validation accuracy 0.9113625913858414
Validation accuracy increased from 0.89 to 0.91
Epoch 21, Train loss 0.1144681004807353, Train accuracy 0.9629172584549948, Validation loss 0.2828835271298885, Validation accuracy 0.9068933814764023
Epoch 22, Train loss 0.10631955715573647, Train accuracy 0.9639186788011681, Validation loss 0.2783207267522812, Validation accuracy 0.9060087323188781
Epoch 23, Train loss 0.09709800426340238, Train accuracy 0.9673845879733562, Validation loss 0.271938144415617, Validation accuracy 0.9108226090669632
Epoch 24, Train loss 0.09316530457528477, Train accuracy 0.9697176844558932, Validation loss 0.2978937543928623, Validation accuracy 0.9038832724094391
Epoch 25, Train loss 0.08475134449756959, Train accuracy 0.9728693179786205, Validation loss 0.28384909182786944, Validation accuracy 0.9116957724094391
Validation accuracy increased from 0.91 to 0.91
Epoch 26, Train loss 0.0811643521936441, Train accuracy 0.9738964841447093, Validation loss 0.2973496712744236, Validation accuracy 0.9078469663858414
Epoch 27, Train loss 0.07503026876259934, Train accuracy 0.9749618250538002, Validation loss 0.3135279856622219, Validation accuracy 0.904078584909439
Epoch 28, Train loss 0.07426700010811063, Train accuracy 0.9752441404218023, Validation loss 0.2793631210923195, Validation accuracy 0.9100643396377563
Epoch 29, Train loss 0.06854689068330283, Train accuracy 0.9779962711036205, Validation loss 0.31937631517648696, Validation accuracy 0.9049402564764023
Epoch 30, Train loss 0.0672146564095535, Train accuracy 0.9771306816149842, Validation loss 0.3143518060445786, Validation accuracy 0.9081112146377563
Epoch 31, Train loss 0.06357964887072078, Train accuracy 0.9795498932627115, Validation loss 0.3081825189292431, Validation accuracy 0.909937959909439
Epoch 32, Train loss 0.05998401769267565, Train accuracy 0.9807324216447093, Validation loss 0.3087326161563396, Validation accuracy 0.9104549646377563
Epoch 33, Train loss 0.05741154852280901, Train accuracy 0.9812455610795454, Validation loss 0.32414970472455024, Validation accuracy 0.9069852948188781
Epoch 34, Train loss 0.05710167642047798, Train accuracy 0.9812997156246142, Validation loss 0.3206156507134438, Validation accuracy 0.9086741715669632
Epoch 35, Train loss 0.049234025751833214, Train accuracy 0.9844229400835254, Validation loss 0.32973927408456805, Validation accuracy 0.9087201297283173
Epoch 36, Train loss 0.048888017518699846, Train accuracy 0.9839852624996142, Validation loss 0.3175051897764206, Validation accuracy 0.9102366715669632
Epoch 37, Train loss 0.04803633210460909, Train accuracy 0.98486683212898, Validation loss 0.301566444337368, Validation accuracy 0.9131318926811218
Validation accuracy increased from 0.91 to 0.91
Epoch 38, Train loss 0.047216513035395605, Train accuracy 0.984505504031073, Validation loss 0.3291600376367569, Validation accuracy 0.9076286762952804
Epoch 39, Train loss 0.04795396426396275, Train accuracy 0.9839604046534408, Validation loss 0.3278637401759624, Validation accuracy 0.9073988974094391
Epoch 40, Train loss 0.030737136691724034, Train accuracy 0.991575816476887, Validation loss 0.29771689251065253, Validation accuracy 0.9160730689764023
Validation accuracy increased from 0.91 to 0.92
Epoch 41, Train loss 0.026481165079696275, Train accuracy 0.9928852980109778, Validation loss 0.2921395286917686, Validation accuracy 0.9182215064764023
Validation accuracy increased from 0.92 to 0.92
Epoch 42, Train loss 0.023010533281855962, Train accuracy 0.9946511008522727, Validation loss 0.2920708328485489, Validation accuracy 0.9213465064764023
Validation accuracy increased from 0.92 to 0.92
Epoch 43, Train loss 0.022344019568250093, Train accuracy 0.9946448863907293, Validation loss 0.3029642790555954, Validation accuracy 0.9162913590669632
Epoch 44, Train loss 0.022300602645951916, Train accuracy 0.9941566051407293, Validation loss 0.29664722755551337, Validation accuracy 0.9180951297283173
Epoch 45, Train loss 0.02049146619604223, Train accuracy 0.9949396306818182, Validation loss 0.2943692147731781, Validation accuracy 0.9170726090669632
Epoch 46, Train loss 0.01900261608005332, Train accuracy 0.9956534088335254, Validation loss 0.30054550915956496, Validation accuracy 0.9182674646377563
Epoch 47, Train loss 0.0184750173992308, Train accuracy 0.9956942471590909, Validation loss 0.29926093518733976, Validation accuracy 0.9188763797283173
Epoch 48, Train loss 0.017687499909450045, Train accuracy 0.9962650923566385, Validation loss 0.3010138750076294, Validation accuracy 0.9165326297283173
Epoch 49, Train loss 0.016472202551085502, Train accuracy 0.9960369315337051, Validation loss 0.31092054322361945, Validation accuracy 0.9171185672283173
Epoch 50, Train loss 0.01722212317823009, Train accuracy 0.9960209517316385, Validation loss 0.30059155225753786, Validation accuracy 0.9194163590669632
Epoch 51, Train loss 0.017396904303247786, Train accuracy 0.9959099787202749, Validation loss 0.30331871658563614, Validation accuracy 0.9169921875
Epoch 52, Train loss 0.015609892376232892, Train accuracy 0.9964426491748203, Validation loss 0.3026989497244358, Validation accuracy 0.9180261939764023
Epoch 53, Train loss 0.014984894162890587, Train accuracy 0.9969149502840909, Validation loss 0.30601695999503137, Validation accuracy 0.9196116715669632
Epoch 54, Train loss 0.015229927481744777, Train accuracy 0.9966486150568182, Validation loss 0.30422459691762926, Validation accuracy 0.9207375913858413
Epoch 55, Train loss 0.0155355712314221, Train accuracy 0.9964364343746142, Validation loss 0.3082474052906036, Validation accuracy 0.9176585465669632
Epoch 56, Train loss 0.014804026064335962, Train accuracy 0.997197265652093, Validation loss 0.31129392683506013, Validation accuracy 0.9207835465669632
Epoch 57, Train loss 0.01454738534150899, Train accuracy 0.9967595880681818, Validation loss 0.3134472072124481, Validation accuracy 0.9195082724094391
Epoch 58, Train loss 0.013644987832363271, Train accuracy 0.9971466616473414, Validation loss 0.325860059261322, Validation accuracy 0.9158203125
Epoch 59, Train loss 0.01341191761259159, Train accuracy 0.9969309304248203, Validation loss 0.3185665510594845, Validation accuracy 0.9191980689764023
Epoch 60, Train loss 0.011833316782775166, Train accuracy 0.9974636008793657, Validation loss 0.31431085243821144, Validation accuracy 0.9193933814764023
Epoch 61, Train loss 0.011860558271027085, Train accuracy 0.9976917613636364, Validation loss 0.31244429275393487, Validation accuracy 0.9184168189764023
Epoch 62, Train loss 0.01130022868164815, Train accuracy 0.9979012781246142, Validation loss 0.30970446318387984, Validation accuracy 0.9199793189764023
Epoch 63, Train loss 0.01057159394126343, Train accuracy 0.9982182173566385, Validation loss 0.31015375927090644, Validation accuracy 0.9182215064764023
Epoch 64, Train loss 0.010677906357820822, Train accuracy 0.9980912642045454, Validation loss 0.3123422585427761, Validation accuracy 0.9182904422283172
Epoch 65, Train loss 0.010204234843099997, Train accuracy 0.9980912642045454, Validation loss 0.3105438970029354, Validation accuracy 0.9184857547283173
Epoch 66, Train loss 0.010192948117037304, Train accuracy 0.9981356534090909, Validation loss 0.3089457578957081, Validation accuracy 0.9171645224094391
Epoch 67, Train loss 0.009987773951830935, Train accuracy 0.9984463778409091, Validation loss 0.3103310249745846, Validation accuracy 0.9190487146377564
Epoch 68, Train loss 0.00949351394162725, Train accuracy 0.9983735795725476, Validation loss 0.3134654015302658, Validation accuracy 0.9188763797283173
Epoch 69, Train loss 0.009774977615134876, Train accuracy 0.9982688210227273, Validation loss 0.3112264804542065, Validation accuracy 0.9198069840669632
Epoch 0, Train loss 1.9565383392301472, Train accuracy 0.3098970170725476, Validation loss 1.5917227029800416, Validation accuracy 0.4331571698188782
Validation accuracy increased from 0.00 to 0.43
Epoch 1, Train loss 1.460659846663475, Train accuracy 0.4611550071700053, Validation loss 1.4003204882144928, Validation accuracy 0.5052734375
Validation accuracy increased from 0.43 to 0.51
Epoch 2, Train loss 1.2437195405364037, Train accuracy 0.5496244670992548, Validation loss 1.1468233168125153, Validation accuracy 0.5911075383424759
Validation accuracy increased from 0.51 to 0.59
Epoch 3, Train loss 1.0586810040880332, Train accuracy 0.6186328123916279, Validation loss 1.2901573479175568, Validation accuracy 0.5675436586141587
Epoch 4, Train loss 0.9239300370893695, Train accuracy 0.6709410510957241, Validation loss 0.8805213123559952, Validation accuracy 0.6940602034330368
Validation accuracy increased from 0.59 to 0.69
Epoch 5, Train loss 0.8229825439100916, Train accuracy 0.7100630324672569, Validation loss 0.9300331503152848, Validation accuracy 0.6755514711141586
Epoch 6, Train loss 0.7470382844859903, Train accuracy 0.7362872866744344, Validation loss 0.7750368773937225, Validation accuracy 0.737109375
Validation accuracy increased from 0.69 to 0.74
Epoch 7, Train loss 0.6852244948121634, Train accuracy 0.7580877129327167, Validation loss 0.6792531430721283, Validation accuracy 0.7740464150905609
Validation accuracy increased from 0.74 to 0.77
Epoch 8, Train loss 0.6229573444209315, Train accuracy 0.7790207740935412, Validation loss 0.6180164217948914, Validation accuracy 0.7850873172283173
Validation accuracy increased from 0.77 to 0.79
Epoch 9, Train loss 0.5635816803710028, Train accuracy 0.802593217315999, Validation loss 0.6024726748466491, Validation accuracy 0.7916819840669632
Validation accuracy increased from 0.79 to 0.79
Epoch 10, Train loss 0.5142284475944259, Train accuracy 0.8199875710362737, Validation loss 0.5863837361335754, Validation accuracy 0.7966337323188781
Validation accuracy increased from 0.79 to 0.80
Epoch 11, Train loss 0.476639678532427, Train accuracy 0.8327228335494344, Validation loss 0.4912709206342697, Validation accuracy 0.8360753685235978
Validation accuracy increased from 0.80 to 0.84
Epoch 12, Train loss 0.4405815719880841, Train accuracy 0.8456196730787103, Validation loss 0.528402778506279, Validation accuracy 0.8194163590669632
Epoch 13, Train loss 0.4078119456429373, Train accuracy 0.8576855466447093, Validation loss 0.5248908787965775, Validation accuracy 0.8188304215669632
Epoch 14, Train loss 0.3726855453781106, Train accuracy 0.8686363636092707, Validation loss 0.5358417809009552, Validation accuracy 0.8197840064764023
Epoch 15, Train loss 0.3526515517891808, Train accuracy 0.8747336647727273, Validation loss 0.4816423386335373, Validation accuracy 0.8431525737047195
Validation accuracy increased from 0.84 to 0.84
Epoch 16, Train loss 0.3245563257316297, Train accuracy 0.8858815695751797, Validation loss 0.46524868011474607, Validation accuracy 0.8468175560235978
Validation accuracy increased from 0.84 to 0.85
Epoch 17, Train loss 0.3074902130968191, Train accuracy 0.8924982242963531, Validation loss 0.47572253942489623, Validation accuracy 0.8434512883424758
Epoch 18, Train loss 0.2905323054980148, Train accuracy 0.8981374288824472, Validation loss 0.461564365029335, Validation accuracy 0.8497012883424759
Validation accuracy increased from 0.85 to 0.85
Epoch 19, Train loss 0.2708066982132467, Train accuracy 0.9029394530437209, Validation loss 0.4962370112538338, Validation accuracy 0.8452550560235977
Epoch 20, Train loss 0.17866632537069646, Train accuracy 0.9382590553299948, Validation loss 0.3525242432951927, Validation accuracy 0.8837890625
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.13995845421132716, Train accuracy 0.9517658024348996, Validation loss 0.34470371156930923, Validation accuracy 0.8963924646377563
Validation accuracy increased from 0.88 to 0.90
Epoch 22, Train loss 0.12513208473947915, Train accuracy 0.9573020240799948, Validation loss 0.34774372577667234, Validation accuracy 0.8946576297283173
Epoch 23, Train loss 0.11452614363621581, Train accuracy 0.9604847299104388, Validation loss 0.3449740819633007, Validation accuracy 0.8962201297283172
Epoch 24, Train loss 0.10475621463476935, Train accuracy 0.9635253904218023, Validation loss 0.36457440704107286, Validation accuracy 0.8978860288858413
Validation accuracy increased from 0.90 to 0.90
Epoch 25, Train loss 0.09695772579024461, Train accuracy 0.9673428620127115, Validation loss 0.38140892535448073, Validation accuracy 0.8926815271377564
Epoch 26, Train loss 0.0931079985827885, Train accuracy 0.9673721590502695, Validation loss 0.377454936504364, Validation accuracy 0.886937040090561
Epoch 27, Train loss 0.08482880608856001, Train accuracy 0.970609019764445, Validation loss 0.3829220190644264, Validation accuracy 0.8940946698188782
Epoch 28, Train loss 0.08162481496533887, Train accuracy 0.9702920808710835, Validation loss 0.38662913292646406, Validation accuracy 0.8923138797283172
Epoch 29, Train loss 0.07572185751897367, Train accuracy 0.9736310368911787, Validation loss 0.3990920647978783, Validation accuracy 0.8919462323188782
Epoch 30, Train loss 0.0729500782168047, Train accuracy 0.9748544032600793, Validation loss 0.40875724852085116, Validation accuracy 0.8906020224094391
Epoch 31, Train loss 0.0695018107177351, Train accuracy 0.9757990054786205, Validation loss 0.3895033627748489, Validation accuracy 0.8915096521377563
Epoch 32, Train loss 0.06818880504843863, Train accuracy 0.9759836647320878, Validation loss 0.4169198587536812, Validation accuracy 0.8934053301811218
Epoch 33, Train loss 0.06723794279704717, Train accuracy 0.9765092327513478, Validation loss 0.40853314399719237, Validation accuracy 0.89296875
Epoch 34, Train loss 0.06430824139070782, Train accuracy 0.9771528762172569, Validation loss 0.4023802988231182, Validation accuracy 0.8946806073188782
Epoch 35, Train loss 0.06425186159851198, Train accuracy 0.9769495735791597, Validation loss 0.42697628140449523, Validation accuracy 0.889866727590561
Epoch 36, Train loss 0.06013212858868593, Train accuracy 0.9792578122155233, Validation loss 0.4222998782992363, Validation accuracy 0.8915096521377563
Epoch 37, Train loss 0.05315897794736719, Train accuracy 0.9814328832382505, Validation loss 0.40927000492811205, Validation accuracy 0.8966567099094391
Epoch 38, Train loss 0.05353903884745457, Train accuracy 0.9816015623509884, Validation loss 0.47273529320955276, Validation accuracy 0.8850183814764023
Epoch 39, Train loss 0.0527974068377675, Train accuracy 0.9814204543151639, Validation loss 0.4687302246689796, Validation accuracy 0.8852481633424759
Epoch 40, Train loss 0.031201464621434836, Train accuracy 0.9904341264204546, Validation loss 0.3826193481683731, Validation accuracy 0.9067670047283173
Validation accuracy increased from 0.90 to 0.91
Epoch 41, Train loss 0.021019047066643412, Train accuracy 0.9938236861066385, Validation loss 0.3866859957575798, Validation accuracy 0.9083754599094391
Validation accuracy increased from 0.91 to 0.91
Epoch 42, Train loss 0.017198344533839685, Train accuracy 0.9955832741477273, Validation loss 0.38617918491363523, Validation accuracy 0.9081341922283173
Epoch 43, Train loss 0.016752930916316636, Train accuracy 0.9950603690337051, Validation loss 0.3862764224410057, Validation accuracy 0.9088924646377563
Validation accuracy increased from 0.91 to 0.91
Epoch 44, Train loss 0.016317544457375665, Train accuracy 0.9951393821022727, Validation loss 0.3819827876985073, Validation accuracy 0.9087431073188782
Epoch 45, Train loss 0.014414367452528413, Train accuracy 0.9962713068181818, Validation loss 0.39179569482803345, Validation accuracy 0.9104779422283172
Validation accuracy increased from 0.91 to 0.91
Epoch 46, Train loss 0.013162567425752059, Train accuracy 0.9962935014204546, Validation loss 0.40464539676904676, Validation accuracy 0.908961397409439
Epoch 47, Train loss 0.012208814970852638, Train accuracy 0.9970419034361839, Validation loss 0.4035852000117302, Validation accuracy 0.9098690271377563
Epoch 48, Train loss 0.01189160425036045, Train accuracy 0.9969371448863636, Validation loss 0.40246770828962325, Validation accuracy 0.9112132340669632
Validation accuracy increased from 0.91 to 0.91
Epoch 49, Train loss 0.010074273033586162, Train accuracy 0.9975807883522727, Validation loss 0.3996025584638119, Validation accuracy 0.9135569840669632
Validation accuracy increased from 0.91 to 0.91
Epoch 50, Train loss 0.010307490461855195, Train accuracy 0.9974254261363636, Validation loss 0.40377733036875724, Validation accuracy 0.9096966922283173
Epoch 51, Train loss 0.009642032708308596, Train accuracy 0.9976473721590909, Validation loss 0.39844526797533036, Validation accuracy 0.9102366715669632
Epoch 52, Train loss 0.01062991385432807, Train accuracy 0.9973588423295454, Validation loss 0.4093420132994652, Validation accuracy 0.9103285849094391
Epoch 53, Train loss 0.009486186929279938, Train accuracy 0.9977521307089112, Validation loss 0.4131032884120941, Validation accuracy 0.9059857547283172
Epoch 54, Train loss 0.009101701039154168, Train accuracy 0.9975142045454546, Validation loss 0.40881714820861814, Validation accuracy 0.90859375
Epoch 55, Train loss 0.008439792001974472, Train accuracy 0.9979012781246142, Validation loss 0.41718298494815825, Validation accuracy 0.9083984375
Epoch 56, Train loss 0.00828795234701829, Train accuracy 0.9978915127840909, Validation loss 0.4073487788438797, Validation accuracy 0.9102826297283173
Epoch 57, Train loss 0.008478175290458074, Train accuracy 0.997834694317796, Validation loss 0.41681650578975676, Validation accuracy 0.9088924646377563
Epoch 58, Train loss 0.008176328005158046, Train accuracy 0.9981578480113636, Validation loss 0.4129104658961296, Validation accuracy 0.9097196698188782
Epoch 59, Train loss 0.00871510837764204, Train accuracy 0.9978187145157293, Validation loss 0.41449314206838606, Validation accuracy 0.9092830896377564
Epoch 60, Train loss 0.00708012775761414, Train accuracy 0.9983575994318182, Validation loss 0.408456552028656, Validation accuracy 0.9112591922283173
Epoch 61, Train loss 0.006494449681750583, Train accuracy 0.9983575994318182, Validation loss 0.4049613192677498, Validation accuracy 0.9106962323188782
Epoch 62, Train loss 0.005952797074728137, Train accuracy 0.9986461292613636, Validation loss 0.4054495349526405, Validation accuracy 0.9112821698188782
Epoch 63, Train loss 0.004939040813372809, Train accuracy 0.9989790482954546, Validation loss 0.4039392113685608, Validation accuracy 0.9122127771377564
Epoch 64, Train loss 0.00505234684797787, Train accuracy 0.9990234375, Validation loss 0.40297366455197337, Validation accuracy 0.9130170047283173
Epoch 65, Train loss 0.005825988930486015, Train accuracy 0.9988458806818182, Validation loss 0.40544857680797575, Validation accuracy 0.9112132340669632
Epoch 66, Train loss 0.005501112620549975, Train accuracy 0.9988014914772727, Validation loss 0.4072787016630173, Validation accuracy 0.9110638797283173
Epoch 67, Train loss 0.0047864359519074, Train accuracy 0.9992009943181818, Validation loss 0.40702624544501304, Validation accuracy 0.9108685672283172
Epoch 68, Train loss 0.004529211270644076, Train accuracy 0.9990456321022727, Validation loss 0.40892934501171113, Validation accuracy 0.9110409021377563
Epoch 69, Train loss 0.004789734023109882, Train accuracy 0.9990900213068182, Validation loss 0.4083362154662609, Validation accuracy 0.9130170047283173
Epoch 0, Train loss 1.613498106598854, Train accuracy 0.39596768451685255, Validation loss 2.3289687871932983, Validation accuracy 0.31402803361415865
Validation accuracy increased from 0.00 to 0.31
Epoch 1, Train loss 1.173808891326189, Train accuracy 0.5737127130004492, Validation loss 1.1128856539726257, Validation accuracy 0.5986557900905609
Validation accuracy increased from 0.31 to 0.60
Epoch 2, Train loss 0.9575200223109939, Train accuracy 0.6571590907194398, Validation loss 1.0283814728260041, Validation accuracy 0.6449103862047195
Validation accuracy increased from 0.60 to 0.64
Epoch 3, Train loss 0.8116276474161581, Train accuracy 0.7132111151110042, Validation loss 0.8792295694351197, Validation accuracy 0.6949678301811218
Validation accuracy increased from 0.64 to 0.69
Epoch 4, Train loss 0.7178381722081791, Train accuracy 0.7506747157736258, Validation loss 0.7550928145647049, Validation accuracy 0.7474149823188782
Validation accuracy increased from 0.69 to 0.75
Epoch 5, Train loss 0.6457217891107906, Train accuracy 0.7732812498103488, Validation loss 0.6869455963373184, Validation accuracy 0.7623621314764023
Validation accuracy increased from 0.75 to 0.76
Epoch 6, Train loss 0.6035372403196313, Train accuracy 0.7889559658413584, Validation loss 0.7896552205085754, Validation accuracy 0.7440716922283173
Epoch 7, Train loss 0.560309028591622, Train accuracy 0.8042453835633668, Validation loss 0.6336632385849953, Validation accuracy 0.7912454038858414
Validation accuracy increased from 0.76 to 0.79
Epoch 8, Train loss 0.5305382966656577, Train accuracy 0.8159854401918974, Validation loss 0.8393433332443238, Validation accuracy 0.7254825383424759
Epoch 9, Train loss 0.5123235603625124, Train accuracy 0.8229616477408193, Validation loss 0.668535229563713, Validation accuracy 0.7826056987047195
Epoch 10, Train loss 0.48074155182323675, Train accuracy 0.8325461647049948, Validation loss 0.5801591753959656, Validation accuracy 0.8079963237047195
Validation accuracy increased from 0.79 to 0.81
Epoch 11, Train loss 0.46710922653702175, Train accuracy 0.8374316404488954, Validation loss 0.5350157126784325, Validation accuracy 0.8252412676811218
Validation accuracy increased from 0.81 to 0.83
Epoch 12, Train loss 0.4448420683091337, Train accuracy 0.84551491452889, Validation loss 0.518712006509304, Validation accuracy 0.8297334551811218
Validation accuracy increased from 0.83 to 0.83
Epoch 13, Train loss 0.42865435321899975, Train accuracy 0.8513423295860941, Validation loss 0.54931281208992, Validation accuracy 0.8144875913858414
Epoch 14, Train loss 0.42390589094297454, Train accuracy 0.8531116829677061, Validation loss 0.5519089639186859, Validation accuracy 0.8216681987047195
Epoch 15, Train loss 0.40585429255257954, Train accuracy 0.8586044033819978, Validation loss 0.48273609578609467, Validation accuracy 0.8333639711141586
Validation accuracy increased from 0.83 to 0.83
Epoch 16, Train loss 0.39576526629653846, Train accuracy 0.8615731532600793, Validation loss 0.5025075510144233, Validation accuracy 0.8332720577716828
Epoch 17, Train loss 0.38384783386506816, Train accuracy 0.8654057173566385, Validation loss 0.4909897059202194, Validation accuracy 0.8368566185235977
Validation accuracy increased from 0.83 to 0.84
Epoch 18, Train loss 0.3705726743421771, Train accuracy 0.8717533736066385, Validation loss 0.5047799274325371, Validation accuracy 0.8403837323188782
Validation accuracy increased from 0.84 to 0.84
Epoch 19, Train loss 0.3602277326651595, Train accuracy 0.8741716972806237, Validation loss 0.4418440625071526, Validation accuracy 0.8533662676811218
Validation accuracy increased from 0.84 to 0.85
Epoch 20, Train loss 0.2983515500514345, Train accuracy 0.8963600850918076, Validation loss 0.3558486640453339, Validation accuracy 0.8804227948188782
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.27526004443114455, Train accuracy 0.9040083451704546, Validation loss 0.3624503344297409, Validation accuracy 0.8740693926811218
Epoch 22, Train loss 0.26624861918389797, Train accuracy 0.9067977626215328, Validation loss 0.3790294975042343, Validation accuracy 0.8728515625
Epoch 23, Train loss 0.26254712976515293, Train accuracy 0.9077397015961733, Validation loss 0.3614553317427635, Validation accuracy 0.8805721521377563
Validation accuracy increased from 0.88 to 0.88
Epoch 24, Train loss 0.25723572430962865, Train accuracy 0.9100346233357083, Validation loss 0.35544430166482927, Validation accuracy 0.8778147965669632
Epoch 25, Train loss 0.25219140481203794, Train accuracy 0.9106152342124418, Validation loss 0.3882803410291672, Validation accuracy 0.8726792275905609
Epoch 26, Train loss 0.2453887454996055, Train accuracy 0.9141060012308034, Validation loss 0.37368267625570295, Validation accuracy 0.876953125
Epoch 27, Train loss 0.2443499199368737, Train accuracy 0.9133806817910888, Validation loss 0.3716950222849846, Validation accuracy 0.8796415448188781
Epoch 28, Train loss 0.24003055793317882, Train accuracy 0.9163565341044556, Validation loss 0.38867107778787613, Validation accuracy 0.8754365801811218
Epoch 29, Train loss 0.23861130030656402, Train accuracy 0.9158806817775423, Validation loss 0.3656501233577728, Validation accuracy 0.881077665090561
Validation accuracy increased from 0.88 to 0.88
Epoch 30, Train loss 0.23347628573802384, Train accuracy 0.9162393466315486, Validation loss 0.397498095035553, Validation accuracy 0.8705537676811218
Epoch 31, Train loss 0.23620412625711074, Train accuracy 0.9155992540446195, Validation loss 0.4036504730582237, Validation accuracy 0.8705078125
Epoch 32, Train loss 0.23330277085981585, Train accuracy 0.9166228693317283, Validation loss 0.36306885033845904, Validation accuracy 0.8854549646377563
Validation accuracy increased from 0.88 to 0.89
Epoch 33, Train loss 0.2264186038889668, Train accuracy 0.9201624644073573, Validation loss 0.3805257424712181, Validation accuracy 0.8775160849094391
Epoch 34, Train loss 0.22477679145099086, Train accuracy 0.9204794033007189, Validation loss 0.417016988992691, Validation accuracy 0.8695542275905609
Epoch 35, Train loss 0.22247632897712968, Train accuracy 0.9213662997565486, Validation loss 0.38582542091608046, Validation accuracy 0.8781020224094391
Epoch 36, Train loss 0.21916060987859964, Train accuracy 0.9222762784497305, Validation loss 0.3902098134160042, Validation accuracy 0.8743106633424759
Epoch 37, Train loss 0.2168740015476942, Train accuracy 0.9231649501757189, Validation loss 0.4096665918827057, Validation accuracy 0.8727596521377563
Epoch 38, Train loss 0.21516061294823885, Train accuracy 0.9241246448999102, Validation loss 0.35483359917998314, Validation accuracy 0.8812270224094391
Epoch 39, Train loss 0.21059618450023912, Train accuracy 0.9248792613771829, Validation loss 0.3870672509074211, Validation accuracy 0.8784122258424759
Epoch 40, Train loss 0.17981720703061332, Train accuracy 0.9371812854978171, Validation loss 0.34577498584985733, Validation accuracy 0.8896484375
Validation accuracy increased from 0.89 to 0.89
Epoch 41, Train loss 0.16620156516067006, Train accuracy 0.9435031959279017, Validation loss 0.3418715797364712, Validation accuracy 0.8958754599094391
Validation accuracy increased from 0.89 to 0.90
Epoch 42, Train loss 0.16505285060371866, Train accuracy 0.9411345879462633, Validation loss 0.34610642939805986, Validation accuracy 0.891819852590561
Epoch 43, Train loss 0.1569543778049675, Train accuracy 0.9459348364987157, Validation loss 0.34353084340691564, Validation accuracy 0.8894761025905609
Epoch 44, Train loss 0.15647993190214038, Train accuracy 0.9451429332521829, Validation loss 0.34647650718688966, Validation accuracy 0.8922794133424758
Epoch 45, Train loss 0.15850878532298587, Train accuracy 0.944330610673536, Validation loss 0.34878968819975853, Validation accuracy 0.8908662676811219
Epoch 46, Train loss 0.1522930325432257, Train accuracy 0.9476979757574472, Validation loss 0.3414072848856449, Validation accuracy 0.8947725176811219
Epoch 47, Train loss 0.14911300451918083, Train accuracy 0.9472824927758087, Validation loss 0.36412722766399386, Validation accuracy 0.8892348349094391
Epoch 48, Train loss 0.15093451539393177, Train accuracy 0.946772016923536, Validation loss 0.35738078132271767, Validation accuracy 0.8904756426811218
Epoch 49, Train loss 0.1499447624876418, Train accuracy 0.9476979757574472, Validation loss 0.3633200258016586, Validation accuracy 0.8868910849094391
Epoch 50, Train loss 0.1465521266429939, Train accuracy 0.9492009942504492, Validation loss 0.3665596768260002, Validation accuracy 0.8853515625
Epoch 51, Train loss 0.1446374338120222, Train accuracy 0.9488077058710835, Validation loss 0.36779367476701735, Validation accuracy 0.8863740801811218
Epoch 52, Train loss 0.14650687046179717, Train accuracy 0.949477095156908, Validation loss 0.37803694903850554, Validation accuracy 0.8877412676811218
Epoch 53, Train loss 0.1435565669512884, Train accuracy 0.9494211646643552, Validation loss 0.37778348475694656, Validation accuracy 0.8847426474094391
Epoch 54, Train loss 0.13997111647305163, Train accuracy 0.9515953480520032, Validation loss 0.35738158598542213, Validation accuracy 0.891015625
Epoch 55, Train loss 0.14173344120552595, Train accuracy 0.9498251063579862, Validation loss 0.37354595884680747, Validation accuracy 0.8865464150905609
Epoch 56, Train loss 0.14019523721865632, Train accuracy 0.9509952058168974, Validation loss 0.35644895285367967, Validation accuracy 0.8929457724094391
Epoch 57, Train loss 0.13897866861556063, Train accuracy 0.9502352625131607, Validation loss 0.3663166269659996, Validation accuracy 0.89375
Epoch 58, Train loss 0.13812591156668283, Train accuracy 0.9508380679921671, Validation loss 0.3720162145793438, Validation accuracy 0.8874540448188781
Epoch 59, Train loss 0.1365305546417155, Train accuracy 0.9514364346184514, Validation loss 0.36057972759008405, Validation accuracy 0.8891084551811218
Epoch 60, Train loss 0.12506427474065937, Train accuracy 0.956186079504815, Validation loss 0.36466662138700484, Validation accuracy 0.8909926474094391
Epoch 61, Train loss 0.11793862778524106, Train accuracy 0.959984019737352, Validation loss 0.3548507772386074, Validation accuracy 0.894312959909439
Epoch 62, Train loss 0.11791042297739875, Train accuracy 0.9596954899078066, Validation loss 0.3626914590597153, Validation accuracy 0.893359375
Epoch 63, Train loss 0.11776133436201648, Train accuracy 0.9597842683168974, Validation loss 0.35532278642058374, Validation accuracy 0.8939223349094391
Epoch 64, Train loss 0.11510743685490028, Train accuracy 0.9606125710362737, Validation loss 0.3600809261202812, Validation accuracy 0.8945542275905609
Epoch 65, Train loss 0.1153460916089402, Train accuracy 0.9605291191149842, Validation loss 0.3569225549697876, Validation accuracy 0.8960707724094391
Validation accuracy increased from 0.90 to 0.90
Epoch 66, Train loss 0.11473205545917153, Train accuracy 0.9596191404218023, Validation loss 0.3546566739678383, Validation accuracy 0.8951171875
Epoch 67, Train loss 0.11740534841506318, Train accuracy 0.959261363541538, Validation loss 0.35970855206251146, Validation accuracy 0.8974149823188782
Validation accuracy increased from 0.90 to 0.90
Epoch 68, Train loss 0.11238706541586328, Train accuracy 0.9606116830625318, Validation loss 0.3614992991089821, Validation accuracy 0.8927734375
Epoch 69, Train loss 0.11242836392061277, Train accuracy 0.9612366831438108, Validation loss 0.36715609207749367, Validation accuracy 0.8929457724094391
Epoch 0, Train loss 2.1124808097427543, Train accuracy 0.24106445315886627, Validation loss 1.7660448729991913, Validation accuracy 0.34965533167123797
Validation accuracy increased from 0.00 to 0.35
Epoch 1, Train loss 1.6524796424941584, Train accuracy 0.38009410503913055, Validation loss 1.6066065788269044, Validation accuracy 0.4042738974094391
Validation accuracy increased from 0.35 to 0.40
Epoch 2, Train loss 1.4191105223514817, Train accuracy 0.47594105113636365, Validation loss 1.4001019418239593, Validation accuracy 0.48820082694292066
Validation accuracy increased from 0.40 to 0.49
Epoch 3, Train loss 1.2343000783161684, Train accuracy 0.5534454899078066, Validation loss 1.255515456199646, Validation accuracy 0.5445657163858414
Validation accuracy increased from 0.49 to 0.54
Epoch 4, Train loss 1.0638338947160677, Train accuracy 0.6190385296940804, Validation loss 1.0587889075279235, Validation accuracy 0.6287568926811218
Validation accuracy increased from 0.54 to 0.63
Epoch 5, Train loss 0.9425416053696112, Train accuracy 0.6645232598212633, Validation loss 0.9073027282953262, Validation accuracy 0.6806525737047195
Validation accuracy increased from 0.63 to 0.68
Epoch 6, Train loss 0.8375097587704659, Train accuracy 0.705810546875, Validation loss 0.9143442809581757, Validation accuracy 0.6783088237047196
Epoch 7, Train loss 0.759281415830959, Train accuracy 0.7334836646914482, Validation loss 0.745052382349968, Validation accuracy 0.7381204038858413
Validation accuracy increased from 0.68 to 0.74
Epoch 8, Train loss 0.6731822649863634, Train accuracy 0.76513671875, Validation loss 0.6662538766860961, Validation accuracy 0.7719669133424759
Validation accuracy increased from 0.74 to 0.77
Epoch 9, Train loss 0.6176379770040512, Train accuracy 0.7836354757574472, Validation loss 0.5882783532142639, Validation accuracy 0.7990808814764023
Validation accuracy increased from 0.77 to 0.80
Epoch 10, Train loss 0.5745500576767054, Train accuracy 0.7997238991612737, Validation loss 0.5984133213758469, Validation accuracy 0.7910500913858414
Epoch 11, Train loss 0.5336940943856131, Train accuracy 0.8163503195074472, Validation loss 0.6038864135742188, Validation accuracy 0.7966337323188781
Epoch 12, Train loss 0.49829342791979964, Train accuracy 0.8246644176542759, Validation loss 0.5291856825351715, Validation accuracy 0.8177504599094391
Validation accuracy increased from 0.80 to 0.82
Epoch 13, Train loss 0.4603312525220893, Train accuracy 0.8405868251892653, Validation loss 0.607747596502304, Validation accuracy 0.7978515625
Epoch 14, Train loss 0.43795395202257414, Train accuracy 0.845332031222907, Validation loss 0.5208087503910065, Validation accuracy 0.8225413590669632
Validation accuracy increased from 0.82 to 0.82
Epoch 15, Train loss 0.4151469934731722, Train accuracy 0.854398082264445, Validation loss 0.5426304921507835, Validation accuracy 0.8244944840669632
Validation accuracy increased from 0.82 to 0.82
Epoch 16, Train loss 0.3923084346408194, Train accuracy 0.8628986149348996, Validation loss 0.46437377482652664, Validation accuracy 0.8427619487047195
Validation accuracy increased from 0.82 to 0.84
Epoch 17, Train loss 0.3687898249111392, Train accuracy 0.8720126063986258, Validation loss 0.4281552344560623, Validation accuracy 0.8512522965669632
Validation accuracy increased from 0.84 to 0.85
Epoch 18, Train loss 0.34735759982669895, Train accuracy 0.8767311789772727, Validation loss 0.4172577753663063, Validation accuracy 0.8560431987047196
Validation accuracy increased from 0.85 to 0.86
Epoch 19, Train loss 0.33327456352046947, Train accuracy 0.8834303976459936, Validation loss 0.48560954332351686, Validation accuracy 0.8412224262952804
Epoch 20, Train loss 0.23194317790594968, Train accuracy 0.9190926846455444, Validation loss 0.3487005949020386, Validation accuracy 0.8827550560235977
Validation accuracy increased from 0.86 to 0.88
Epoch 21, Train loss 0.19565778208727186, Train accuracy 0.9316486150703647, Validation loss 0.35393543988466264, Validation accuracy 0.8837086409330368
Validation accuracy increased from 0.88 to 0.88
Epoch 22, Train loss 0.18067380553111434, Train accuracy 0.938119673254815, Validation loss 0.3514105796813965, Validation accuracy 0.8895450383424759
Validation accuracy increased from 0.88 to 0.89
Epoch 23, Train loss 0.17005982224575497, Train accuracy 0.9413316761228171, Validation loss 0.36058551743626593, Validation accuracy 0.8851907163858413
Epoch 24, Train loss 0.15569601648233153, Train accuracy 0.9460431462661787, Validation loss 0.38157824128866197, Validation accuracy 0.8804113060235977
Epoch 25, Train loss 0.15085777365179223, Train accuracy 0.9475150921128013, Validation loss 0.39518130123615264, Validation accuracy 0.8765280336141587
Epoch 26, Train loss 0.14393943781033158, Train accuracy 0.9500195312906395, Validation loss 0.39695675373077394, Validation accuracy 0.8789981633424759
Epoch 27, Train loss 0.13638612064956265, Train accuracy 0.9518457031385466, Validation loss 0.3751548409461975, Validation accuracy 0.886937040090561
Epoch 28, Train loss 0.1268449222499674, Train accuracy 0.9552672227675264, Validation loss 0.39093227684497833, Validation accuracy 0.8818244487047195
Epoch 29, Train loss 0.11901870615441691, Train accuracy 0.9570197087119926, Validation loss 0.39493158757686614, Validation accuracy 0.8866383284330368
Epoch 30, Train loss 0.11994031552140685, Train accuracy 0.9572798294777219, Validation loss 0.41153275966644287, Validation accuracy 0.8797794133424759
Epoch 31, Train loss 0.10871980790133504, Train accuracy 0.962055220184001, Validation loss 0.38806281238794327, Validation accuracy 0.8892003685235977
Epoch 32, Train loss 0.10448449883948673, Train accuracy 0.9632120027460835, Validation loss 0.40882242769002913, Validation accuracy 0.8808019310235977
Epoch 33, Train loss 0.09795041428878903, Train accuracy 0.9653808593072675, Validation loss 0.4197377532720566, Validation accuracy 0.8850068926811219
Epoch 34, Train loss 0.09688365290110762, Train accuracy 0.9659543677487157, Validation loss 0.4487288549542427, Validation accuracy 0.8750114887952805
Epoch 35, Train loss 0.09402841230092401, Train accuracy 0.9668394885957241, Validation loss 0.4482292652130127, Validation accuracy 0.8753791362047195
Epoch 36, Train loss 0.08816949870776046, Train accuracy 0.9697372158142653, Validation loss 0.4032053291797638, Validation accuracy 0.8887408077716827
Epoch 37, Train loss 0.08223624821667644, Train accuracy 0.971097301014445, Validation loss 0.41126292049884794, Validation accuracy 0.8922104775905609
Validation accuracy increased from 0.89 to 0.89
Epoch 38, Train loss 0.07464201697571711, Train accuracy 0.9734818891368129, Validation loss 0.42355658262968066, Validation accuracy 0.8891314327716827
Epoch 39, Train loss 0.07825056246524169, Train accuracy 0.9726757810197093, Validation loss 0.43329848200082777, Validation accuracy 0.8924517452716827
Validation accuracy increased from 0.89 to 0.89
Epoch 40, Train loss 0.045474428090859546, Train accuracy 0.9855202412740751, Validation loss 0.374047127366066, Validation accuracy 0.8997012883424759
Validation accuracy increased from 0.89 to 0.90
Epoch 41, Train loss 0.034776497806888074, Train accuracy 0.9892453832382505, Validation loss 0.38539761304855347, Validation accuracy 0.8996783077716828
Epoch 42, Train loss 0.027880226621742953, Train accuracy 0.9923686076971617, Validation loss 0.3784618817269802, Validation accuracy 0.9048598349094391
Validation accuracy increased from 0.90 to 0.90
Epoch 43, Train loss 0.024637148101729425, Train accuracy 0.9931134588339112, Validation loss 0.3825036436319351, Validation accuracy 0.9030445784330368
Epoch 44, Train loss 0.024230079508428884, Train accuracy 0.9936079545454546, Validation loss 0.38170205131173135, Validation accuracy 0.9031709551811218
Epoch 45, Train loss 0.022997954979390754, Train accuracy 0.9937411221590909, Validation loss 0.3942592695355415, Validation accuracy 0.9037339150905609
Epoch 46, Train loss 0.021724087667693806, Train accuracy 0.9940012429248203, Validation loss 0.3925307862460613, Validation accuracy 0.9005055159330368
Epoch 47, Train loss 0.01984172622906044, Train accuracy 0.9945845170454546, Validation loss 0.39180658757686615, Validation accuracy 0.9006548702716828
Epoch 48, Train loss 0.019257784167579797, Train accuracy 0.9948446378111839, Validation loss 0.3995667487382889, Validation accuracy 0.9016773909330368
Epoch 49, Train loss 0.017305488174315542, Train accuracy 0.9952503551136364, Validation loss 0.4035902708768845, Validation accuracy 0.9010454952716828
Epoch 50, Train loss 0.016334218965229495, Train accuracy 0.9958052201704546, Validation loss 0.3976736515760422, Validation accuracy 0.9009995400905609
Epoch 51, Train loss 0.01667827134951949, Train accuracy 0.9956880326975476, Validation loss 0.4088202342391014, Validation accuracy 0.9045611202716828
Epoch 52, Train loss 0.014750221342017705, Train accuracy 0.9961035153405233, Validation loss 0.4009868547320366, Validation accuracy 0.9021943926811218
Epoch 53, Train loss 0.014003224547857164, Train accuracy 0.99658203125, Validation loss 0.3977156698703766, Validation accuracy 0.9004595577716827
Epoch 54, Train loss 0.013217245269598525, Train accuracy 0.99658203125, Validation loss 0.3987613350152969, Validation accuracy 0.9028033077716827
Epoch 55, Train loss 0.013482782559797422, Train accuracy 0.9965314275839112, Validation loss 0.3920497357845306, Validation accuracy 0.901953125
Epoch 56, Train loss 0.013080456991288387, Train accuracy 0.9968643466180022, Validation loss 0.4018861770629883, Validation accuracy 0.9041245400905609
Epoch 57, Train loss 0.013163156429072842, Train accuracy 0.9967373934659091, Validation loss 0.4083471655845642, Validation accuracy 0.8998506426811218
Epoch 58, Train loss 0.013682565506314859, Train accuracy 0.9963156960227273, Validation loss 0.41822863817214967, Validation accuracy 0.8994370400905609
Epoch 59, Train loss 0.01198692079395352, Train accuracy 0.9973526278680022, Validation loss 0.4075688496232033, Validation accuracy 0.9027573525905609
Epoch 60, Train loss 0.010085509019766258, Train accuracy 0.9975745738907293, Validation loss 0.4037170261144638, Validation accuracy 0.9018037676811218
Epoch 61, Train loss 0.00980092979311435, Train accuracy 0.9976411576975476, Validation loss 0.40084381103515626, Validation accuracy 0.9041475176811218
Epoch 62, Train loss 0.009014363962871192, Train accuracy 0.9982244318181818, Validation loss 0.39919704496860503, Validation accuracy 0.9029526650905609
Epoch 63, Train loss 0.008658825414551591, Train accuracy 0.9980690696022727, Validation loss 0.39488286674022677, Validation accuracy 0.9043428301811218
Epoch 64, Train loss 0.008195516333216801, Train accuracy 0.9981578480113636, Validation loss 0.406376114487648, Validation accuracy 0.9023897051811218
Epoch 65, Train loss 0.007520295690813906, Train accuracy 0.9983354048295454, Validation loss 0.40534131824970243, Validation accuracy 0.9023897051811218
Epoch 66, Train loss 0.007592682968772186, Train accuracy 0.9986017400568182, Validation loss 0.40414386093616483, Validation accuracy 0.9035615801811219
Epoch 67, Train loss 0.0070125350288104855, Train accuracy 0.9986905184659091, Validation loss 0.3981347680091858, Validation accuracy 0.9023667275905609
Epoch 68, Train loss 0.0070530720086852934, Train accuracy 0.9986017400568182, Validation loss 0.4031773000955582, Validation accuracy 0.9041245400905609
Epoch 69, Train loss 0.007423813640012999, Train accuracy 0.998417968777093, Validation loss 0.3964299589395523, Validation accuracy 0.9039522051811218
Epoch 0, Train loss 1.7686878950758413, Train accuracy 0.34086203829131345, Validation loss 1.5155578076839447, Validation accuracy 0.4358800545334816
Validation accuracy increased from 0.00 to 0.44
Epoch 1, Train loss 1.2970113307237625, Train accuracy 0.5261035155166279, Validation loss 1.6126489341259003, Validation accuracy 0.5002412691712379
Validation accuracy increased from 0.44 to 0.50
Epoch 2, Train loss 1.0013061108236962, Train accuracy 0.6396821730516173, Validation loss 0.9280438452959061, Validation accuracy 0.6840877771377564
Validation accuracy increased from 0.50 to 0.68
Epoch 3, Train loss 0.831111141903834, Train accuracy 0.7071049359034408, Validation loss 0.8638454169034958, Validation accuracy 0.7062385112047196
Validation accuracy increased from 0.68 to 0.71
Epoch 4, Train loss 0.716671708971262, Train accuracy 0.7501047585498203, Validation loss 0.7383860617876052, Validation accuracy 0.7457720577716828
Validation accuracy increased from 0.71 to 0.75
Epoch 5, Train loss 0.6451806348155845, Train accuracy 0.7748100141232664, Validation loss 0.6650907561182976, Validation accuracy 0.7791704952716827
Validation accuracy increased from 0.75 to 0.78
Epoch 6, Train loss 0.5868784184144302, Train accuracy 0.7930024855516173, Validation loss 0.6799129843711853, Validation accuracy 0.7677734375
Epoch 7, Train loss 0.5426165273582394, Train accuracy 0.8113254616883668, Validation loss 0.5340487107634544, Validation accuracy 0.8201976090669632
Validation accuracy increased from 0.78 to 0.82
Epoch 8, Train loss 0.5052139276469295, Train accuracy 0.8233860084279017, Validation loss 0.5380747392773628, Validation accuracy 0.8195197612047196
Epoch 9, Train loss 0.47225435569205065, Train accuracy 0.8344788707115434, Validation loss 0.5452675387263298, Validation accuracy 0.8148322612047195
Epoch 10, Train loss 0.4576222075318748, Train accuracy 0.8417249643667177, Validation loss 0.4618896618485451, Validation accuracy 0.8409581810235978
Validation accuracy increased from 0.82 to 0.84
Epoch 11, Train loss 0.4286304929039695, Train accuracy 0.8493821021508087, Validation loss 0.4769686058163643, Validation accuracy 0.8338005512952804
Epoch 12, Train loss 0.4129946628077464, Train accuracy 0.8562775213610042, Validation loss 0.5268674328923225, Validation accuracy 0.819140625
Epoch 13, Train loss 0.3906303854151206, Train accuracy 0.8638423295183615, Validation loss 0.4544549062848091, Validation accuracy 0.8484719663858413
Validation accuracy increased from 0.84 to 0.85
Epoch 14, Train loss 0.3767203456637534, Train accuracy 0.8659348365935412, Validation loss 0.4577683135867119, Validation accuracy 0.8398322612047195
Epoch 15, Train loss 0.35787739350714465, Train accuracy 0.8734756745398045, Validation loss 0.5366945147514344, Validation accuracy 0.8253791362047196
Epoch 16, Train loss 0.3430205900222063, Train accuracy 0.8814524147998203, Validation loss 0.5677339524030686, Validation accuracy 0.8218520224094391
Epoch 17, Train loss 0.3369913577864116, Train accuracy 0.8828471235253594, Validation loss 0.4590002030134201, Validation accuracy 0.850390625
Validation accuracy increased from 0.85 to 0.85
Epoch 18, Train loss 0.3212180540642955, Train accuracy 0.8855415481058034, Validation loss 0.4354442685842514, Validation accuracy 0.8582146137952804
Validation accuracy increased from 0.85 to 0.86
Epoch 19, Train loss 0.3120651129971851, Train accuracy 0.8893093040043657, Validation loss 0.4724110931158066, Validation accuracy 0.8509765625
Epoch 20, Train loss 0.23430226074362343, Train accuracy 0.9182812500406395, Validation loss 0.3435867577791214, Validation accuracy 0.8899126827716828
Validation accuracy increased from 0.86 to 0.89
Epoch 21, Train loss 0.20783957398750566, Train accuracy 0.9274103336713531, Validation loss 0.3535626620054245, Validation accuracy 0.8904756426811218
Validation accuracy increased from 0.89 to 0.89
Epoch 22, Train loss 0.19993269341913136, Train accuracy 0.9292773435061629, Validation loss 0.3461321659386158, Validation accuracy 0.8906939327716827
Validation accuracy increased from 0.89 to 0.89
Epoch 23, Train loss 0.1926836649548601, Train accuracy 0.9317587001079862, Validation loss 0.3379009425640106, Validation accuracy 0.8902803301811218
Epoch 24, Train loss 0.1840111123482612, Train accuracy 0.9349582740529017, Validation loss 0.35827334970235825, Validation accuracy 0.8915326297283173
Validation accuracy increased from 0.89 to 0.89
Epoch 25, Train loss 0.17600476161830805, Train accuracy 0.9375301846726374, Validation loss 0.3496642880141735, Validation accuracy 0.8899816185235977
Epoch 26, Train loss 0.1755629668689587, Train accuracy 0.9368457028811629, Validation loss 0.3549186483025551, Validation accuracy 0.8914522051811218
Epoch 27, Train loss 0.16862266760488803, Train accuracy 0.9399147724563425, Validation loss 0.36960813850164415, Validation accuracy 0.8903033077716828
Epoch 28, Train loss 0.16323339117860253, Train accuracy 0.9415571730245244, Validation loss 0.3530582211911678, Validation accuracy 0.8916015625
Validation accuracy increased from 0.89 to 0.89
Epoch 29, Train loss 0.16089914057573135, Train accuracy 0.9422443180598996, Validation loss 0.37166406214237213, Validation accuracy 0.8951171875
Validation accuracy increased from 0.89 to 0.90
Epoch 30, Train loss 0.155313463839279, Train accuracy 0.9433673650703647, Validation loss 0.37221423983573915, Validation accuracy 0.8877642452716827
Epoch 31, Train loss 0.1515096606771377, Train accuracy 0.9461736502972516, Validation loss 0.3929431602358818, Validation accuracy 0.8865923702716827
Epoch 32, Train loss 0.14556271635757928, Train accuracy 0.9479740766639059, Validation loss 0.3710573635995388, Validation accuracy 0.8958984375
Validation accuracy increased from 0.90 to 0.90
Epoch 33, Train loss 0.1432377784512937, Train accuracy 0.9485759941691702, Validation loss 0.3907140910625458, Validation accuracy 0.8882582724094391
Epoch 34, Train loss 0.14216327049176802, Train accuracy 0.9488050426271829, Validation loss 0.38703336417675016, Validation accuracy 0.8933823525905609
Epoch 35, Train loss 0.1337276624981314, Train accuracy 0.9520703124051745, Validation loss 0.3759477213025093, Validation accuracy 0.8924287676811218
Epoch 36, Train loss 0.1350897871889174, Train accuracy 0.9506409801542759, Validation loss 0.37038690894842147, Validation accuracy 0.8986328125
Validation accuracy increased from 0.90 to 0.90
Epoch 37, Train loss 0.12963412100957197, Train accuracy 0.9538467682220719, Validation loss 0.36777041628956797, Validation accuracy 0.8919921875
Epoch 38, Train loss 0.12872252469374376, Train accuracy 0.9532501775432717, Validation loss 0.4339970737695694, Validation accuracy 0.8807559758424759
Epoch 39, Train loss 0.12960533431561833, Train accuracy 0.9530850496481765, Validation loss 0.41165361404418943, Validation accuracy 0.8903262883424758
Epoch 40, Train loss 0.08951387167061595, Train accuracy 0.9687153761359778, Validation loss 0.3612158626317978, Validation accuracy 0.9044462323188782
Validation accuracy increased from 0.90 to 0.90
Epoch 41, Train loss 0.07434566492553461, Train accuracy 0.9741885651918974, Validation loss 0.3569201499223709, Validation accuracy 0.9064453125
Validation accuracy increased from 0.90 to 0.91
Epoch 42, Train loss 0.06640939250461418, Train accuracy 0.9771528762172569, Validation loss 0.3759119361639023, Validation accuracy 0.9049287676811218
Epoch 43, Train loss 0.06130450727968392, Train accuracy 0.9783611504191702, Validation loss 0.3748394787311554, Validation accuracy 0.9068129599094391
Validation accuracy increased from 0.91 to 0.91
Epoch 44, Train loss 0.06387374392414297, Train accuracy 0.9783762429248203, Validation loss 0.36936890333890915, Validation accuracy 0.9029756426811218
Epoch 45, Train loss 0.06236586374738677, Train accuracy 0.9784650213339112, Validation loss 0.3950774624943733, Validation accuracy 0.8998506426811218
Epoch 46, Train loss 0.05874401391272179, Train accuracy 0.9803710935468023, Validation loss 0.3899869084358215, Validation accuracy 0.9035845577716828
Epoch 47, Train loss 0.05417992256116122, Train accuracy 0.9818670099431818, Validation loss 0.38890945315361025, Validation accuracy 0.905078125
Epoch 48, Train loss 0.05451671682848511, Train accuracy 0.9814426489174366, Validation loss 0.39438374191522596, Validation accuracy 0.9012408077716827
Epoch 49, Train loss 0.052806210280819374, Train accuracy 0.9813538705083457, Validation loss 0.39133537709712984, Validation accuracy 0.9029756426811218
Epoch 50, Train loss 0.05076347410001538, Train accuracy 0.9821493253111839, Validation loss 0.4022433266043663, Validation accuracy 0.9026079952716828
Epoch 51, Train loss 0.049693762441165745, Train accuracy 0.9820134941149842, Validation loss 0.4114586845040321, Validation accuracy 0.9016314327716828
Epoch 52, Train loss 0.05091207626339218, Train accuracy 0.982298472726887, Validation loss 0.3960072100162506, Validation accuracy 0.9068818926811218
Validation accuracy increased from 0.91 to 0.91
Epoch 53, Train loss 0.04822636216836558, Train accuracy 0.9829678620127115, Validation loss 0.39965626448392866, Validation accuracy 0.9039751827716828
Epoch 54, Train loss 0.04634652244964276, Train accuracy 0.9840838065878912, Validation loss 0.4070740342140198, Validation accuracy 0.9059283077716828
Epoch 55, Train loss 0.04814043565420434, Train accuracy 0.9833478338339112, Validation loss 0.4224085554480553, Validation accuracy 0.9000459551811218
Epoch 56, Train loss 0.044431486934296445, Train accuracy 0.9845658733763478, Validation loss 0.42230048924684527, Validation accuracy 0.9037568926811218
Epoch 57, Train loss 0.044992248908701266, Train accuracy 0.9842773435468023, Validation loss 0.4006590947508812, Validation accuracy 0.9043198525905609
Epoch 58, Train loss 0.042268767069220885, Train accuracy 0.9858052198859778, Validation loss 0.41927956491708757, Validation accuracy 0.9042738974094391
Epoch 59, Train loss 0.04386524988380684, Train accuracy 0.9847052554515275, Validation loss 0.4140747100114822, Validation accuracy 0.9036879599094391
Epoch 60, Train loss 0.03547364507738331, Train accuracy 0.9881418679248203, Validation loss 0.40876608788967134, Validation accuracy 0.9048598349094391
Epoch 61, Train loss 0.031912623073863375, Train accuracy 0.9894229400564324, Validation loss 0.4082893535494804, Validation accuracy 0.9045381426811219
Epoch 62, Train loss 0.0298903263756074, Train accuracy 0.9906436431814324, Validation loss 0.41258553713560103, Validation accuracy 0.907421875
Validation accuracy increased from 0.91 to 0.91
Epoch 63, Train loss 0.029737920373339544, Train accuracy 0.9905007102272727, Validation loss 0.41842672526836394, Validation accuracy 0.90625
Epoch 64, Train loss 0.029110975431236016, Train accuracy 0.9903995025564324, Validation loss 0.4116506800055504, Validation accuracy 0.90703125
Epoch 65, Train loss 0.02592118683969602, Train accuracy 0.9922132454812527, Validation loss 0.4129320099949837, Validation accuracy 0.9057100176811218
Epoch 66, Train loss 0.027087518548465927, Train accuracy 0.9916903407058932, Validation loss 0.414154015481472, Validation accuracy 0.907421875
Validation accuracy increased from 0.91 to 0.91
Epoch 67, Train loss 0.02603983880412257, Train accuracy 0.9918705611066385, Validation loss 0.4109776750206947, Validation accuracy 0.9064453125
Epoch 68, Train loss 0.02583941075400534, Train accuracy 0.9918101917613636, Validation loss 0.41899014413356783, Validation accuracy 0.907421875
Validation accuracy increased from 0.91 to 0.91
Epoch 69, Train loss 0.025525312727867542, Train accuracy 0.9918643463064324, Validation loss 0.4150944843888283, Validation accuracy 0.9081571698188782
Validation accuracy increased from 0.91 to 0.91
Test loss: 0.3165593516081572 Test accuracy: 0.91455078125  resnet10_SGD_0.1
Test loss: 0.4331353183835745 Test accuracy: 0.90283203125  resnet18_SGD_0.1
Test loss: 0.38084388487041 Test accuracy: 0.89033203125  resnet12_SGD_0.1
Test loss: 0.423050719127059 Test accuracy: 0.89560546875  resnet14_4_SGD_0.1
Test loss: 0.46691943407058717 Test accuracy: 0.89453125  resnet14_5_SGD_0.1
Epoch 0, Train loss 1.58043715425513, Train accuracy 0.42511718754063954, Validation loss 1.3930488526821136, Validation accuracy 0.49287683963775636
Validation accuracy increased from 0.00 to 0.49
Epoch 1, Train loss 1.2190401344136759, Train accuracy 0.5619460225782611, Validation loss 1.202572649717331, Validation accuracy 0.5764820784330368
Validation accuracy increased from 0.49 to 0.58
Epoch 2, Train loss 1.0501704348081893, Train accuracy 0.6248100142587315, Validation loss 0.9845744490623474, Validation accuracy 0.6517233461141586
Validation accuracy increased from 0.58 to 0.65
Epoch 3, Train loss 0.9368122819472443, Train accuracy 0.6684268465773626, Validation loss 0.9011272042989731, Validation accuracy 0.6810202211141586
Validation accuracy increased from 0.65 to 0.68
Epoch 4, Train loss 0.8569095703688535, Train accuracy 0.6981667256490751, Validation loss 0.8206309974193573, Validation accuracy 0.7131548702716828
Validation accuracy increased from 0.68 to 0.71
Epoch 5, Train loss 0.7924980148673058, Train accuracy 0.7205957028676163, Validation loss 0.8417279958724976, Validation accuracy 0.7037339150905609
Epoch 6, Train loss 0.7343882156366651, Train accuracy 0.7437349076975476, Validation loss 0.7573027729988098, Validation accuracy 0.7341796875
Validation accuracy increased from 0.71 to 0.73
Epoch 7, Train loss 0.686771786687049, Train accuracy 0.7603346945887263, Validation loss 0.7785621017217637, Validation accuracy 0.739039522409439
Validation accuracy increased from 0.73 to 0.74
Epoch 8, Train loss 0.6482737988910892, Train accuracy 0.7713068181818182, Validation loss 0.7546531140804291, Validation accuracy 0.7405330896377563
Validation accuracy increased from 0.74 to 0.74
Epoch 9, Train loss 0.6118689328432083, Train accuracy 0.7871439985253594, Validation loss 0.6916846960783005, Validation accuracy 0.7646024823188782
Validation accuracy increased from 0.74 to 0.76
Epoch 10, Train loss 0.5798757479272105, Train accuracy 0.799058061093092, Validation loss 0.6556190639734268, Validation accuracy 0.7763556987047195
Validation accuracy increased from 0.76 to 0.78
Epoch 11, Train loss 0.5597293395549059, Train accuracy 0.8068412640555338, Validation loss 0.6271771669387818, Validation accuracy 0.7857881426811218
Validation accuracy increased from 0.78 to 0.79
Epoch 12, Train loss 0.529342969879508, Train accuracy 0.8163547583601691, Validation loss 0.6113555431365967, Validation accuracy 0.7915670961141587
Validation accuracy increased from 0.79 to 0.79
Epoch 13, Train loss 0.5040950780226425, Train accuracy 0.8237917257303541, Validation loss 0.660208198428154, Validation accuracy 0.7820542275905609
Epoch 14, Train loss 0.48943873935125093, Train accuracy 0.8292169743640856, Validation loss 0.6907477498054504, Validation accuracy 0.7787454038858413
Epoch 15, Train loss 0.46646988493475045, Train accuracy 0.8386754261499102, Validation loss 0.6159426108002662, Validation accuracy 0.7962545961141586
Validation accuracy increased from 0.79 to 0.80
Epoch 16, Train loss 0.447217475453561, Train accuracy 0.8442995382303541, Validation loss 0.6475020229816437, Validation accuracy 0.7832605689764023
Epoch 17, Train loss 0.4267040724781426, Train accuracy 0.8520960580896247, Validation loss 0.6360007852315903, Validation accuracy 0.7919806987047195
Epoch 18, Train loss 0.4177791386504065, Train accuracy 0.8549591617828066, Validation loss 0.5138414040207863, Validation accuracy 0.8282169133424759
Validation accuracy increased from 0.80 to 0.83
Epoch 19, Train loss 0.4012201978740367, Train accuracy 0.8619877486066385, Validation loss 0.48875668495893476, Validation accuracy 0.8368336409330368
Validation accuracy increased from 0.83 to 0.84
Epoch 20, Train loss 0.3380345647138628, Train accuracy 0.8845561079003594, Validation loss 0.42447360306978227, Validation accuracy 0.86015625
Validation accuracy increased from 0.84 to 0.86
Epoch 21, Train loss 0.3270843585275791, Train accuracy 0.8879456675865434, Validation loss 0.4130594521760941, Validation accuracy 0.863062959909439
Validation accuracy increased from 0.86 to 0.86
Epoch 22, Train loss 0.3183177780698646, Train accuracy 0.8914808238094504, Validation loss 0.4208341702818871, Validation accuracy 0.8603056073188782
Epoch 23, Train loss 0.3109448603777723, Train accuracy 0.8946235792880709, Validation loss 0.415734001994133, Validation accuracy 0.864039522409439
Validation accuracy increased from 0.86 to 0.86
Epoch 24, Train loss 0.30638632152906875, Train accuracy 0.8947363279082559, Validation loss 0.4131689161062241, Validation accuracy 0.8610638797283172
Epoch 25, Train loss 0.2981937737627463, Train accuracy 0.8982501775026321, Validation loss 0.4268381640315056, Validation accuracy 0.8614774823188782
Epoch 26, Train loss 0.2922818712382154, Train accuracy 0.9008149856870825, Validation loss 0.4235760197043419, Validation accuracy 0.8623276650905609
Epoch 27, Train loss 0.28777042717080226, Train accuracy 0.9017080966044556, Validation loss 0.40578396767377856, Validation accuracy 0.8690487146377563
Validation accuracy increased from 0.86 to 0.87
Epoch 28, Train loss 0.28024668365039607, Train accuracy 0.9055291190743446, Validation loss 0.40599299520254134, Validation accuracy 0.8647977948188782
Epoch 29, Train loss 0.2817240038209341, Train accuracy 0.9031329900026321, Validation loss 0.4259554758667946, Validation accuracy 0.859765625
Epoch 30, Train loss 0.2734320399944078, Train accuracy 0.9075621447779916, Validation loss 0.4163320705294609, Validation accuracy 0.8624080896377564
Epoch 31, Train loss 0.26589519437402487, Train accuracy 0.9095561077648943, Validation loss 0.4153539314866066, Validation accuracy 0.8643841922283173
Epoch 32, Train loss 0.2624730554155328, Train accuracy 0.9101526987823573, Validation loss 0.40230802744627, Validation accuracy 0.8641429215669632
Epoch 33, Train loss 0.2596701373430816, Train accuracy 0.912339311093092, Validation loss 0.4082143321633339, Validation accuracy 0.8669462323188781
Epoch 34, Train loss 0.2527782753617926, Train accuracy 0.9152414771643552, Validation loss 0.4045023173093796, Validation accuracy 0.8682444840669632
Epoch 35, Train loss 0.24854994590648197, Train accuracy 0.9166139912876216, Validation loss 0.4024293258786201, Validation accuracy 0.8645335465669632
Epoch 36, Train loss 0.2450519889931787, Train accuracy 0.9161132811145349, Validation loss 0.45194874703884125, Validation accuracy 0.8535615801811218
Epoch 37, Train loss 0.24088318518955598, Train accuracy 0.9173650565472516, Validation loss 0.3951724126935005, Validation accuracy 0.8692440271377564
Validation accuracy increased from 0.87 to 0.87
Epoch 38, Train loss 0.23287739655510944, Train accuracy 0.9219185012308034, Validation loss 0.4057177692651749, Validation accuracy 0.8690257340669632
Epoch 39, Train loss 0.23180084133690054, Train accuracy 0.9211265979842707, Validation loss 0.42730690985918046, Validation accuracy 0.8603975176811218
Epoch 40, Train loss 0.20951898777010766, Train accuracy 0.9293279471722516, Validation loss 0.38085792362689974, Validation accuracy 0.8704618573188782
Validation accuracy increased from 0.87 to 0.87
Epoch 41, Train loss 0.20702107665552336, Train accuracy 0.9321750710633668, Validation loss 0.378576485812664, Validation accuracy 0.8716796875
Validation accuracy increased from 0.87 to 0.87
Epoch 42, Train loss 0.2031956079669974, Train accuracy 0.9333735795860941, Validation loss 0.3772568479180336, Validation accuracy 0.8739085465669632
Validation accuracy increased from 0.87 to 0.87
Epoch 43, Train loss 0.20117204183373938, Train accuracy 0.9326003193855286, Validation loss 0.3737552136182785, Validation accuracy 0.8741727948188782
Validation accuracy increased from 0.87 to 0.87
Epoch 44, Train loss 0.1997823671183803, Train accuracy 0.9343465908684514, Validation loss 0.389822793006897, Validation accuracy 0.8696346521377564
Epoch 45, Train loss 0.19499696977436543, Train accuracy 0.9355859373780814, Validation loss 0.3746742203831673, Validation accuracy 0.8753446698188782
Validation accuracy increased from 0.87 to 0.88
Epoch 46, Train loss 0.19482207751240244, Train accuracy 0.9360609017312527, Validation loss 0.37943305969238283, Validation accuracy 0.8747587323188781
Epoch 47, Train loss 0.19411292562091892, Train accuracy 0.9358212002976374, Validation loss 0.37875568121671677, Validation accuracy 0.8734949439764023
Epoch 48, Train loss 0.19215710808269001, Train accuracy 0.935688032684001, Validation loss 0.3773731142282486, Validation accuracy 0.8741268396377564
Epoch 49, Train loss 0.19170585884289307, Train accuracy 0.9356818182224577, Validation loss 0.3808737948536873, Validation accuracy 0.8754710465669632
Validation accuracy increased from 0.88 to 0.88
Epoch 50, Train loss 0.18909376529468733, Train accuracy 0.937738813798536, Validation loss 0.38141732662916183, Validation accuracy 0.8808938413858414
Validation accuracy increased from 0.88 to 0.88
Epoch 51, Train loss 0.18680735055187886, Train accuracy 0.9387792968614534, Validation loss 0.3802576497197151, Validation accuracy 0.8729779422283173
Epoch 52, Train loss 0.1863756773739376, Train accuracy 0.938218217343092, Validation loss 0.38223565369844437, Validation accuracy 0.8764476090669632
Epoch 53, Train loss 0.1832855559292842, Train accuracy 0.9401047585362737, Validation loss 0.3784984230995178, Validation accuracy 0.8737821698188781
Epoch 54, Train loss 0.18240402664311908, Train accuracy 0.9387127130546353, Validation loss 0.3808334395289421, Validation accuracy 0.8718290448188781
Epoch 55, Train loss 0.17969479771669616, Train accuracy 0.9422824928029017, Validation loss 0.38765469789505, Validation accuracy 0.8750574439764023
Epoch 56, Train loss 0.17947251260788602, Train accuracy 0.9403426846997305, Validation loss 0.3848979100584984, Validation accuracy 0.8747357547283172
Epoch 57, Train loss 0.17695402341302147, Train accuracy 0.942888849160888, Validation loss 0.37723937779664996, Validation accuracy 0.8778607547283173
Epoch 58, Train loss 0.1741957266984338, Train accuracy 0.9437571022320878, Validation loss 0.38186816945672036, Validation accuracy 0.8736098349094391
Epoch 59, Train loss 0.17371980858628044, Train accuracy 0.9428444599563425, Validation loss 0.3810718163847923, Validation accuracy 0.8748851090669632
Epoch 60, Train loss 0.167104382279583, Train accuracy 0.946176313879815, Validation loss 0.3737385496497154, Validation accuracy 0.8774701297283173
Epoch 61, Train loss 0.16649995524097572, Train accuracy 0.946654829450629, Validation loss 0.37511600703001025, Validation accuracy 0.8764935672283173
Epoch 62, Train loss 0.1667013502764431, Train accuracy 0.9454030540179122, Validation loss 0.3757240891456604, Validation accuracy 0.8764705896377564
Epoch 63, Train loss 0.1645995986393907, Train accuracy 0.9461194957521829, Validation loss 0.37385810911655426, Validation accuracy 0.8799632340669632
Epoch 64, Train loss 0.16435584506358614, Train accuracy 0.9455291191962633, Validation loss 0.37372553944587705, Validation accuracy 0.8772518396377563
Epoch 65, Train loss 0.1643445441838015, Train accuracy 0.9469442469152537, Validation loss 0.37641211450099943, Validation accuracy 0.8776194840669632
Epoch 66, Train loss 0.16459210458296267, Train accuracy 0.9468767754733562, Validation loss 0.3797645002603531, Validation accuracy 0.8761029422283173
Epoch 67, Train loss 0.16033637705682355, Train accuracy 0.9485413706438108, Validation loss 0.37966715544462204, Validation accuracy 0.8760799646377564
Epoch 68, Train loss 0.1641962855461646, Train accuracy 0.946772016923536, Validation loss 0.37714880853891375, Validation accuracy 0.8758846521377563
Epoch 69, Train loss 0.16155668064443904, Train accuracy 0.9477805397049948, Validation loss 0.3781815513968468, Validation accuracy 0.8754940271377564
Epoch 0, Train loss 1.476179760965434, Train accuracy 0.45865855806253175, Validation loss 1.3630625784397126, Validation accuracy 0.5211741715669632
Validation accuracy increased from 0.00 to 0.52
Epoch 1, Train loss 1.0049886314029044, Train accuracy 0.639939630573446, Validation loss 0.9514564752578736, Validation accuracy 0.6524126827716827
Validation accuracy increased from 0.52 to 0.65
Epoch 2, Train loss 0.7871145880357786, Train accuracy 0.7203631035306237, Validation loss 0.7839468479156494, Validation accuracy 0.7259650737047195
Validation accuracy increased from 0.65 to 0.73
Epoch 3, Train loss 0.6518473188308153, Train accuracy 0.7726287286389958, Validation loss 0.7362874478101731, Validation accuracy 0.7520450383424759
Validation accuracy increased from 0.73 to 0.75
Epoch 4, Train loss 0.5734150475737724, Train accuracy 0.7994744317098097, Validation loss 0.6208254188299179, Validation accuracy 0.7747587323188782
Validation accuracy increased from 0.75 to 0.77
Epoch 5, Train loss 0.5123861371116205, Train accuracy 0.8202485794370825, Validation loss 0.5562523379921913, Validation accuracy 0.8106043189764023
Validation accuracy increased from 0.77 to 0.81
Epoch 6, Train loss 0.4622757235033946, Train accuracy 0.8394060724160888, Validation loss 0.5999242901802063, Validation accuracy 0.8070886939764023
Epoch 7, Train loss 0.4228518271649426, Train accuracy 0.8513281250541861, Validation loss 0.6180461928248405, Validation accuracy 0.7983915448188782
Epoch 8, Train loss 0.38787320611829107, Train accuracy 0.8640296520157293, Validation loss 0.5002541914582253, Validation accuracy 0.8351217836141587
Validation accuracy increased from 0.81 to 0.84
Epoch 9, Train loss 0.3614472833208062, Train accuracy 0.8733451705087315, Validation loss 0.5262313157320022, Validation accuracy 0.8289177387952804
Epoch 10, Train loss 0.32990692352706735, Train accuracy 0.8851580254056237, Validation loss 0.4982461005449295, Validation accuracy 0.8351677387952805
Validation accuracy increased from 0.84 to 0.84
Epoch 11, Train loss 0.3111226838082075, Train accuracy 0.8909232955087315, Validation loss 0.4643835544586182, Validation accuracy 0.8495289534330368
Validation accuracy increased from 0.84 to 0.85
Epoch 12, Train loss 0.2866881440647624, Train accuracy 0.8979287997565486, Validation loss 0.47718259394168855, Validation accuracy 0.8486213237047195
Epoch 13, Train loss 0.2726846370338039, Train accuracy 0.9049174358898943, Validation loss 0.4402619361877441, Validation accuracy 0.8577665448188782
Validation accuracy increased from 0.85 to 0.86
Epoch 14, Train loss 0.25265485971150076, Train accuracy 0.911404474215074, Validation loss 0.48229681700468063, Validation accuracy 0.8492647051811218
Epoch 15, Train loss 0.23628927149217238, Train accuracy 0.9163734018802643, Validation loss 0.5605967670679093, Validation accuracy 0.8329503685235977
Epoch 16, Train loss 0.2226576651023193, Train accuracy 0.9224786931140856, Validation loss 0.4245728746056557, Validation accuracy 0.8652113974094391
Validation accuracy increased from 0.86 to 0.87
Epoch 17, Train loss 0.20841010075739838, Train accuracy 0.9268616830760782, Validation loss 0.4295555755496025, Validation accuracy 0.8701171875
Validation accuracy increased from 0.87 to 0.87
Epoch 18, Train loss 0.1934649029069326, Train accuracy 0.9318581318313425, Validation loss 0.4268114075064659, Validation accuracy 0.8668658077716828
Epoch 19, Train loss 0.18776687475937334, Train accuracy 0.9342072087932717, Validation loss 0.4831259846687317, Validation accuracy 0.8564338237047195
Epoch 20, Train loss 0.1183133918622678, Train accuracy 0.9600470523265275, Validation loss 0.3003306038677692, Validation accuracy 0.9054457724094391
Validation accuracy increased from 0.87 to 0.91
Epoch 21, Train loss 0.09897695553743026, Train accuracy 0.9672824926674366, Validation loss 0.30026633366942407, Validation accuracy 0.9056640625
Validation accuracy increased from 0.91 to 0.91
Epoch 22, Train loss 0.08844239531423558, Train accuracy 0.9710333804515275, Validation loss 0.3139366120100021, Validation accuracy 0.9050321698188781
Epoch 23, Train loss 0.08231188215061346, Train accuracy 0.9723401987417177, Validation loss 0.3172800727188587, Validation accuracy 0.9060087323188781
Validation accuracy increased from 0.91 to 0.91
Epoch 24, Train loss 0.07468919024210084, Train accuracy 0.9761416901918974, Validation loss 0.3144587464630604, Validation accuracy 0.9056870400905609
Epoch 25, Train loss 0.0741399746091867, Train accuracy 0.9751047583466227, Validation loss 0.3277281329035759, Validation accuracy 0.8980698525905609
Epoch 26, Train loss 0.0697441036304967, Train accuracy 0.9768323861062527, Validation loss 0.3395976684987545, Validation accuracy 0.904078584909439
Epoch 27, Train loss 0.063477946752259, Train accuracy 0.9792959869585254, Validation loss 0.32305425256490705, Validation accuracy 0.9059283077716828
Epoch 28, Train loss 0.059858710219321605, Train accuracy 0.980744850567796, Validation loss 0.331228643655777, Validation accuracy 0.9068359375
Validation accuracy increased from 0.91 to 0.91
Epoch 29, Train loss 0.05727047915570438, Train accuracy 0.9815917966718023, Validation loss 0.34247058182954787, Validation accuracy 0.9033203125
Epoch 30, Train loss 0.053846182619136845, Train accuracy 0.9824414060197093, Validation loss 0.3385117560625076, Validation accuracy 0.9027113974094391
Epoch 31, Train loss 0.05148795597382228, Train accuracy 0.9832182170992548, Validation loss 0.3216574490070343, Validation accuracy 0.90859375
Validation accuracy increased from 0.91 to 0.91
Epoch 32, Train loss 0.05026398848911578, Train accuracy 0.9836523434655233, Validation loss 0.32934395596385, Validation accuracy 0.9080307900905609
Epoch 33, Train loss 0.04703794360499491, Train accuracy 0.9851775565607981, Validation loss 0.33987213373184205, Validation accuracy 0.9028033077716827
Epoch 34, Train loss 0.04499302725095979, Train accuracy 0.9856658378107981, Validation loss 0.34933855980634687, Validation accuracy 0.9044232547283173
Epoch 35, Train loss 0.04332263553938405, Train accuracy 0.9866486147723414, Validation loss 0.33697606772184374, Validation accuracy 0.9079388797283172
Epoch 36, Train loss 0.04080320645483549, Train accuracy 0.9869087355380709, Validation loss 0.3409620724618435, Validation accuracy 0.9105238974094391
Validation accuracy increased from 0.91 to 0.91
Epoch 37, Train loss 0.03846180641134693, Train accuracy 0.9877867542884566, Validation loss 0.3523121178150177, Validation accuracy 0.9059857547283172
Epoch 38, Train loss 0.03608546845763075, Train accuracy 0.9887162640013478, Validation loss 0.35492267459630966, Validation accuracy 0.9097196698188782
Epoch 39, Train loss 0.03574756877920167, Train accuracy 0.9886905181814324, Validation loss 0.36665881276130674, Validation accuracy 0.9063763797283173
Epoch 40, Train loss 0.02578888995445926, Train accuracy 0.9922860437496142, Validation loss 0.3322535060346127, Validation accuracy 0.9103056073188782
Epoch 41, Train loss 0.021742248243588783, Train accuracy 0.9941787997430022, Validation loss 0.3339178182184696, Validation accuracy 0.9120863974094391
Validation accuracy increased from 0.91 to 0.91
Epoch 42, Train loss 0.020376912410773166, Train accuracy 0.9951615767045454, Validation loss 0.32612444683909414, Validation accuracy 0.9126953125
Validation accuracy increased from 0.91 to 0.91
Epoch 43, Train loss 0.019912375610808587, Train accuracy 0.9952059659090909, Validation loss 0.32685265243053435, Validation accuracy 0.9152918189764023
Validation accuracy increased from 0.91 to 0.92
Epoch 44, Train loss 0.018383323474236848, Train accuracy 0.9956942471590909, Validation loss 0.3302746884524822, Validation accuracy 0.9159007340669632
Validation accuracy increased from 0.92 to 0.92
Epoch 45, Train loss 0.01851001151953824, Train accuracy 0.9953391335227273, Validation loss 0.33247463703155516, Validation accuracy 0.9137752771377563
Epoch 46, Train loss 0.01766023420019668, Train accuracy 0.995361328125, Validation loss 0.3342613592743874, Validation accuracy 0.9160960465669632
Validation accuracy increased from 0.92 to 0.92
Epoch 47, Train loss 0.017192663566675037, Train accuracy 0.9957608309659091, Validation loss 0.33248540461063386, Validation accuracy 0.9143382340669632
Epoch 48, Train loss 0.01718591544671323, Train accuracy 0.9951837713068182, Validation loss 0.32751665860414503, Validation accuracy 0.9164866715669632
Validation accuracy increased from 0.92 to 0.92
Epoch 49, Train loss 0.016241812697527083, Train accuracy 0.9957546165043657, Validation loss 0.3295971632003784, Validation accuracy 0.9170496314764023
Validation accuracy increased from 0.92 to 0.92
Epoch 50, Train loss 0.01539228930910626, Train accuracy 0.9962491122159091, Validation loss 0.33018932268023493, Validation accuracy 0.9159237146377563
Epoch 51, Train loss 0.015475294222018088, Train accuracy 0.9965314275839112, Validation loss 0.3306275583803654, Validation accuracy 0.9157054215669632
Epoch 52, Train loss 0.015464848922089335, Train accuracy 0.9960813207382505, Validation loss 0.3334332436323166, Validation accuracy 0.9161649823188782
Epoch 53, Train loss 0.015292429981689731, Train accuracy 0.9960493607954546, Validation loss 0.3339536778628826, Validation accuracy 0.9129940271377563
Epoch 54, Train loss 0.01459421309250915, Train accuracy 0.9965154474431818, Validation loss 0.32678300216794015, Validation accuracy 0.9170726090669632
Validation accuracy increased from 0.92 to 0.92
Epoch 55, Train loss 0.01471222005255351, Train accuracy 0.9965571730651639, Validation loss 0.33274397626519203, Validation accuracy 0.9147058814764023
Epoch 56, Train loss 0.012758397521048953, Train accuracy 0.9971528764475476, Validation loss 0.3318494357168674, Validation accuracy 0.9159237146377563
Epoch 57, Train loss 0.013222322143106298, Train accuracy 0.9968705610795454, Validation loss 0.333483300358057, Validation accuracy 0.9164866715669632
Epoch 58, Train loss 0.012923367800381542, Train accuracy 0.9970197088339112, Validation loss 0.33529602363705635, Validation accuracy 0.9135799646377564
Epoch 59, Train loss 0.013148801725368354, Train accuracy 0.9965154474431818, Validation loss 0.3382186956703663, Validation accuracy 0.9132352948188782
Epoch 60, Train loss 0.011422858959783545, Train accuracy 0.9975363991477273, Validation loss 0.33514625281095506, Validation accuracy 0.9159237146377563
Epoch 61, Train loss 0.011775027490908873, Train accuracy 0.9971368963068182, Validation loss 0.33528550118207934, Validation accuracy 0.9141659021377564
Epoch 62, Train loss 0.010969828466345049, Train accuracy 0.9975363991477273, Validation loss 0.33367839455604553, Validation accuracy 0.9165096521377564
Epoch 63, Train loss 0.01059102746578653, Train accuracy 0.9976189630952749, Validation loss 0.3348131164908409, Validation accuracy 0.9178998172283173
Validation accuracy increased from 0.92 to 0.92
Epoch 64, Train loss 0.011326571870912712, Train accuracy 0.9973366477272727, Validation loss 0.3370799385011196, Validation accuracy 0.9137982547283172
Epoch 65, Train loss 0.01076165887537751, Train accuracy 0.9977139559659091, Validation loss 0.33302260637283326, Validation accuracy 0.9167279422283172
Epoch 66, Train loss 0.009687294373262293, Train accuracy 0.998173828152093, Validation loss 0.3343788467347622, Validation accuracy 0.9182674646377563
Validation accuracy increased from 0.92 to 0.92
Epoch 67, Train loss 0.009574864866656506, Train accuracy 0.9982404119589112, Validation loss 0.3364231429994106, Validation accuracy 0.9167279422283172
Epoch 68, Train loss 0.009794346281771803, Train accuracy 0.9979359019886364, Validation loss 0.3352980315685272, Validation accuracy 0.9176585465669632
Epoch 69, Train loss 0.010224656835568814, Train accuracy 0.9977583451704546, Validation loss 0.33568273708224294, Validation accuracy 0.9167049646377563
Epoch 0, Train loss 1.7860418910329992, Train accuracy 0.3447460936890407, Validation loss 1.645291656255722, Validation accuracy 0.39944852888584137
Validation accuracy increased from 0.00 to 0.40
Epoch 1, Train loss 1.4203048321333798, Train accuracy 0.4856924716044556, Validation loss 1.378934532403946, Validation accuracy 0.5028952211141586
Validation accuracy increased from 0.40 to 0.50
Epoch 2, Train loss 1.26155977899378, Train accuracy 0.5450106534090909, Validation loss 1.1902398705482482, Validation accuracy 0.5800321698188782
Validation accuracy increased from 0.50 to 0.58
Epoch 3, Train loss 1.153341369195418, Train accuracy 0.5862455608492548, Validation loss 1.0757178723812104, Validation accuracy 0.6222426474094391
Validation accuracy increased from 0.58 to 0.62
Epoch 4, Train loss 1.0753507102754982, Train accuracy 0.6167311790314588, Validation loss 1.1888972759246825, Validation accuracy 0.5923483461141587
Epoch 5, Train loss 1.008652700619264, Train accuracy 0.6401944245127115, Validation loss 1.1415996849536896, Validation accuracy 0.5954503685235977
Epoch 6, Train loss 0.9551792957566001, Train accuracy 0.6595090553164482, Validation loss 0.9957821369171143, Validation accuracy 0.6514361202716827
Validation accuracy increased from 0.62 to 0.65
Epoch 7, Train loss 0.9159317307851531, Train accuracy 0.6739293323321776, Validation loss 0.9496446520090103, Validation accuracy 0.6546875
Validation accuracy increased from 0.65 to 0.65
Epoch 8, Train loss 0.8799088478765704, Train accuracy 0.6859818890013478, Validation loss 0.8501853823661805, Validation accuracy 0.6981847435235977
Validation accuracy increased from 0.65 to 0.70
Epoch 9, Train loss 0.8421160009774294, Train accuracy 0.703987925906073, Validation loss 0.9207399070262909, Validation accuracy 0.6740004599094391
Epoch 10, Train loss 0.8075602975758639, Train accuracy 0.7160946377976374, Validation loss 0.8545178890228271, Validation accuracy 0.7043887883424759
Validation accuracy increased from 0.70 to 0.70
Epoch 11, Train loss 0.7832819457081232, Train accuracy 0.7243625707924366, Validation loss 0.8003829330205917, Validation accuracy 0.7099379599094391
Validation accuracy increased from 0.70 to 0.71
Epoch 12, Train loss 0.755774459039623, Train accuracy 0.7332350852137263, Validation loss 0.7246318191289902, Validation accuracy 0.7479779422283173
Validation accuracy increased from 0.71 to 0.75
Epoch 13, Train loss 0.7273672168905084, Train accuracy 0.7461230466988954, Validation loss 0.7779848456382752, Validation accuracy 0.7249425560235977
Epoch 14, Train loss 0.7036762542345307, Train accuracy 0.7538201348348097, Validation loss 0.8084671080112458, Validation accuracy 0.7169806987047196
Epoch 15, Train loss 0.6839802117848938, Train accuracy 0.7607581676407293, Validation loss 0.9569202601909638, Validation accuracy 0.6811121314764023
Epoch 16, Train loss 0.6636431325565685, Train accuracy 0.7682981179519133, Validation loss 0.6954056710004807, Validation accuracy 0.7560087323188782
Validation accuracy increased from 0.75 to 0.76
Epoch 17, Train loss 0.6460413810881701, Train accuracy 0.7727769884196195, Validation loss 0.6891002655029297, Validation accuracy 0.7598920047283173
Validation accuracy increased from 0.76 to 0.76
Epoch 18, Train loss 0.6227880340408195, Train accuracy 0.7841752483086153, Validation loss 0.6480483531951904, Validation accuracy 0.7704388797283173
Validation accuracy increased from 0.76 to 0.77
Epoch 19, Train loss 0.6094968215647069, Train accuracy 0.7884028763933615, Validation loss 0.7335844188928604, Validation accuracy 0.7456801474094391
Epoch 20, Train loss 0.5528456130149689, Train accuracy 0.8094699928029017, Validation loss 0.5624775916337967, Validation accuracy 0.8040670961141586
Validation accuracy increased from 0.77 to 0.80
Epoch 21, Train loss 0.5458227687261321, Train accuracy 0.8125932172618129, Validation loss 0.5585425183176994, Validation accuracy 0.8078010112047196
Validation accuracy increased from 0.80 to 0.81
Epoch 22, Train loss 0.5415195177563212, Train accuracy 0.8109002130275423, Validation loss 0.5793449103832244, Validation accuracy 0.7929457724094391
Epoch 23, Train loss 0.5329684650694783, Train accuracy 0.8176695667207241, Validation loss 0.554435096681118, Validation accuracy 0.8033777564764023
Epoch 24, Train loss 0.528663020581007, Train accuracy 0.816763139245185, Validation loss 0.571643216907978, Validation accuracy 0.8040900737047195
Epoch 25, Train loss 0.5191966422240842, Train accuracy 0.8206276632845402, Validation loss 0.5372940063476562, Validation accuracy 0.8137293189764023
Validation accuracy increased from 0.81 to 0.81
Epoch 26, Train loss 0.5190706608647649, Train accuracy 0.8175248578190804, Validation loss 0.5333476826548577, Validation accuracy 0.8119715064764023
Epoch 27, Train loss 0.512242875654589, Train accuracy 0.822391690178351, Validation loss 0.5311375886201859, Validation accuracy 0.8151999086141586
Validation accuracy increased from 0.81 to 0.82
Epoch 28, Train loss 0.5072170040485534, Train accuracy 0.825209517031908, Validation loss 0.5328655377030372, Validation accuracy 0.8142003685235977
Epoch 29, Train loss 0.5016453906216405, Train accuracy 0.826566051014445, Validation loss 0.5295845985412597, Validation accuracy 0.8185891538858414
Validation accuracy increased from 0.82 to 0.82
Epoch 30, Train loss 0.49313385564495216, Train accuracy 0.8286372514610941, Validation loss 0.5293286874890327, Validation accuracy 0.8161994487047195
Epoch 31, Train loss 0.4931797402148897, Train accuracy 0.8299564983357083, Validation loss 0.5486930564045907, Validation accuracy 0.8101907163858414
Epoch 32, Train loss 0.4889732363887809, Train accuracy 0.8312899500808932, Validation loss 0.54601421803236, Validation accuracy 0.8097081810235978
Epoch 33, Train loss 0.4845658803189343, Train accuracy 0.8331747156652537, Validation loss 0.5430548176169395, Validation accuracy 0.8073529422283172
Epoch 34, Train loss 0.47945961644026364, Train accuracy 0.8346706320616332, Validation loss 0.5283522993326187, Validation accuracy 0.8150735288858414
Epoch 35, Train loss 0.47066408209502697, Train accuracy 0.8367018821564588, Validation loss 0.5087641939520836, Validation accuracy 0.8199103862047196
Validation accuracy increased from 0.82 to 0.82
Epoch 36, Train loss 0.4703594656153159, Train accuracy 0.8383478336036205, Validation loss 0.5904419183731079, Validation accuracy 0.7981272965669632
Epoch 37, Train loss 0.47298739274794405, Train accuracy 0.8367151987146247, Validation loss 0.534078186750412, Validation accuracy 0.8182674646377563
Epoch 38, Train loss 0.4643271897326816, Train accuracy 0.839857954531908, Validation loss 0.5008451536297798, Validation accuracy 0.8248161762952805
Validation accuracy increased from 0.82 to 0.82
Epoch 39, Train loss 0.4582885607061061, Train accuracy 0.8414905894209038, Validation loss 0.48796406090259553, Validation accuracy 0.8310431987047195
Validation accuracy increased from 0.82 to 0.83
Epoch 40, Train loss 0.44043569368394936, Train accuracy 0.847914595156908, Validation loss 0.4787792667746544, Validation accuracy 0.8275965064764023
Epoch 41, Train loss 0.43855595436285844, Train accuracy 0.8478187143125318, Validation loss 0.47589498609304426, Validation accuracy 0.8332146137952805
Validation accuracy increased from 0.83 to 0.83
Epoch 42, Train loss 0.4340209615501491, Train accuracy 0.8523712713610042, Validation loss 0.478810778260231, Validation accuracy 0.8354894310235977
Validation accuracy increased from 0.83 to 0.84
Epoch 43, Train loss 0.43563561395488004, Train accuracy 0.8498979048295454, Validation loss 0.4789505362510681, Validation accuracy 0.8343405336141586
Epoch 44, Train loss 0.4304474917325107, Train accuracy 0.851318359375, Validation loss 0.4773895010352135, Validation accuracy 0.8329273909330368
Epoch 45, Train loss 0.4322554673999548, Train accuracy 0.8509028763933615, Validation loss 0.4832454025745392, Validation accuracy 0.8316521137952805
Epoch 46, Train loss 0.4266308512200009, Train accuracy 0.8526180752299048, Validation loss 0.47434946447610854, Validation accuracy 0.8349264711141586
Epoch 47, Train loss 0.4278361580588601, Train accuracy 0.8520516688850793, Validation loss 0.47623027116060257, Validation accuracy 0.8335822612047196
Epoch 48, Train loss 0.42899258129976015, Train accuracy 0.8538645241748203, Validation loss 0.4718472108244896, Validation accuracy 0.8353630512952804
Epoch 49, Train loss 0.42685202712362463, Train accuracy 0.852586114948446, Validation loss 0.47384088635444643, Validation accuracy 0.8326056987047196
Epoch 50, Train loss 0.42333322763442993, Train accuracy 0.8545880680057135, Validation loss 0.47353615164756774, Validation accuracy 0.8337545961141586
Epoch 51, Train loss 0.42191032641990617, Train accuracy 0.854622691531073, Validation loss 0.47418949007987976, Validation accuracy 0.8341222435235978
Epoch 52, Train loss 0.41956714100458403, Train accuracy 0.8565181107683615, Validation loss 0.472645577788353, Validation accuracy 0.8347541362047195
Epoch 53, Train loss 0.41760712692683394, Train accuracy 0.8558655892583457, Validation loss 0.4758665844798088, Validation accuracy 0.8339039534330368
Epoch 54, Train loss 0.4188654138283296, Train accuracy 0.8533993251621723, Validation loss 0.4702571019530296, Validation accuracy 0.8364889711141587
Validation accuracy increased from 0.84 to 0.84
Epoch 55, Train loss 0.41622292605990713, Train accuracy 0.857219459996982, Validation loss 0.4710253804922104, Validation accuracy 0.8334329038858413
Epoch 56, Train loss 0.4181851319630038, Train accuracy 0.8554882810197093, Validation loss 0.4656419768929482, Validation accuracy 0.8348805159330368
Epoch 57, Train loss 0.41336597773161804, Train accuracy 0.8567471588877115, Validation loss 0.48258270174264906, Validation accuracy 0.8318933814764022
Epoch 58, Train loss 0.4133156888525594, Train accuracy 0.857787641950629, Validation loss 0.47256709188222884, Validation accuracy 0.8337545961141586
Epoch 59, Train loss 0.4126720374280756, Train accuracy 0.858313209969889, Validation loss 0.4701680526137352, Validation accuracy 0.8364659935235977
Epoch 60, Train loss 0.40421605144034733, Train accuracy 0.8609170808710835, Validation loss 0.4639384031295776, Validation accuracy 0.8382467836141586
Validation accuracy increased from 0.84 to 0.84
Epoch 61, Train loss 0.4035428489812396, Train accuracy 0.8609978692098097, Validation loss 0.4611456379294395, Validation accuracy 0.8390739887952805
Validation accuracy increased from 0.84 to 0.84
Epoch 62, Train loss 0.40178064443171024, Train accuracy 0.8607421872968023, Validation loss 0.46404879838228225, Validation accuracy 0.8380284935235978
Epoch 63, Train loss 0.40407762778076256, Train accuracy 0.8617649146101691, Validation loss 0.46447543799877167, Validation accuracy 0.8388556987047195
Epoch 64, Train loss 0.39859382198615506, Train accuracy 0.8623748221857981, Validation loss 0.4667754054069519, Validation accuracy 0.8364889711141587
Epoch 65, Train loss 0.40021430226889526, Train accuracy 0.8606090196831659, Validation loss 0.46393138617277146, Validation accuracy 0.8380974262952805
Epoch 66, Train loss 0.40022662603719666, Train accuracy 0.862679332156073, Validation loss 0.45899254083633423, Validation accuracy 0.8395680159330368
Validation accuracy increased from 0.84 to 0.84
Epoch 67, Train loss 0.4013102860613303, Train accuracy 0.8623366477814588, Validation loss 0.46488562822341917, Validation accuracy 0.8390280336141587
Epoch 68, Train loss 0.4006702622229403, Train accuracy 0.8622425425459038, Validation loss 0.4596901938319206, Validation accuracy 0.8395680159330368
Validation accuracy increased from 0.84 to 0.84
Epoch 69, Train loss 0.4010641132904725, Train accuracy 0.8604154827242548, Validation loss 0.46133065670728685, Validation accuracy 0.8378331810235977
Epoch 0, Train loss 1.6102216250517152, Train accuracy 0.4019673295657743, Validation loss 1.3719671607017516, Validation accuracy 0.5033203125
Validation accuracy increased from 0.00 to 0.50
Epoch 1, Train loss 1.230641175400127, Train accuracy 0.55470614338463, Validation loss 1.2839353561401368, Validation accuracy 0.5282743573188782
Validation accuracy increased from 0.50 to 0.53
Epoch 2, Train loss 1.0554767244241454, Train accuracy 0.6188538707792759, Validation loss 1.0650439143180848, Validation accuracy 0.6216567099094391
Validation accuracy increased from 0.53 to 0.62
Epoch 3, Train loss 0.9442914534698833, Train accuracy 0.6644344814121723, Validation loss 1.0354040414094925, Validation accuracy 0.6307674646377563
Validation accuracy increased from 0.62 to 0.63
Epoch 4, Train loss 0.8523195650089871, Train accuracy 0.6995214843614534, Validation loss 0.8277036786079407, Validation accuracy 0.7061925560235978
Validation accuracy increased from 0.63 to 0.71
Epoch 5, Train loss 0.7842937010255727, Train accuracy 0.7238680750808932, Validation loss 0.923512926697731, Validation accuracy 0.6914636939764023
Epoch 6, Train loss 0.7225754934955727, Train accuracy 0.7454980466176163, Validation loss 0.8356058269739151, Validation accuracy 0.7133961409330368
Validation accuracy increased from 0.71 to 0.71
Epoch 7, Train loss 0.6649334647438743, Train accuracy 0.7660564631223679, Validation loss 0.7194384545087814, Validation accuracy 0.7464384198188782
Validation accuracy increased from 0.71 to 0.75
Epoch 8, Train loss 0.6210065390914679, Train accuracy 0.7815474075349894, Validation loss 0.6329869598150253, Validation accuracy 0.7786649823188782
Validation accuracy increased from 0.75 to 0.78
Epoch 9, Train loss 0.5829302648251707, Train accuracy 0.7944744317369028, Validation loss 0.7049124300479889, Validation accuracy 0.7603056073188782
Epoch 10, Train loss 0.5474317673255097, Train accuracy 0.8091024502434514, Validation loss 0.7966400980949402, Validation accuracy 0.734765625
Epoch 11, Train loss 0.5205920328470793, Train accuracy 0.8188964843072675, Validation loss 0.6759359270334244, Validation accuracy 0.7688534021377563
Epoch 12, Train loss 0.4932245673103766, Train accuracy 0.8263227980245244, Validation loss 0.624734778702259, Validation accuracy 0.7860868573188782
Validation accuracy increased from 0.78 to 0.79
Epoch 13, Train loss 0.4644150200553916, Train accuracy 0.835590376434001, Validation loss 0.6149079412221908, Validation accuracy 0.8013556987047196
Validation accuracy increased from 0.79 to 0.80
Epoch 14, Train loss 0.44598268988457596, Train accuracy 0.843538707291538, Validation loss 0.6326158329844475, Validation accuracy 0.7917279422283172
Epoch 15, Train loss 0.4224624840373343, Train accuracy 0.8522034798833457, Validation loss 0.5526108160614968, Validation accuracy 0.8177159935235977
Validation accuracy increased from 0.80 to 0.82
Epoch 16, Train loss 0.40317952988499944, Train accuracy 0.8597771660848097, Validation loss 0.5427949860692024, Validation accuracy 0.8193244487047195
Validation accuracy increased from 0.82 to 0.82
Epoch 17, Train loss 0.3822500664232807, Train accuracy 0.8674067824401639, Validation loss 0.6038707658648491, Validation accuracy 0.7991498172283172
Epoch 18, Train loss 0.36866298724304547, Train accuracy 0.8718022016639059, Validation loss 0.6194004237651825, Validation accuracy 0.8004825383424758
Epoch 19, Train loss 0.35154719853943045, Train accuracy 0.876600674607537, Validation loss 0.5213382929563523, Validation accuracy 0.8275735288858413
Validation accuracy increased from 0.82 to 0.83
Epoch 20, Train loss 0.27320107351988554, Train accuracy 0.9070729758929122, Validation loss 0.44226807057857515, Validation accuracy 0.8555147051811218
Validation accuracy increased from 0.83 to 0.86
Epoch 21, Train loss 0.2500201058150692, Train accuracy 0.9144442470913584, Validation loss 0.4395676523447037, Validation accuracy 0.8573414534330368
Validation accuracy increased from 0.86 to 0.86
Epoch 22, Train loss 0.2401531789113175, Train accuracy 0.918348721482537, Validation loss 0.41975382417440416, Validation accuracy 0.864039522409439
Validation accuracy increased from 0.86 to 0.86
Epoch 23, Train loss 0.23336682104590264, Train accuracy 0.9189914773133668, Validation loss 0.43588199764490126, Validation accuracy 0.8590303301811218
Epoch 24, Train loss 0.2236955716190013, Train accuracy 0.9226225140419874, Validation loss 0.45753614157438277, Validation accuracy 0.8518727034330368
Epoch 25, Train loss 0.21778511298312384, Train accuracy 0.9247682883658193, Validation loss 0.4572458639740944, Validation accuracy 0.8524586409330368
Epoch 26, Train loss 0.2030352313410152, Train accuracy 0.9305291192775423, Validation loss 0.5287660464644433, Validation accuracy 0.8372931987047195
Epoch 27, Train loss 0.19925423339009285, Train accuracy 0.9310360439121723, Validation loss 0.48527040928602216, Validation accuracy 0.850390625
Epoch 28, Train loss 0.19328606996515935, Train accuracy 0.9343341619453647, Validation loss 0.4579489216208458, Validation accuracy 0.8570427387952805
Epoch 29, Train loss 0.18802743862298402, Train accuracy 0.9355992542749102, Validation loss 0.4268947958946228, Validation accuracy 0.8642348349094391
Validation accuracy increased from 0.86 to 0.86
Epoch 30, Train loss 0.18123800032348794, Train accuracy 0.9376979758116332, Validation loss 0.4495114490389824, Validation accuracy 0.8606387883424759
Epoch 31, Train loss 0.17185293362391266, Train accuracy 0.9420223720371723, Validation loss 0.46984309554100034, Validation accuracy 0.8599264711141587
Epoch 32, Train loss 0.1644926190545613, Train accuracy 0.9439000355249102, Validation loss 0.46375255584716796, Validation accuracy 0.8567095577716828
Epoch 33, Train loss 0.16485060505907645, Train accuracy 0.9427237216044556, Validation loss 0.43564126193523406, Validation accuracy 0.8670611202716827
Validation accuracy increased from 0.86 to 0.87
Epoch 34, Train loss 0.15620027706873688, Train accuracy 0.9464080255817283, Validation loss 0.43627732396125796, Validation accuracy 0.8651079952716827
Epoch 35, Train loss 0.14997416798194702, Train accuracy 0.9487668678841807, Validation loss 0.5085691377520561, Validation accuracy 0.8487936586141587
Epoch 36, Train loss 0.14576118905097246, Train accuracy 0.9502565694803541, Validation loss 0.44356299936771393, Validation accuracy 0.8667394310235977
Epoch 37, Train loss 0.1422628753987903, Train accuracy 0.9520294744182717, Validation loss 0.5010674208402633, Validation accuracy 0.8559283077716827
Epoch 38, Train loss 0.1350198762322014, Train accuracy 0.954701704396443, Validation loss 0.5035596042871475, Validation accuracy 0.8539292275905609
Epoch 39, Train loss 0.1303898038935255, Train accuracy 0.9569975141097199, Validation loss 0.5398000583052636, Validation accuracy 0.8491153508424759
Epoch 40, Train loss 0.0997913636859845, Train accuracy 0.9687349074943499, Validation loss 0.41920638680458067, Validation accuracy 0.872828584909439
Validation accuracy increased from 0.87 to 0.87
Epoch 41, Train loss 0.09194983205419373, Train accuracy 0.9725079898807135, Validation loss 0.424116051197052, Validation accuracy 0.8753446698188782
Validation accuracy increased from 0.87 to 0.88
Epoch 42, Train loss 0.08721579243005677, Train accuracy 0.9745090553029017, Validation loss 0.42806426435709, Validation accuracy 0.8754365801811218
Validation accuracy increased from 0.88 to 0.88
Epoch 43, Train loss 0.08633971254510636, Train accuracy 0.9754980467259884, Validation loss 0.46031069606542585, Validation accuracy 0.8688189327716828
Epoch 44, Train loss 0.08048910421149974, Train accuracy 0.9767782315611839, Validation loss 0.42426796555519103, Validation accuracy 0.877734375
Validation accuracy increased from 0.88 to 0.88
Epoch 45, Train loss 0.08020168966190382, Train accuracy 0.9758398434655233, Validation loss 0.43149803578853607, Validation accuracy 0.8780560672283173
Validation accuracy increased from 0.88 to 0.88
Epoch 46, Train loss 0.07818155839446593, Train accuracy 0.9762775210494344, Validation loss 0.43592665046453477, Validation accuracy 0.8734145224094391
Epoch 47, Train loss 0.07613231870345771, Train accuracy 0.9776349430057135, Validation loss 0.4367594614624977, Validation accuracy 0.8746553301811218
Epoch 48, Train loss 0.07428086832673712, Train accuracy 0.9783611504191702, Validation loss 0.43266396820545194, Validation accuracy 0.8736557900905609
Epoch 49, Train loss 0.07134411613118243, Train accuracy 0.980139381844889, Validation loss 0.45536468029022215, Validation accuracy 0.8721162676811218
Epoch 50, Train loss 0.06903563721359453, Train accuracy 0.9800727980380709, Validation loss 0.426331090927124, Validation accuracy 0.88046875
Validation accuracy increased from 0.88 to 0.88
Epoch 51, Train loss 0.06810555410232734, Train accuracy 0.9804279116744344, Validation loss 0.4340718165040016, Validation accuracy 0.877711397409439
Epoch 52, Train loss 0.06649269623978232, Train accuracy 0.9819025211036205, Validation loss 0.46132082045078276, Validation accuracy 0.8719439327716827
Epoch 53, Train loss 0.0648402464999394, Train accuracy 0.9812464487146247, Validation loss 0.4385801702737808, Validation accuracy 0.8765854775905609
Epoch 54, Train loss 0.06307784942063419, Train accuracy 0.9822354401377115, Validation loss 0.44365488886833193, Validation accuracy 0.8762408077716828
Epoch 55, Train loss 0.05958840474274687, Train accuracy 0.9840305396779017, Validation loss 0.47257076352834704, Validation accuracy 0.8725298702716827
Epoch 56, Train loss 0.059065324370749295, Train accuracy 0.9837162640284408, Validation loss 0.4564780622720718, Validation accuracy 0.8751723349094391
Epoch 57, Train loss 0.0588717779610306, Train accuracy 0.9836017397994344, Validation loss 0.45728646367788317, Validation accuracy 0.8759995400905609
Epoch 58, Train loss 0.05871275340376252, Train accuracy 0.9840553975240751, Validation loss 0.45613888204097747, Validation accuracy 0.8718979775905609
Epoch 59, Train loss 0.056463671043853865, Train accuracy 0.9839062497697093, Validation loss 0.45649209469556806, Validation accuracy 0.8715533077716827
Epoch 60, Train loss 0.048937212453562424, Train accuracy 0.988196022469889, Validation loss 0.4345609188079834, Validation accuracy 0.8821576297283172
Validation accuracy increased from 0.88 to 0.88
Epoch 61, Train loss 0.04850397021933035, Train accuracy 0.9875142042609778, Validation loss 0.4325367294251919, Validation accuracy 0.8793428301811218
Epoch 62, Train loss 0.04682738332882185, Train accuracy 0.9884179684926163, Validation loss 0.43826168924570086, Validation accuracy 0.8787339150905609
Epoch 63, Train loss 0.04538203608667986, Train accuracy 0.9887473366477273, Validation loss 0.4424794167280197, Validation accuracy 0.880101102590561
Epoch 64, Train loss 0.04467708626973697, Train accuracy 0.9891850142316385, Validation loss 0.4367619022727013, Validation accuracy 0.8830078125
Validation accuracy increased from 0.88 to 0.88
Epoch 65, Train loss 0.04549158541274003, Train accuracy 0.9892675778405233, Validation loss 0.43606839030981065, Validation accuracy 0.8793198525905609
Epoch 66, Train loss 0.04488576989917254, Train accuracy 0.988890269601887, Validation loss 0.4354488417506218, Validation accuracy 0.8793428301811218
Epoch 67, Train loss 0.04465945027980276, Train accuracy 0.9895374642854388, Validation loss 0.4346627049148083, Validation accuracy 0.882594209909439
Epoch 68, Train loss 0.04342985520435667, Train accuracy 0.989660866219889, Validation loss 0.4415748119354248, Validation accuracy 0.8781709551811219
Epoch 69, Train loss 0.04280067012983967, Train accuracy 0.989876597781073, Validation loss 0.44413368701934813, Validation accuracy 0.8822265625
Epoch 0, Train loss 1.6278226788748393, Train accuracy 0.390396839346398, Validation loss 1.4973034858703613, Validation accuracy 0.44993106573820113
Validation accuracy increased from 0.00 to 0.45
Epoch 1, Train loss 1.2675113779577343, Train accuracy 0.5402281606061892, Validation loss 1.381238007545471, Validation accuracy 0.5044921875
Validation accuracy increased from 0.45 to 0.50
Epoch 2, Train loss 1.0920168672772972, Train accuracy 0.6066725850105286, Validation loss 1.151546335220337, Validation accuracy 0.582421875
Validation accuracy increased from 0.50 to 0.58
Epoch 3, Train loss 0.9681924754245714, Train accuracy 0.6544034091586416, Validation loss 0.985955485701561, Validation accuracy 0.6492417275905609
Validation accuracy increased from 0.58 to 0.65
Epoch 4, Train loss 0.8681663457642902, Train accuracy 0.6909570311280814, Validation loss 1.2717367172241212, Validation accuracy 0.5990004599094391
Epoch 5, Train loss 0.7878431525420059, Train accuracy 0.7222558591853488, Validation loss 0.828005713224411, Validation accuracy 0.7124080896377564
Validation accuracy increased from 0.65 to 0.71
Epoch 6, Train loss 0.7245840176262639, Train accuracy 0.7466610439799048, Validation loss 0.7166254073381424, Validation accuracy 0.7451861202716827
Validation accuracy increased from 0.71 to 0.75
Epoch 7, Train loss 0.6724613979458809, Train accuracy 0.7637801844288002, Validation loss 1.0342880576848983, Validation accuracy 0.6566980689764023
Epoch 8, Train loss 0.6286746468394995, Train accuracy 0.780155362053351, Validation loss 0.7190996915102005, Validation accuracy 0.7541819840669632
Validation accuracy increased from 0.75 to 0.75
Epoch 9, Train loss 0.5891881574961272, Train accuracy 0.7947780537334356, Validation loss 0.7295444130897522, Validation accuracy 0.7622012883424759
Validation accuracy increased from 0.75 to 0.76
Epoch 10, Train loss 0.5644867608154361, Train accuracy 0.8024946732277219, Validation loss 0.6400447815656662, Validation accuracy 0.7808823525905609
Validation accuracy increased from 0.76 to 0.78
Epoch 11, Train loss 0.5304907006634907, Train accuracy 0.8139160153540698, Validation loss 0.5851107254624367, Validation accuracy 0.80546875
Validation accuracy increased from 0.78 to 0.81
Epoch 12, Train loss 0.5073134135454893, Train accuracy 0.8227965198457241, Validation loss 0.6478019654750824, Validation accuracy 0.7842830896377564
Epoch 13, Train loss 0.4823940000073476, Train accuracy 0.8292986503378912, Validation loss 0.598971788585186, Validation accuracy 0.8037913590669632
Epoch 14, Train loss 0.46074699695137417, Train accuracy 0.8385644531385466, Validation loss 0.6510551035404205, Validation accuracy 0.7891659021377564
Epoch 15, Train loss 0.44772933643649926, Train accuracy 0.8432581675323573, Validation loss 0.5466385617852211, Validation accuracy 0.8201976090669632
Validation accuracy increased from 0.81 to 0.82
Epoch 16, Train loss 0.43000062233345077, Train accuracy 0.8507830253378912, Validation loss 0.5488773316144944, Validation accuracy 0.8214499086141587
Validation accuracy increased from 0.82 to 0.82
Epoch 17, Train loss 0.41388000530952757, Train accuracy 0.8556028052487157, Validation loss 0.5908085376024246, Validation accuracy 0.8030101090669632
Epoch 18, Train loss 0.3929674110629342, Train accuracy 0.8617551489309832, Validation loss 0.5235684245824814, Validation accuracy 0.8321691185235978
Validation accuracy increased from 0.82 to 0.83
Epoch 19, Train loss 0.3888668179173361, Train accuracy 0.86354403400963, Validation loss 0.45091875195503234, Validation accuracy 0.8528952211141586
Validation accuracy increased from 0.83 to 0.85
Epoch 20, Train loss 0.3160534253851934, Train accuracy 0.890751065178351, Validation loss 0.4205324649810791, Validation accuracy 0.8608570784330368
Validation accuracy increased from 0.85 to 0.86
Epoch 21, Train loss 0.30333746351640334, Train accuracy 0.8962970525026321, Validation loss 0.4237841948866844, Validation accuracy 0.8598805159330368
Epoch 22, Train loss 0.28892717070200225, Train accuracy 0.8995117186145349, Validation loss 0.4137816235423088, Validation accuracy 0.8587086409330368
Epoch 23, Train loss 0.28296777267347684, Train accuracy 0.901023614812981, Validation loss 0.4450944483280182, Validation accuracy 0.8589958637952805
Epoch 24, Train loss 0.2772119531238621, Train accuracy 0.9033229757439006, Validation loss 0.4259334340691566, Validation accuracy 0.8609834551811218
Validation accuracy increased from 0.86 to 0.86
Epoch 25, Train loss 0.26931203580038116, Train accuracy 0.9055388847535307, Validation loss 0.4459250971674919, Validation accuracy 0.8595818012952805
Epoch 26, Train loss 0.2636297040364959, Train accuracy 0.908103692937981, Validation loss 0.42574392110109327, Validation accuracy 0.8638327211141587
Validation accuracy increased from 0.86 to 0.86
Epoch 27, Train loss 0.2580542717636986, Train accuracy 0.9091663706031713, Validation loss 0.4304512217640877, Validation accuracy 0.8622012883424759
Epoch 28, Train loss 0.2542724831199104, Train accuracy 0.9108478335494344, Validation loss 0.45473596900701524, Validation accuracy 0.8519646137952804
Epoch 29, Train loss 0.24327164642851462, Train accuracy 0.9162047227675264, Validation loss 0.44058107286691667, Validation accuracy 0.8618106633424759
Epoch 30, Train loss 0.2391621574590152, Train accuracy 0.9158433946696195, Validation loss 0.42227481603622435, Validation accuracy 0.8647403508424759
Validation accuracy increased from 0.86 to 0.86
Epoch 31, Train loss 0.2339304987002503, Train accuracy 0.9183096591044556, Validation loss 0.45639176964759826, Validation accuracy 0.8578239887952804
Epoch 32, Train loss 0.23051605788482862, Train accuracy 0.9189444245262579, Validation loss 0.45375332683324815, Validation accuracy 0.8591681987047195
Epoch 33, Train loss 0.22511024747721173, Train accuracy 0.9205957031385466, Validation loss 0.4292091175913811, Validation accuracy 0.8651539534330368
Validation accuracy increased from 0.86 to 0.87
Epoch 34, Train loss 0.21713033572516657, Train accuracy 0.9246253550729968, Validation loss 0.4679784715175629, Validation accuracy 0.8548253685235977
Epoch 35, Train loss 0.22011281880126757, Train accuracy 0.9224067824808034, Validation loss 0.4554359927773476, Validation accuracy 0.8608341008424759
Epoch 36, Train loss 0.21195153824307703, Train accuracy 0.9263512072238055, Validation loss 0.4391362100839615, Validation accuracy 0.8658662676811218
Validation accuracy increased from 0.87 to 0.87
Epoch 37, Train loss 0.21168197818439116, Train accuracy 0.9259588068181818, Validation loss 0.4798757493495941, Validation accuracy 0.8530445784330368
Epoch 38, Train loss 0.20405392615463247, Train accuracy 0.9279865056953647, Validation loss 0.43440240919589995, Validation accuracy 0.8624195784330368
Epoch 39, Train loss 0.19753949674354357, Train accuracy 0.9299325282600793, Validation loss 0.42684085965156554, Validation accuracy 0.8676470577716827
Validation accuracy increased from 0.87 to 0.87
Epoch 40, Train loss 0.17761756674471227, Train accuracy 0.9384934302758087, Validation loss 0.4123592644929886, Validation accuracy 0.8700597435235977
Validation accuracy increased from 0.87 to 0.87
Epoch 41, Train loss 0.17045135973868045, Train accuracy 0.9415438564663584, Validation loss 0.40859623402357104, Validation accuracy 0.8738970577716827
Validation accuracy increased from 0.87 to 0.87
Epoch 42, Train loss 0.16602165061472493, Train accuracy 0.9424636008387263, Validation loss 0.4086409255862236, Validation accuracy 0.8741153508424759
Validation accuracy increased from 0.87 to 0.87
Epoch 43, Train loss 0.1637632598761808, Train accuracy 0.9427228336307135, Validation loss 0.41233654618263244, Validation accuracy 0.8746553301811218
Validation accuracy increased from 0.87 to 0.87
Epoch 44, Train loss 0.16265705828978258, Train accuracy 0.9446990412067283, Validation loss 0.41889385879039764, Validation accuracy 0.8741613060235978
Epoch 45, Train loss 0.15980628932910887, Train accuracy 0.9448881389742548, Validation loss 0.4265003353357315, Validation accuracy 0.8702780336141587
Epoch 46, Train loss 0.1581252679144117, Train accuracy 0.9463156959549948, Validation loss 0.4168213590979576, Validation accuracy 0.8750919133424759
Validation accuracy increased from 0.87 to 0.88
Epoch 47, Train loss 0.15530050025236877, Train accuracy 0.9472230114042759, Validation loss 0.4204172149300575, Validation accuracy 0.8769990801811218
Validation accuracy increased from 0.88 to 0.88
Epoch 48, Train loss 0.1553730144250122, Train accuracy 0.9456720524890856, Validation loss 0.41636003404855726, Validation accuracy 0.8729664534330368
Epoch 49, Train loss 0.15132336635989221, Train accuracy 0.9473996802487157, Validation loss 0.4147202387452126, Validation accuracy 0.8745059758424759
Epoch 50, Train loss 0.14763641624118795, Train accuracy 0.9495339132845402, Validation loss 0.4159360706806183, Validation accuracy 0.8752412676811219
Epoch 51, Train loss 0.14529552120207387, Train accuracy 0.9504216973754492, Validation loss 0.4216310799121857, Validation accuracy 0.8718405336141586
Epoch 52, Train loss 0.14554538298398256, Train accuracy 0.9498126774348996, Validation loss 0.4216570109128952, Validation accuracy 0.8751148909330368
Epoch 53, Train loss 0.1444076249714602, Train accuracy 0.9505486505275423, Validation loss 0.4338278815150261, Validation accuracy 0.8745289534330368
Epoch 54, Train loss 0.14255029695447197, Train accuracy 0.9508718038824472, Validation loss 0.43546977937221526, Validation accuracy 0.8723115801811219
Epoch 55, Train loss 0.1399610393934629, Train accuracy 0.9514968039637263, Validation loss 0.42991357296705246, Validation accuracy 0.8716452211141587
Epoch 56, Train loss 0.13683937731283632, Train accuracy 0.9535955255004492, Validation loss 0.4221858009696007, Validation accuracy 0.8764131426811218
Epoch 57, Train loss 0.139138967984102, Train accuracy 0.9509481533684514, Validation loss 0.428015823662281, Validation accuracy 0.8756318926811218
Epoch 58, Train loss 0.13762278816747395, Train accuracy 0.9529802910983562, Validation loss 0.44571077525615693, Validation accuracy 0.8698414534330368
Epoch 59, Train loss 0.13345675424418665, Train accuracy 0.9539950283413584, Validation loss 0.4401092067360878, Validation accuracy 0.8725988060235977
Epoch 60, Train loss 0.1263452573594722, Train accuracy 0.957270063798536, Validation loss 0.4258793115615845, Validation accuracy 0.8772403508424759
Validation accuracy increased from 0.88 to 0.88
Epoch 61, Train loss 0.12235742130062797, Train accuracy 0.9590518464418974, Validation loss 0.42666138261556624, Validation accuracy 0.8789522051811218
Validation accuracy increased from 0.88 to 0.88
Epoch 62, Train loss 0.12376099930737507, Train accuracy 0.9580877128649842, Validation loss 0.4245328187942505, Validation accuracy 0.8760684758424759
Epoch 63, Train loss 0.12084581067954953, Train accuracy 0.9585573507303541, Validation loss 0.4281095966696739, Validation accuracy 0.8762637883424759
Epoch 64, Train loss 0.12263871225613085, Train accuracy 0.957552379166538, Validation loss 0.4260724812746048, Validation accuracy 0.8784122258424759
Epoch 65, Train loss 0.11895112358880314, Train accuracy 0.9596732953055338, Validation loss 0.42720713913440705, Validation accuracy 0.8764361202716827
Epoch 66, Train loss 0.12261680970815095, Train accuracy 0.9591530537740751, Validation loss 0.432409243285656, Validation accuracy 0.8755055159330368
Epoch 67, Train loss 0.12092768963934346, Train accuracy 0.9596582031385466, Validation loss 0.42889021039009095, Validation accuracy 0.8747472435235977
Epoch 68, Train loss 0.11971735511906445, Train accuracy 0.9598987925459038, Validation loss 0.43303329199552537, Validation accuracy 0.8762178301811219
Epoch 69, Train loss 0.12021294644695114, Train accuracy 0.959584516896443, Validation loss 0.4297595039010048, Validation accuracy 0.8773897051811218
Test loss: 0.42016381621360777 Test accuracy: 0.86591796875  resnet10_AdaDelta_0.1
Test loss: 0.38926016353070736 Test accuracy: 0.908984375  resnet18_AdaDelta_0.1
Test loss: 0.4910932555794716 Test accuracy: 0.83515625  resnet12_AdaDelta_0.1
Test loss: 0.4880803644657135 Test accuracy: 0.8693359375  resnet14_4_AdaDelta_0.1
Test loss: 0.4782030276954174 Test accuracy: 0.8654296875  resnet14_5_AdaDelta_0.1
Epoch 0, Train loss 1.9368748922239651, Train accuracy 0.32164328833195294, Validation loss 1.5755958199501037, Validation accuracy 0.4447150737047195
Validation accuracy increased from 0.00 to 0.44
Epoch 1, Train loss 1.4256348738616162, Train accuracy 0.48252397013658826, Validation loss 1.3066640377044678, Validation accuracy 0.5210248172283173
Validation accuracy increased from 0.44 to 0.52
Epoch 2, Train loss 1.1687993444502354, Train accuracy 0.579702592370185, Validation loss 0.9601195275783538, Validation accuracy 0.6671530336141587
Validation accuracy increased from 0.52 to 0.67
Epoch 3, Train loss 0.9703098586337133, Train accuracy 0.6557288704947992, Validation loss 0.8957465440034866, Validation accuracy 0.6862247258424758
Validation accuracy increased from 0.67 to 0.69
Epoch 4, Train loss 0.8459590615873988, Train accuracy 0.6987881745127115, Validation loss 0.8061496496200562, Validation accuracy 0.7166015625
Validation accuracy increased from 0.69 to 0.72
Epoch 5, Train loss 0.7430952773852781, Train accuracy 0.7375976561822675, Validation loss 0.7668177485466003, Validation accuracy 0.739039522409439
Validation accuracy increased from 0.72 to 0.74
Epoch 6, Train loss 0.6653519743545488, Train accuracy 0.7645791901106184, Validation loss 0.7495120406150818, Validation accuracy 0.7348115801811218
Epoch 7, Train loss 0.5887631636790254, Train accuracy 0.793701171875, Validation loss 0.6591218799352646, Validation accuracy 0.7777228862047195
Validation accuracy increased from 0.74 to 0.78
Epoch 8, Train loss 0.5167365785349499, Train accuracy 0.8200124288824472, Validation loss 0.5744935616850853, Validation accuracy 0.8106617659330368
Validation accuracy increased from 0.78 to 0.81
Epoch 9, Train loss 0.47712836583906953, Train accuracy 0.8334055397320878, Validation loss 0.5187172770500184, Validation accuracy 0.8189338237047196
Validation accuracy increased from 0.81 to 0.82
Epoch 10, Train loss 0.43583352711390366, Train accuracy 0.8478302556005392, Validation loss 0.4660444393754005, Validation accuracy 0.8423023909330368
Validation accuracy increased from 0.82 to 0.84
Epoch 11, Train loss 0.39454048651863227, Train accuracy 0.8624227626079862, Validation loss 0.5293469876050949, Validation accuracy 0.8291934758424759
Epoch 12, Train loss 0.36551593904468144, Train accuracy 0.8717658025297251, Validation loss 0.42683680802583696, Validation accuracy 0.8565142452716827
Validation accuracy increased from 0.84 to 0.86
Epoch 13, Train loss 0.3392622394656593, Train accuracy 0.8808345168151639, Validation loss 0.4286675348877907, Validation accuracy 0.8574793189764023
Validation accuracy increased from 0.86 to 0.86
Epoch 14, Train loss 0.3127554710107771, Train accuracy 0.8897052556276321, Validation loss 0.4109819620847702, Validation accuracy 0.8674747258424759
Validation accuracy increased from 0.86 to 0.87
Epoch 15, Train loss 0.29180679038505664, Train accuracy 0.8965980112552643, Validation loss 0.45215784311294555, Validation accuracy 0.8571806073188781
Epoch 16, Train loss 0.26964347352358425, Train accuracy 0.9051713421940804, Validation loss 0.402675998210907, Validation accuracy 0.8687614887952805
Validation accuracy increased from 0.87 to 0.87
Epoch 17, Train loss 0.2566178761930628, Train accuracy 0.9109295098619028, Validation loss 0.500269415974617, Validation accuracy 0.8447495400905609
Epoch 18, Train loss 0.2378068195063282, Train accuracy 0.9156977981328964, Validation loss 0.4035019248723984, Validation accuracy 0.877171415090561
Validation accuracy increased from 0.87 to 0.88
Epoch 19, Train loss 0.22360374236648733, Train accuracy 0.9213503196158193, Validation loss 0.3694456309080124, Validation accuracy 0.886328125
Validation accuracy increased from 0.88 to 0.89
Epoch 20, Train loss 0.13856237551028078, Train accuracy 0.952768110754815, Validation loss 0.32584075927734374, Validation accuracy 0.9005629599094391
Validation accuracy increased from 0.89 to 0.90
Epoch 21, Train loss 0.11079425013370135, Train accuracy 0.9615092328326269, Validation loss 0.3082994192838669, Validation accuracy 0.90703125
Validation accuracy increased from 0.90 to 0.91
Epoch 22, Train loss 0.10157727757045491, Train accuracy 0.9644007455896247, Validation loss 0.3255005210638046, Validation accuracy 0.9063993573188782
Epoch 23, Train loss 0.09385109201750973, Train accuracy 0.9671147015284408, Validation loss 0.37022130340337756, Validation accuracy 0.8990234375
Epoch 24, Train loss 0.08568195411300455, Train accuracy 0.96973011337898, Validation loss 0.34232784882187844, Validation accuracy 0.9073988974094391
Validation accuracy increased from 0.91 to 0.91
Epoch 25, Train loss 0.08104491476181218, Train accuracy 0.9716770239174366, Validation loss 0.35070500820875167, Validation accuracy 0.903515625
Epoch 26, Train loss 0.07519860222766345, Train accuracy 0.9742489345371723, Validation loss 0.3540719136595726, Validation accuracy 0.9052274823188782
Epoch 27, Train loss 0.07345764876597306, Train accuracy 0.9743155183439905, Validation loss 0.3927106559276581, Validation accuracy 0.9012982547283173
Epoch 28, Train loss 0.06734765468122945, Train accuracy 0.9765509587119926, Validation loss 0.3829231932759285, Validation accuracy 0.9038832724094391
Epoch 29, Train loss 0.06541540250393817, Train accuracy 0.9766992184926163, Validation loss 0.37745447382330893, Validation accuracy 0.9052274823188782
Epoch 30, Train loss 0.0609264901352369, Train accuracy 0.9783167612146247, Validation loss 0.3915355697274208, Validation accuracy 0.9052045047283173
Epoch 31, Train loss 0.05980551944495263, Train accuracy 0.9788840551945296, Validation loss 0.3788553476333618, Validation accuracy 0.90625
Epoch 32, Train loss 0.05924940172752196, Train accuracy 0.9792613634331659, Validation loss 0.4181554488837719, Validation accuracy 0.9001493573188781
Epoch 33, Train loss 0.058004769337871534, Train accuracy 0.9800603691149842, Validation loss 0.39178149700164794, Validation accuracy 0.9053998172283173
Epoch 34, Train loss 0.053470855853943663, Train accuracy 0.9818705608221617, Validation loss 0.38915545046329497, Validation accuracy 0.9061580896377563
Epoch 35, Train loss 0.048212768663440576, Train accuracy 0.9831454188308932, Validation loss 0.4024204656481743, Validation accuracy 0.9083065271377564
Validation accuracy increased from 0.91 to 0.91
Epoch 36, Train loss 0.0472168516875668, Train accuracy 0.9830024855380709, Validation loss 0.4075335532426834, Validation accuracy 0.9095473349094391
Validation accuracy increased from 0.91 to 0.91
Epoch 37, Train loss 0.04890560408503833, Train accuracy 0.9828471233221617, Validation loss 0.41411900371313093, Validation accuracy 0.9059857547283172
Epoch 38, Train loss 0.04560137007766488, Train accuracy 0.9846635298295454, Validation loss 0.42537188082933425, Validation accuracy 0.9017348349094391
Epoch 39, Train loss 0.04113981935237958, Train accuracy 0.9856116832657293, Validation loss 0.43448332101106646, Validation accuracy 0.9060891538858413
Epoch 40, Train loss 0.026510822695193136, Train accuracy 0.9915980110791597, Validation loss 0.37652002424001696, Validation accuracy 0.9130399823188782
Validation accuracy increased from 0.91 to 0.91
Epoch 41, Train loss 0.019748520751653068, Train accuracy 0.9941850142045454, Validation loss 0.36998811140656473, Validation accuracy 0.9215877771377563
Validation accuracy increased from 0.91 to 0.92
Epoch 42, Train loss 0.016321997785284606, Train accuracy 0.9952947443181818, Validation loss 0.36846768856048584, Validation accuracy 0.9170955896377564
Epoch 43, Train loss 0.015693743819032203, Train accuracy 0.9953426844017073, Validation loss 0.3818680360913277, Validation accuracy 0.9167509198188781
Epoch 44, Train loss 0.015467836378692564, Train accuracy 0.995361328125, Validation loss 0.3712068542838097, Validation accuracy 0.9155330896377564
Epoch 45, Train loss 0.013286995862885802, Train accuracy 0.996008522469889, Validation loss 0.38057416006922723, Validation accuracy 0.9190487146377564
Epoch 46, Train loss 0.012719428871853532, Train accuracy 0.9961381392045454, Validation loss 0.3821279861032963, Validation accuracy 0.9192440271377563
Epoch 47, Train loss 0.011842003902446859, Train accuracy 0.9963316761634566, Validation loss 0.3988616466522217, Validation accuracy 0.9184627771377564
Epoch 48, Train loss 0.012099762285784394, Train accuracy 0.9958274147727273, Validation loss 0.4191541731357574, Validation accuracy 0.914820772409439
Epoch 49, Train loss 0.012137616051900708, Train accuracy 0.9959827769886364, Validation loss 0.4116548500955105, Validation accuracy 0.915234375
Epoch 50, Train loss 0.012335831229971849, Train accuracy 0.9958718039772727, Validation loss 0.4116342216730118, Validation accuracy 0.9168772965669632
Epoch 51, Train loss 0.011651651046122424, Train accuracy 0.9964710582386364, Validation loss 0.4126423180103302, Validation accuracy 0.9174632340669632
Epoch 52, Train loss 0.01005415366803804, Train accuracy 0.9971368963068182, Validation loss 0.4292731299996376, Validation accuracy 0.9143382340669632
Epoch 53, Train loss 0.011231465712295507, Train accuracy 0.9963920451700687, Validation loss 0.43163329660892485, Validation accuracy 0.9153837323188782
Epoch 54, Train loss 0.011784028447767592, Train accuracy 0.9962428977543657, Validation loss 0.41696413308382035, Validation accuracy 0.9157054215669632
Epoch 55, Train loss 0.010976116536767222, Train accuracy 0.9962428977543657, Validation loss 0.429204960167408, Validation accuracy 0.9147058814764023
Epoch 56, Train loss 0.010323032640206458, Train accuracy 0.9966264204545454, Validation loss 0.44848962873220444, Validation accuracy 0.9157284021377563
Epoch 57, Train loss 0.012559743150301405, Train accuracy 0.9958593747155233, Validation loss 0.443344934284687, Validation accuracy 0.9161420047283173
Epoch 58, Train loss 0.011562663926187352, Train accuracy 0.9962935014204546, Validation loss 0.4354099974036217, Validation accuracy 0.9172679215669632
Epoch 59, Train loss 0.011171908863947134, Train accuracy 0.9963822798295454, Validation loss 0.43182371407747266, Validation accuracy 0.9164866715669632
Epoch 60, Train loss 0.008240684199832189, Train accuracy 0.9974857954816385, Validation loss 0.41662793308496476, Validation accuracy 0.9209558814764023
Epoch 61, Train loss 0.006850385004575152, Train accuracy 0.9979678619314324, Validation loss 0.4155697777867317, Validation accuracy 0.9215418189764023
Epoch 62, Train loss 0.005917948450256848, Train accuracy 0.9981578480113636, Validation loss 0.4219411388039589, Validation accuracy 0.9201976090669632
Epoch 63, Train loss 0.005739355396310037, Train accuracy 0.9983575994318182, Validation loss 0.4194191932678223, Validation accuracy 0.9211741715669632
Epoch 64, Train loss 0.005023659394448094, Train accuracy 0.9985573508522727, Validation loss 0.42440836429595946, Validation accuracy 0.9213924646377564
Epoch 65, Train loss 0.004982639450893409, Train accuracy 0.9986399147998203, Validation loss 0.4149399191141129, Validation accuracy 0.9217601090669632
Validation accuracy increased from 0.92 to 0.92
Epoch 66, Train loss 0.004982272666728188, Train accuracy 0.9984463778409091, Validation loss 0.42333058565855025, Validation accuracy 0.9180721521377564
Epoch 67, Train loss 0.004236999169899553, Train accuracy 0.9989284446293657, Validation loss 0.4264273077249527, Validation accuracy 0.9196116715669632
Epoch 68, Train loss 0.004314995555680732, Train accuracy 0.9989568536931818, Validation loss 0.4254500702023506, Validation accuracy 0.9205882340669632
Epoch 69, Train loss 0.004139530519585771, Train accuracy 0.9988458806818182, Validation loss 0.4242770910263062, Validation accuracy 0.9202435672283172
Epoch 0, Train loss 1.9605936150659213, Train accuracy 0.29116832380267704, Validation loss 1.6477124750614167, Validation accuracy 0.3921070769429207
Validation accuracy increased from 0.00 to 0.39
Epoch 1, Train loss 1.4502550261941822, Train accuracy 0.4648011362349445, Validation loss 1.3623770773410797, Validation accuracy 0.5185891538858414
Validation accuracy increased from 0.39 to 0.52
Epoch 2, Train loss 1.1783729740841822, Train accuracy 0.5770179331302643, Validation loss 1.064102265238762, Validation accuracy 0.6237706810235977
Validation accuracy increased from 0.52 to 0.62
Epoch 3, Train loss 0.9764031794938174, Train accuracy 0.6521919386630709, Validation loss 0.8729092657566071, Validation accuracy 0.6946231633424759
Validation accuracy increased from 0.62 to 0.69
Epoch 4, Train loss 0.8365075242790309, Train accuracy 0.7011940696022727, Validation loss 0.7992149382829666, Validation accuracy 0.7252182900905609
Validation accuracy increased from 0.69 to 0.73
Epoch 5, Train loss 0.7305280522189357, Train accuracy 0.7450372867963531, Validation loss 0.7735237926244736, Validation accuracy 0.7368566185235977
Validation accuracy increased from 0.73 to 0.74
Epoch 6, Train loss 0.6277905851602554, Train accuracy 0.7804865054786205, Validation loss 0.5933404982089996, Validation accuracy 0.8002757340669632
Validation accuracy increased from 0.74 to 0.80
Epoch 7, Train loss 0.5605489765717224, Train accuracy 0.8033034445887263, Validation loss 0.5192037001252174, Validation accuracy 0.8251148909330368
Validation accuracy increased from 0.80 to 0.83
Epoch 8, Train loss 0.5020762348378246, Train accuracy 0.8243945312093605, Validation loss 0.5469021007418633, Validation accuracy 0.8087201297283173
Epoch 9, Train loss 0.4436234063045545, Train accuracy 0.8442702415314588, Validation loss 0.501702430844307, Validation accuracy 0.8360523909330368
Validation accuracy increased from 0.83 to 0.84
Epoch 10, Train loss 0.41109221073036845, Train accuracy 0.8573881391097199, Validation loss 0.4688407450914383, Validation accuracy 0.8461167275905609
Validation accuracy increased from 0.84 to 0.85
Epoch 11, Train loss 0.3760790099305185, Train accuracy 0.8672700639475476, Validation loss 0.45893786400556563, Validation accuracy 0.8443474262952805
Epoch 12, Train loss 0.3423231973905455, Train accuracy 0.879891690205444, Validation loss 0.4373787045478821, Validation accuracy 0.8565372258424759
Validation accuracy increased from 0.85 to 0.86
Epoch 13, Train loss 0.3223662284964865, Train accuracy 0.8870285864580761, Validation loss 0.4062400355935097, Validation accuracy 0.8651079952716827
Validation accuracy increased from 0.86 to 0.87
Epoch 14, Train loss 0.2920282329855995, Train accuracy 0.8973774855787103, Validation loss 0.36060523986816406, Validation accuracy 0.8775390625
Validation accuracy increased from 0.87 to 0.88
Epoch 15, Train loss 0.27175290984186257, Train accuracy 0.9065474075349894, Validation loss 0.3918719902634621, Validation accuracy 0.8731158077716827
Epoch 16, Train loss 0.2529377861964432, Train accuracy 0.9092436077242548, Validation loss 0.3997499242424965, Validation accuracy 0.8732421875
Epoch 17, Train loss 0.23637749305502934, Train accuracy 0.9168332740664482, Validation loss 0.4016730234026909, Validation accuracy 0.8736787676811218
Epoch 18, Train loss 0.21958344243466854, Train accuracy 0.9220605468885466, Validation loss 0.36690532192587855, Validation accuracy 0.8857192099094391
Validation accuracy increased from 0.88 to 0.89
Epoch 19, Train loss 0.20475677951154383, Train accuracy 0.9280468750406395, Validation loss 0.370431461930275, Validation accuracy 0.8869829952716828
Validation accuracy increased from 0.89 to 0.89
Epoch 20, Train loss 0.12069162684069439, Train accuracy 0.9576855467801745, Validation loss 0.28690728172659874, Validation accuracy 0.9124770224094391
Validation accuracy increased from 0.89 to 0.91
Epoch 21, Train loss 0.10027101640166207, Train accuracy 0.9647620736875318, Validation loss 0.30492758825421334, Validation accuracy 0.9127527564764023
Validation accuracy increased from 0.91 to 0.91
Epoch 22, Train loss 0.08569399697113443, Train accuracy 0.9699209870939905, Validation loss 0.31187243908643725, Validation accuracy 0.9145335465669632
Validation accuracy increased from 0.91 to 0.91
Epoch 23, Train loss 0.07648882033853707, Train accuracy 0.973421519791538, Validation loss 0.34280530661344527, Validation accuracy 0.9086971521377564
Epoch 24, Train loss 0.0733617799970406, Train accuracy 0.9749431816691702, Validation loss 0.36499298065900804, Validation accuracy 0.9066176474094391
Epoch 25, Train loss 0.06984540064480495, Train accuracy 0.9751615764742548, Validation loss 0.37760283052921295, Validation accuracy 0.9069852948188781
Epoch 26, Train loss 0.06421879252461209, Train accuracy 0.9771111505952749, Validation loss 0.350541103631258, Validation accuracy 0.9096966922283173
Epoch 27, Train loss 0.061607619779269124, Train accuracy 0.9778693179515275, Validation loss 0.39098926782608034, Validation accuracy 0.9062040448188782
Epoch 28, Train loss 0.05662670895584266, Train accuracy 0.9801677909087051, Validation loss 0.3793685853481293, Validation accuracy 0.9103515625
Epoch 29, Train loss 0.05884256174745546, Train accuracy 0.9791912284087051, Validation loss 0.3562961511313915, Validation accuracy 0.9155330896377564
Validation accuracy increased from 0.91 to 0.92
Epoch 30, Train loss 0.04913515610810877, Train accuracy 0.9831898080354388, Validation loss 0.3863606981933117, Validation accuracy 0.9095013797283172
Epoch 31, Train loss 0.04776186074278402, Train accuracy 0.9836115054786205, Validation loss 0.4109856620430946, Validation accuracy 0.9040096521377563
Epoch 32, Train loss 0.04785732711157338, Train accuracy 0.9831800423562527, Validation loss 0.3767873734235764, Validation accuracy 0.9147518396377563
Epoch 33, Train loss 0.04656604101182893, Train accuracy 0.9835759943181818, Validation loss 0.382485730946064, Validation accuracy 0.9110638797283173
Epoch 34, Train loss 0.04273391395426271, Train accuracy 0.98462269150398, Validation loss 0.42040541023015976, Validation accuracy 0.9076976090669632
Epoch 35, Train loss 0.04384721346220679, Train accuracy 0.9848162284628912, Validation loss 0.3925938680768013, Validation accuracy 0.9110179215669632
Epoch 36, Train loss 0.04546687328415415, Train accuracy 0.9847052554515275, Validation loss 0.4348752170801163, Validation accuracy 0.9083065271377564
Epoch 37, Train loss 0.04323110881325027, Train accuracy 0.984739878976887, Validation loss 0.402905835211277, Validation accuracy 0.9124080896377563
Epoch 38, Train loss 0.0371524639935656, Train accuracy 0.9866867895153436, Validation loss 0.4367796048521996, Validation accuracy 0.9111443012952805
Epoch 39, Train loss 0.03524846841041422, Train accuracy 0.9874698150564324, Validation loss 0.43456596285104754, Validation accuracy 0.9132123172283173
Epoch 40, Train loss 0.022049083518636922, Train accuracy 0.9928977272727273, Validation loss 0.4011387087404728, Validation accuracy 0.9190487146377564
Validation accuracy increased from 0.92 to 0.92
Epoch 41, Train loss 0.015017689749418589, Train accuracy 0.9950284090909091, Validation loss 0.39134211987257006, Validation accuracy 0.9221737146377563
Validation accuracy increased from 0.92 to 0.92
Epoch 42, Train loss 0.013439599564828148, Train accuracy 0.9959161931818182, Validation loss 0.39111417457461356, Validation accuracy 0.9251034021377563
Validation accuracy increased from 0.92 to 0.93
Epoch 43, Train loss 0.01226703216393203, Train accuracy 0.9958274147727273, Validation loss 0.4093347735702991, Validation accuracy 0.9209788590669632
Epoch 44, Train loss 0.010445820254972205, Train accuracy 0.9967977628111839, Validation loss 0.4180340901017189, Validation accuracy 0.9229779422283173
Epoch 45, Train loss 0.011291210237686755, Train accuracy 0.9961159446022727, Validation loss 0.41793090999126437, Validation accuracy 0.9233455896377564
Epoch 46, Train loss 0.010089632420038635, Train accuracy 0.9968643466180022, Validation loss 0.42820208296179774, Validation accuracy 0.9238625913858414
Epoch 47, Train loss 0.01023740625863535, Train accuracy 0.99682972275398, Validation loss 0.433321139216423, Validation accuracy 0.9219784021377564
Epoch 48, Train loss 0.010311705032191558, Train accuracy 0.9964364343746142, Validation loss 0.4398391082882881, Validation accuracy 0.9211741715669632
Epoch 49, Train loss 0.008814160371746932, Train accuracy 0.9970419034361839, Validation loss 0.43935559689998627, Validation accuracy 0.9238855689764023
Epoch 50, Train loss 0.009202638854979094, Train accuracy 0.9967817826704546, Validation loss 0.4389932736754417, Validation accuracy 0.9221737146377563
Epoch 51, Train loss 0.01069591417548178, Train accuracy 0.9962872869589112, Validation loss 0.47489128559827803, Validation accuracy 0.9203929215669632
Epoch 52, Train loss 0.009682199811570834, Train accuracy 0.9966264204545454, Validation loss 0.46442849561572075, Validation accuracy 0.9188534021377563
Epoch 53, Train loss 0.009234801630637694, Train accuracy 0.9968865412202749, Validation loss 0.46841723546385766, Validation accuracy 0.9205652564764023
Epoch 54, Train loss 0.009615659367971768, Train accuracy 0.9967755682089112, Validation loss 0.45530947372317315, Validation accuracy 0.9256204038858413
Validation accuracy increased from 0.93 to 0.93
Epoch 55, Train loss 0.009375940542833467, Train accuracy 0.9969593394886364, Validation loss 0.46536264270544053, Validation accuracy 0.9233226090669632
Epoch 56, Train loss 0.009195261233551057, Train accuracy 0.9969691048291597, Validation loss 0.47447251304984095, Validation accuracy 0.9233915448188782
Epoch 57, Train loss 0.009726505121348468, Train accuracy 0.9966708096590909, Validation loss 0.45365980714559556, Validation accuracy 0.9241038590669632
Epoch 58, Train loss 0.0077643737845805435, Train accuracy 0.9973970170725476, Validation loss 0.47399939596652985, Validation accuracy 0.9219554215669632
Epoch 59, Train loss 0.00733367654538597, Train accuracy 0.9973588423295454, Validation loss 0.46832614690065383, Validation accuracy 0.9252068012952804
Epoch 60, Train loss 0.006471745782536428, Train accuracy 0.9980690696022727, Validation loss 0.46492302417755127, Validation accuracy 0.9256204038858413
Validation accuracy increased from 0.93 to 0.93
Epoch 61, Train loss 0.0052550012682001, Train accuracy 0.9982022372159091, Validation loss 0.4609147846698761, Validation accuracy 0.9259880512952805
Validation accuracy increased from 0.93 to 0.93
Epoch 62, Train loss 0.004112531616390863, Train accuracy 0.9986017400568182, Validation loss 0.466697034239769, Validation accuracy 0.9260340064764023
Validation accuracy increased from 0.93 to 0.93
Epoch 63, Train loss 0.004954892671610816, Train accuracy 0.9985511363907293, Validation loss 0.46369149833917617, Validation accuracy 0.9252757340669632
Epoch 64, Train loss 0.003608558005081167, Train accuracy 0.9988236860795454, Validation loss 0.47503381967544556, Validation accuracy 0.9246668189764022
Epoch 65, Train loss 0.003674241473742189, Train accuracy 0.9988014914772727, Validation loss 0.4739741384983063, Validation accuracy 0.9248621314764023
Epoch 66, Train loss 0.0035997698193816837, Train accuracy 0.9988014914772727, Validation loss 0.47783218175172804, Validation accuracy 0.9256433814764022
Epoch 67, Train loss 0.0038355741557593733, Train accuracy 0.998662109402093, Validation loss 0.4778331398963928, Validation accuracy 0.9232996314764023
Epoch 68, Train loss 0.00419842944252609, Train accuracy 0.9985795454545454, Validation loss 0.49105255901813505, Validation accuracy 0.9232766538858413
Epoch 69, Train loss 0.003438433148816826, Train accuracy 0.9989604045721617, Validation loss 0.48683732748031616, Validation accuracy 0.9246668189764022
Epoch 0, Train loss 1.7246728478507563, Train accuracy 0.347799183123491, Validation loss 1.5682749807834626, Validation accuracy 0.4204848349094391
Validation accuracy increased from 0.00 to 0.42
Epoch 1, Train loss 1.2785627889362248, Train accuracy 0.530141157521443, Validation loss 1.2521353840827942, Validation accuracy 0.5469324439764023
Validation accuracy increased from 0.42 to 0.55
Epoch 2, Train loss 1.0490050373429602, Train accuracy 0.6226411576975476, Validation loss 1.2104353606700897, Validation accuracy 0.5762522965669632
Validation accuracy increased from 0.55 to 0.58
Epoch 3, Train loss 0.9056449651040814, Train accuracy 0.6773899146779017, Validation loss 1.3655521810054778, Validation accuracy 0.6008272051811219
Validation accuracy increased from 0.58 to 0.60
Epoch 4, Train loss 0.8010535392571579, Train accuracy 0.7162863991477273, Validation loss 0.8413143813610077, Validation accuracy 0.7155905336141586
Validation accuracy increased from 0.60 to 0.72
Epoch 5, Train loss 0.7197022011334245, Train accuracy 0.7470321377569978, Validation loss 0.822375375032425, Validation accuracy 0.7388442099094391
Validation accuracy increased from 0.72 to 0.74
Epoch 6, Train loss 0.6541596344587478, Train accuracy 0.7720827412876216, Validation loss 0.6931008875370026, Validation accuracy 0.7633846521377563
Validation accuracy increased from 0.74 to 0.76
Epoch 7, Train loss 0.6073213952847503, Train accuracy 0.7880273437635466, Validation loss 0.6731684923171997, Validation accuracy 0.7838465064764023
Validation accuracy increased from 0.76 to 0.78
Epoch 8, Train loss 0.5601132324134762, Train accuracy 0.806541192937981, Validation loss 0.6863238126039505, Validation accuracy 0.7737936586141586
Epoch 9, Train loss 0.5289891468869015, Train accuracy 0.8145330253649842, Validation loss 0.7066194415092468, Validation accuracy 0.7709903508424759
Epoch 10, Train loss 0.5093833981928501, Train accuracy 0.822856889190999, Validation loss 0.5502881467342376, Validation accuracy 0.8107077211141587
Validation accuracy increased from 0.78 to 0.81
Epoch 11, Train loss 0.4868186978115277, Train accuracy 0.8295143818990751, Validation loss 0.5747090622782707, Validation accuracy 0.8100068926811218
Epoch 12, Train loss 0.4639769574119286, Train accuracy 0.8376251774078066, Validation loss 0.5320361882448197, Validation accuracy 0.8225528508424759
Validation accuracy increased from 0.81 to 0.82
Epoch 13, Train loss 0.44570203430273314, Train accuracy 0.8451589132574472, Validation loss 0.5887763068079949, Validation accuracy 0.8105353862047195
Epoch 14, Train loss 0.42488002218306065, Train accuracy 0.8515003550459038, Validation loss 0.5009973078966141, Validation accuracy 0.8354204952716827
Validation accuracy increased from 0.82 to 0.84
Epoch 15, Train loss 0.410609133541584, Train accuracy 0.8569930751215328, Validation loss 0.46262971609830855, Validation accuracy 0.841796875
Validation accuracy increased from 0.84 to 0.84
Epoch 16, Train loss 0.4017356678166173, Train accuracy 0.8591024503111839, Validation loss 0.47233578115701674, Validation accuracy 0.8452780336141587
Validation accuracy increased from 0.84 to 0.85
Epoch 17, Train loss 0.3855964941057292, Train accuracy 0.8650417256761681, Validation loss 0.5209373071789741, Validation accuracy 0.8337545961141586
Epoch 18, Train loss 0.37428375672210346, Train accuracy 0.8681995736604388, Validation loss 0.4395267054438591, Validation accuracy 0.8544002771377563
Validation accuracy increased from 0.85 to 0.85
Epoch 19, Train loss 0.36266987449066207, Train accuracy 0.8731613988903436, Validation loss 0.47721132934093474, Validation accuracy 0.8472886025905609
Epoch 20, Train loss 0.2921073245392604, Train accuracy 0.8983318534764376, Validation loss 0.3686155125498772, Validation accuracy 0.8780790448188782
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.2722116050903093, Train accuracy 0.9061851918020032, Validation loss 0.3709699004888535, Validation accuracy 0.8813534021377564
Validation accuracy increased from 0.88 to 0.88
Epoch 22, Train loss 0.2610707276246764, Train accuracy 0.9092729047618129, Validation loss 0.36553792357444764, Validation accuracy 0.8856272965669632
Validation accuracy increased from 0.88 to 0.89
Epoch 23, Train loss 0.25935960916632955, Train accuracy 0.9090074571696195, Validation loss 0.3671620324254036, Validation accuracy 0.8806181073188781
Epoch 24, Train loss 0.2576826898889108, Train accuracy 0.909207208590074, Validation loss 0.38155322819948195, Validation accuracy 0.880641084909439
Epoch 25, Train loss 0.247028868814761, Train accuracy 0.9137064983898943, Validation loss 0.3770819142460823, Validation accuracy 0.8782743573188782
Epoch 26, Train loss 0.24784720451994377, Train accuracy 0.9131711646914482, Validation loss 0.36695949733257294, Validation accuracy 0.8818359375
Epoch 27, Train loss 0.24008547311479395, Train accuracy 0.916160333562981, Validation loss 0.36345867067575455, Validation accuracy 0.8838694840669632
Epoch 28, Train loss 0.2347057404165918, Train accuracy 0.9174254258925264, Validation loss 0.38395017981529234, Validation accuracy 0.8803768396377564
Epoch 29, Train loss 0.2321564986116507, Train accuracy 0.9185262783007189, Validation loss 0.3753157705068588, Validation accuracy 0.8838924646377564
Epoch 30, Train loss 0.22731569549068809, Train accuracy 0.9197274500673468, Validation loss 0.4236841455101967, Validation accuracy 0.8736328125
Epoch 31, Train loss 0.22429571055214514, Train accuracy 0.9199520596726374, Validation loss 0.37465031296014784, Validation accuracy 0.8831571698188782
Epoch 32, Train loss 0.22111412324011326, Train accuracy 0.9212402342395349, Validation loss 0.3707324668765068, Validation accuracy 0.8842141538858413
Epoch 33, Train loss 0.2148848409679803, Train accuracy 0.9246191406114534, Validation loss 0.40331824123859406, Validation accuracy 0.8773552387952804
Epoch 34, Train loss 0.21354712850668214, Train accuracy 0.9246360083872621, Validation loss 0.37933367788791655, Validation accuracy 0.8818359375
Epoch 35, Train loss 0.2087207721038298, Train accuracy 0.9259952059523626, Validation loss 0.3890656366944313, Validation accuracy 0.8828929215669632
Epoch 36, Train loss 0.2095380381427028, Train accuracy 0.925767045468092, Validation loss 0.38366649150848386, Validation accuracy 0.8814453125
Epoch 37, Train loss 0.20635737292468548, Train accuracy 0.9262526631355286, Validation loss 0.3988707631826401, Validation accuracy 0.8830078125
Epoch 38, Train loss 0.20068977002731778, Train accuracy 0.9278151633387263, Validation loss 0.37750178426504133, Validation accuracy 0.8866038590669632
Validation accuracy increased from 0.89 to 0.89
Epoch 39, Train loss 0.19832987342537803, Train accuracy 0.9285449216311629, Validation loss 0.38489933535456655, Validation accuracy 0.883984375
Epoch 40, Train loss 0.16661509007892825, Train accuracy 0.941176313906908, Validation loss 0.3597110755741596, Validation accuracy 0.8900160849094391
Validation accuracy increased from 0.89 to 0.89
Epoch 41, Train loss 0.16051964512602848, Train accuracy 0.9429998221722516, Validation loss 0.36149970814585686, Validation accuracy 0.8922909021377563
Validation accuracy increased from 0.89 to 0.89
Epoch 42, Train loss 0.16008509932593865, Train accuracy 0.9440926845100793, Validation loss 0.3515449553728104, Validation accuracy 0.8956571698188782
Validation accuracy increased from 0.89 to 0.90
Epoch 43, Train loss 0.15631168509240856, Train accuracy 0.9457226561551745, Validation loss 0.3634057007730007, Validation accuracy 0.8953699439764022
Epoch 44, Train loss 0.1545423354784196, Train accuracy 0.9463343393396247, Validation loss 0.3718829646706581, Validation accuracy 0.8878446698188782
Epoch 45, Train loss 0.15244877207177607, Train accuracy 0.946400923146443, Validation loss 0.3620883457362652, Validation accuracy 0.8906020224094391
Epoch 46, Train loss 0.14748414440757848, Train accuracy 0.9483194246210835, Validation loss 0.3713474594056606, Validation accuracy 0.892359834909439
Epoch 47, Train loss 0.14885606705634433, Train accuracy 0.9459952058439905, Validation loss 0.3789424479007721, Validation accuracy 0.8891429215669632
Epoch 48, Train loss 0.14927263693376022, Train accuracy 0.9477521306411787, Validation loss 0.3698073089122772, Validation accuracy 0.8935317099094391
Epoch 49, Train loss 0.1466792068782855, Train accuracy 0.9485449218614534, Validation loss 0.37118816524744036, Validation accuracy 0.8926815271377564
Epoch 50, Train loss 0.14131525095382874, Train accuracy 0.9500390623103488, Validation loss 0.3688101559877396, Validation accuracy 0.8956112146377564
Epoch 51, Train loss 0.14300895943729716, Train accuracy 0.9496732953597199, Validation loss 0.37617513090372084, Validation accuracy 0.8959788590669632
Validation accuracy increased from 0.90 to 0.90
Epoch 52, Train loss 0.14032648579979484, Train accuracy 0.9484082030301745, Validation loss 0.3775710679590702, Validation accuracy 0.8927504599094391
Epoch 53, Train loss 0.13959680738943545, Train accuracy 0.951072442937981, Validation loss 0.37708120718598365, Validation accuracy 0.8916015625
Epoch 54, Train loss 0.13736108914864334, Train accuracy 0.9500310722399842, Validation loss 0.379233618080616, Validation accuracy 0.8940946698188782
Epoch 55, Train loss 0.13636657350103965, Train accuracy 0.9510786573995244, Validation loss 0.385953189432621, Validation accuracy 0.8933134198188781
Epoch 56, Train loss 0.13549332375722853, Train accuracy 0.9509579190476374, Validation loss 0.383309930562973, Validation accuracy 0.8942899823188781
Epoch 57, Train loss 0.13446266614747318, Train accuracy 0.9525648081167177, Validation loss 0.399451370537281, Validation accuracy 0.8890165448188782
Epoch 58, Train loss 0.12990976950492372, Train accuracy 0.9540580609305338, Validation loss 0.4004706934094429, Validation accuracy 0.888453584909439
Epoch 59, Train loss 0.13211566861718893, Train accuracy 0.9530504261228171, Validation loss 0.3996130257844925, Validation accuracy 0.8917279422283173
Epoch 60, Train loss 0.12340040204369208, Train accuracy 0.9562908380546353, Validation loss 0.3785998962819576, Validation accuracy 0.8943359375
Epoch 61, Train loss 0.11881037858653475, Train accuracy 0.9583034444261681, Validation loss 0.3878910131752491, Validation accuracy 0.8952205896377563
Epoch 62, Train loss 0.12082403616725722, Train accuracy 0.9570294743911787, Validation loss 0.3864461652934551, Validation accuracy 0.8963924646377563
Validation accuracy increased from 0.90 to 0.90
Epoch 63, Train loss 0.11864310994066975, Train accuracy 0.9573908024890856, Validation loss 0.38906105756759646, Validation accuracy 0.8944852948188782
Epoch 64, Train loss 0.11602195216850801, Train accuracy 0.9588148082521829, Validation loss 0.38959947749972346, Validation accuracy 0.8968060672283172
Validation accuracy increased from 0.90 to 0.90
Epoch 65, Train loss 0.11864225509237837, Train accuracy 0.9581827057356184, Validation loss 0.38260277211666105, Validation accuracy 0.8994715064764023
Validation accuracy increased from 0.90 to 0.90
Epoch 66, Train loss 0.11526130958968266, Train accuracy 0.9586940695616332, Validation loss 0.3877044811844826, Validation accuracy 0.8934857547283173
Epoch 67, Train loss 0.11700534215196967, Train accuracy 0.9584685723212633, Validation loss 0.3926077149808407, Validation accuracy 0.8954388797283173
Epoch 68, Train loss 0.11477575457485562, Train accuracy 0.9583664770153436, Validation loss 0.3873961217701435, Validation accuracy 0.8940946698188782
Epoch 69, Train loss 0.11206402650780299, Train accuracy 0.9606685011901639, Validation loss 0.38910472840070726, Validation accuracy 0.8958524823188782
Epoch 0, Train loss 1.9723900712349198, Train accuracy 0.2769096234644001, Validation loss 1.7542463779449462, Validation accuracy 0.33343290388584135
Validation accuracy increased from 0.00 to 0.33
Epoch 1, Train loss 1.5299104242162271, Train accuracy 0.42623224431140855, Validation loss 1.2929589569568634, Validation accuracy 0.5171070769429207
Validation accuracy increased from 0.33 to 0.52
Epoch 2, Train loss 1.246307790956714, Train accuracy 0.5463751774619926, Validation loss 1.3669201493263246, Validation accuracy 0.5394875913858413
Validation accuracy increased from 0.52 to 0.54
Epoch 3, Train loss 1.0223133154213428, Train accuracy 0.6352716619995508, Validation loss 0.987512519955635, Validation accuracy 0.6493566185235977
Validation accuracy increased from 0.54 to 0.65
Epoch 4, Train loss 0.86133317344568, Train accuracy 0.6962579898536205, Validation loss 0.8831621825695037, Validation accuracy 0.6898897051811218
Validation accuracy increased from 0.65 to 0.69
Epoch 5, Train loss 0.7368718927556818, Train accuracy 0.739867720075629, Validation loss 0.6860892474651337, Validation accuracy 0.7703584551811218
Validation accuracy increased from 0.69 to 0.77
Epoch 6, Train loss 0.6439506577497179, Train accuracy 0.7746466618369926, Validation loss 0.7116006851196289, Validation accuracy 0.7514131426811218
Epoch 7, Train loss 0.5716402882879431, Train accuracy 0.7999937852675264, Validation loss 0.5658707708120346, Validation accuracy 0.8036764711141586
Validation accuracy increased from 0.77 to 0.80
Epoch 8, Train loss 0.5215467688712206, Train accuracy 0.8166388493369926, Validation loss 0.5351543337106704, Validation accuracy 0.8212086409330368
Validation accuracy increased from 0.80 to 0.82
Epoch 9, Train loss 0.4743200408464128, Train accuracy 0.8348694955083457, Validation loss 0.4974474966526031, Validation accuracy 0.8298943012952804
Validation accuracy increased from 0.82 to 0.83
Epoch 10, Train loss 0.4399159957062114, Train accuracy 0.8463751775297251, Validation loss 0.5031798481941223, Validation accuracy 0.8311925560235978
Validation accuracy increased from 0.83 to 0.83
Epoch 11, Train loss 0.40856769105250185, Train accuracy 0.8569051846861839, Validation loss 0.5198553755879403, Validation accuracy 0.8267693012952805
Epoch 12, Train loss 0.377859525043856, Train accuracy 0.8677272725511681, Validation loss 0.4905648097395897, Validation accuracy 0.8370289534330368
Validation accuracy increased from 0.83 to 0.84
Epoch 13, Train loss 0.346994976174425, Train accuracy 0.8787029473619028, Validation loss 0.5065932542085647, Validation accuracy 0.8383501827716827
Validation accuracy increased from 0.84 to 0.84
Epoch 14, Train loss 0.3314313886009834, Train accuracy 0.8866042257709936, Validation loss 0.44673212617635727, Validation accuracy 0.8470358461141586
Validation accuracy increased from 0.84 to 0.85
Epoch 15, Train loss 0.30067205462943425, Train accuracy 0.8955042612823573, Validation loss 0.43318845331668854, Validation accuracy 0.8624195784330368
Validation accuracy increased from 0.85 to 0.86
Epoch 16, Train loss 0.2848814742808992, Train accuracy 0.8992649147456343, Validation loss 0.49954584389925005, Validation accuracy 0.8467256426811218
Epoch 17, Train loss 0.2626507841050625, Train accuracy 0.9072061435065486, Validation loss 0.43275715708732604, Validation accuracy 0.8735638797283173
Validation accuracy increased from 0.86 to 0.87
Epoch 18, Train loss 0.2510127542032437, Train accuracy 0.9116308594291861, Validation loss 0.43390247970819473, Validation accuracy 0.8712201297283173
Epoch 19, Train loss 0.23217824600975623, Train accuracy 0.9176029827107083, Validation loss 0.41881401687860487, Validation accuracy 0.8721852034330368
Epoch 20, Train loss 0.14442810907282613, Train accuracy 0.9488139203326269, Validation loss 0.3319577075541019, Validation accuracy 0.9020335465669632
Validation accuracy increased from 0.87 to 0.90
Epoch 21, Train loss 0.11458535363305021, Train accuracy 0.9600390622561629, Validation loss 0.37420405969023707, Validation accuracy 0.8974149823188782
Epoch 22, Train loss 0.10224748811345886, Train accuracy 0.9641157669777219, Validation loss 0.3975194595754147, Validation accuracy 0.8915785849094391
Epoch 23, Train loss 0.08735514444891702, Train accuracy 0.9694229401648045, Validation loss 0.3897063657641411, Validation accuracy 0.893336397409439
Epoch 24, Train loss 0.08304104230112651, Train accuracy 0.9707137783142653, Validation loss 0.3964982233941555, Validation accuracy 0.8990808814764023
Epoch 25, Train loss 0.0783174185463312, Train accuracy 0.9715349785983562, Validation loss 0.4397711269557476, Validation accuracy 0.8923828125
Epoch 26, Train loss 0.07303748696788469, Train accuracy 0.9733540480109778, Validation loss 0.43599571734666825, Validation accuracy 0.8979779422283173
Epoch 27, Train loss 0.06949982068247416, Train accuracy 0.9754909446293657, Validation loss 0.4231320858001709, Validation accuracy 0.8950712323188782
Epoch 28, Train loss 0.06203978261063722, Train accuracy 0.9781835936009884, Validation loss 0.4216404236853123, Validation accuracy 0.9009535849094391
Epoch 29, Train loss 0.05656382143074139, Train accuracy 0.9798064628107981, Validation loss 0.4407044678926468, Validation accuracy 0.9047909021377564
Validation accuracy increased from 0.90 to 0.90
Epoch 30, Train loss 0.05755214696877043, Train accuracy 0.9807324216447093, Validation loss 0.4431918621063232, Validation accuracy 0.9014935672283173
Epoch 31, Train loss 0.05227971145756204, Train accuracy 0.9819211644882505, Validation loss 0.47313871383666994, Validation accuracy 0.8989315271377564
Epoch 32, Train loss 0.04803086764877662, Train accuracy 0.983069069344889, Validation loss 0.47235689163208006, Validation accuracy 0.9022288590669632
Epoch 33, Train loss 0.05276810605375266, Train accuracy 0.9818927554244344, Validation loss 0.4829137668013573, Validation accuracy 0.8990349262952805
Epoch 34, Train loss 0.04566985925934701, Train accuracy 0.9844992895695296, Validation loss 0.48750084936618804, Validation accuracy 0.8947610288858414
Epoch 35, Train loss 0.0445288403742862, Train accuracy 0.9846670807085254, Validation loss 0.477904862165451, Validation accuracy 0.8989085465669632
Epoch 36, Train loss 0.039905470081562686, Train accuracy 0.9856658378107981, Validation loss 0.4971947088837624, Validation accuracy 0.8999540448188782
Epoch 37, Train loss 0.041312779096188024, Train accuracy 0.98535511337898, Validation loss 0.5041413128376007, Validation accuracy 0.9000229775905609
Epoch 38, Train loss 0.04029102458364584, Train accuracy 0.9867817823859778, Validation loss 0.467095747590065, Validation accuracy 0.9016659021377563
Epoch 39, Train loss 0.036385722376342695, Train accuracy 0.9874378551136364, Validation loss 0.5150637328624725, Validation accuracy 0.8960707724094391
Epoch 40, Train loss 0.02242305484039455, Train accuracy 0.9928311434659091, Validation loss 0.466544371843338, Validation accuracy 0.9078929215669632
Validation accuracy increased from 0.90 to 0.91
Epoch 41, Train loss 0.015166492947504263, Train accuracy 0.9953391335227273, Validation loss 0.46886016279459, Validation accuracy 0.9084788590669632
Validation accuracy increased from 0.91 to 0.91
Epoch 42, Train loss 0.01471628646355715, Train accuracy 0.995237925851887, Validation loss 0.4827374815940857, Validation accuracy 0.9106272965669632
Validation accuracy increased from 0.91 to 0.91
Epoch 43, Train loss 0.011562921221907758, Train accuracy 0.9961763139475476, Validation loss 0.48965984731912615, Validation accuracy 0.9088694840669632
Epoch 44, Train loss 0.012174592244264204, Train accuracy 0.9959827769886364, Validation loss 0.5068214014172554, Validation accuracy 0.9081112146377563
Epoch 45, Train loss 0.010308905983534218, Train accuracy 0.9965917965905233, Validation loss 0.4957800656557083, Validation accuracy 0.9094784021377563
Epoch 46, Train loss 0.011067068136154294, Train accuracy 0.9963822798295454, Validation loss 0.5182773917913437, Validation accuracy 0.9091107547283173
Epoch 47, Train loss 0.01032592367118923, Train accuracy 0.9964932528409091, Validation loss 0.5085256457328796, Validation accuracy 0.9092371314764023
Epoch 48, Train loss 0.010505422601867891, Train accuracy 0.9965536221861839, Validation loss 0.5244347706437111, Validation accuracy 0.9063993573188782
Epoch 49, Train loss 0.00972918592478064, Train accuracy 0.9969975142316385, Validation loss 0.526664137840271, Validation accuracy 0.9115808814764023
Validation accuracy increased from 0.91 to 0.91
Epoch 50, Train loss 0.010027678260733162, Train accuracy 0.9966521659357981, Validation loss 0.5449729904532432, Validation accuracy 0.9100643396377563
Epoch 51, Train loss 0.009878569063651164, Train accuracy 0.9970037286931818, Validation loss 0.5412459880113601, Validation accuracy 0.9106272965669632
Epoch 52, Train loss 0.00963891633397328, Train accuracy 0.9966202059930022, Validation loss 0.54742172062397, Validation accuracy 0.9109949439764022
Epoch 53, Train loss 0.009146376992000362, Train accuracy 0.9969815340909091, Validation loss 0.5416853308677674, Validation accuracy 0.9102366715669632
Epoch 54, Train loss 0.009634440251168351, Train accuracy 0.996826171875, Validation loss 0.5622936651110649, Validation accuracy 0.9073299646377564
Epoch 55, Train loss 0.01051539327123795, Train accuracy 0.996826171875, Validation loss 0.5654251933097839, Validation accuracy 0.9086052387952804
Epoch 56, Train loss 0.008482775744844483, Train accuracy 0.9971368963068182, Validation loss 0.5546102344989776, Validation accuracy 0.9109949439764022
Epoch 57, Train loss 0.00913964418412599, Train accuracy 0.996826171875, Validation loss 0.5617903634905815, Validation accuracy 0.9092371314764023
Epoch 58, Train loss 0.00917860020325117, Train accuracy 0.9967249642041597, Validation loss 0.5623375475406647, Validation accuracy 0.9071116715669632
Epoch 59, Train loss 0.008887753069343902, Train accuracy 0.9970259232954546, Validation loss 0.5990727707743645, Validation accuracy 0.9073759198188782
Epoch 60, Train loss 0.006407094803018315, Train accuracy 0.9979740767316385, Validation loss 0.56411122828722, Validation accuracy 0.9114315271377563
Epoch 61, Train loss 0.005375759163474537, Train accuracy 0.9983797940340909, Validation loss 0.5615920931100845, Validation accuracy 0.9131204038858414
Validation accuracy increased from 0.91 to 0.91
Epoch 62, Train loss 0.004559339604880238, Train accuracy 0.9985733309930022, Validation loss 0.5678962677717209, Validation accuracy 0.9146599262952805
Validation accuracy increased from 0.91 to 0.91
Epoch 63, Train loss 0.0040527429165112235, Train accuracy 0.9987127130681818, Validation loss 0.5758861482143403, Validation accuracy 0.9106502771377564
Epoch 64, Train loss 0.004332434224331585, Train accuracy 0.9987349076704546, Validation loss 0.5728184148669243, Validation accuracy 0.9116498172283173
Epoch 65, Train loss 0.004109473635914831, Train accuracy 0.9987571022727273, Validation loss 0.5695231169462204, Validation accuracy 0.9112591922283173
Epoch 66, Train loss 0.0043846297913577555, Train accuracy 0.99853515625, Validation loss 0.5663812309503555, Validation accuracy 0.9131433814764023
Epoch 67, Train loss 0.004004887848457822, Train accuracy 0.9986683238636364, Validation loss 0.5640194401144981, Validation accuracy 0.9098920047283172
Epoch 68, Train loss 0.004799826823727926, Train accuracy 0.9984019886363636, Validation loss 0.5693706437945366, Validation accuracy 0.9107192099094391
Epoch 69, Train loss 0.004833633300635979, Train accuracy 0.9985067471861839, Validation loss 0.5702663794159889, Validation accuracy 0.9102366715669632
Epoch 0, Train loss 2.0216082740913737, Train accuracy 0.2416228692639958, Validation loss 1.9780785977840423, Validation accuracy 0.2848230704665184
Validation accuracy increased from 0.00 to 0.28
Epoch 1, Train loss 1.6159575032916935, Train accuracy 0.3906951348551295, Validation loss 1.5215904533863067, Validation accuracy 0.4357077211141586
Validation accuracy increased from 0.28 to 0.44
Epoch 2, Train loss 1.3511675609783693, Train accuracy 0.500276988541538, Validation loss 1.2919669091701507, Validation accuracy 0.5206801474094391
Validation accuracy increased from 0.44 to 0.52
Epoch 3, Train loss 1.1487476822327485, Train accuracy 0.5823952413418076, Validation loss 1.146506118774414, Validation accuracy 0.5983570784330368
Validation accuracy increased from 0.52 to 0.60
Epoch 4, Train loss 0.9782970144667409, Train accuracy 0.6481995738365434, Validation loss 0.9989201873540878, Validation accuracy 0.6607766538858414
Validation accuracy increased from 0.60 to 0.66
Epoch 5, Train loss 0.8526509102772583, Train accuracy 0.6991219815205444, Validation loss 0.9316790074110031, Validation accuracy 0.6744485288858414
Validation accuracy increased from 0.66 to 0.67
Epoch 6, Train loss 0.7403468889268962, Train accuracy 0.7391086647456343, Validation loss 0.899739146232605, Validation accuracy 0.6953584551811218
Validation accuracy increased from 0.67 to 0.70
Epoch 7, Train loss 0.665427999232303, Train accuracy 0.7651997513391755, Validation loss 0.8308281689882279, Validation accuracy 0.7276079952716827
Validation accuracy increased from 0.70 to 0.73
Epoch 8, Train loss 0.599906618960879, Train accuracy 0.7907253195616332, Validation loss 0.6860359996557236, Validation accuracy 0.7668428301811219
Validation accuracy increased from 0.73 to 0.77
Epoch 9, Train loss 0.5580566584725272, Train accuracy 0.806049360809001, Validation loss 0.6804685354232788, Validation accuracy 0.7752757340669632
Validation accuracy increased from 0.77 to 0.78
Epoch 10, Train loss 0.5184227465228601, Train accuracy 0.8181134587661787, Validation loss 0.532598964869976, Validation accuracy 0.8195427387952805
Validation accuracy increased from 0.78 to 0.82
Epoch 11, Train loss 0.47817192328247154, Train accuracy 0.833002485673536, Validation loss 0.5717279016971588, Validation accuracy 0.8062844663858414
Epoch 12, Train loss 0.45136362906884064, Train accuracy 0.842444069344889, Validation loss 0.5069175705313682, Validation accuracy 0.8261948525905609
Validation accuracy increased from 0.82 to 0.83
Epoch 13, Train loss 0.4191692088815299, Train accuracy 0.8547878194261681, Validation loss 0.5784495905041694, Validation accuracy 0.8152688413858413
Epoch 14, Train loss 0.39737761122259224, Train accuracy 0.8608149855651639, Validation loss 0.4906998619437218, Validation accuracy 0.8341911762952805
Validation accuracy increased from 0.83 to 0.83
Epoch 15, Train loss 0.37817829119210894, Train accuracy 0.8672576346857981, Validation loss 0.524859094619751, Validation accuracy 0.8272633284330368
Epoch 16, Train loss 0.3556831249628555, Train accuracy 0.8744353692639958, Validation loss 0.48400922268629076, Validation accuracy 0.8430606633424759
Validation accuracy increased from 0.83 to 0.84
Epoch 17, Train loss 0.33816542848944664, Train accuracy 0.8809543678706343, Validation loss 0.42493211179971696, Validation accuracy 0.8596162676811219
Validation accuracy increased from 0.84 to 0.86
Epoch 18, Train loss 0.31516350500962953, Train accuracy 0.8902024145830761, Validation loss 0.4465037599205971, Validation accuracy 0.8503102034330368
Epoch 19, Train loss 0.30326640436595137, Train accuracy 0.8916521661660888, Validation loss 0.48124682158231735, Validation accuracy 0.8529756426811218
Epoch 20, Train loss 0.22279863186519255, Train accuracy 0.922001065178351, Validation loss 0.34534704089164736, Validation accuracy 0.8871323525905609
Validation accuracy increased from 0.86 to 0.89
Epoch 21, Train loss 0.19399835042316804, Train accuracy 0.9325399500402537, Validation loss 0.3740673497319221, Validation accuracy 0.8826171875
Epoch 22, Train loss 0.1870972913774577, Train accuracy 0.9332377483898943, Validation loss 0.34797121584415436, Validation accuracy 0.8877412676811218
Validation accuracy increased from 0.89 to 0.89
Epoch 23, Train loss 0.1701142378574745, Train accuracy 0.9395081675188108, Validation loss 0.3763765931129456, Validation accuracy 0.8873506426811218
Epoch 24, Train loss 0.16318755969405174, Train accuracy 0.9420933946967125, Validation loss 0.40804539024829867, Validation accuracy 0.8813419133424759
Epoch 25, Train loss 0.15308179465037855, Train accuracy 0.9441628195345402, Validation loss 0.38299119621515276, Validation accuracy 0.886500459909439
Epoch 26, Train loss 0.14800107110799712, Train accuracy 0.9470010653815486, Validation loss 0.37000992968678476, Validation accuracy 0.8883042275905609
Validation accuracy increased from 0.89 to 0.89
Epoch 27, Train loss 0.13663296287202023, Train accuracy 0.9506685012443499, Validation loss 0.40318098813295367, Validation accuracy 0.8861098349094391
Epoch 28, Train loss 0.1318215293471109, Train accuracy 0.9527015269479968, Validation loss 0.3976939022541046, Validation accuracy 0.8909926474094391
Validation accuracy increased from 0.89 to 0.89
Epoch 29, Train loss 0.1273176821202717, Train accuracy 0.9541947797618129, Validation loss 0.40502282977104187, Validation accuracy 0.8901884198188782
Epoch 30, Train loss 0.11666826499541375, Train accuracy 0.9584659090773626, Validation loss 0.4356514632701874, Validation accuracy 0.8870634198188782
Epoch 31, Train loss 0.11555301618169654, Train accuracy 0.9580273435197093, Validation loss 0.40915725082159043, Validation accuracy 0.8876034021377563
Epoch 32, Train loss 0.10602473922666501, Train accuracy 0.9618323861875318, Validation loss 0.41536740958690643, Validation accuracy 0.8920381426811218
Validation accuracy increased from 0.89 to 0.89
Epoch 33, Train loss 0.10218277749266814, Train accuracy 0.9632057882845402, Validation loss 0.4163211971521378, Validation accuracy 0.8929457724094391
Validation accuracy increased from 0.89 to 0.89
Epoch 34, Train loss 0.0969247340055352, Train accuracy 0.9649360792880709, Validation loss 0.4193276584148407, Validation accuracy 0.8900620400905609
Epoch 35, Train loss 0.09332968231121247, Train accuracy 0.9664550779218023, Validation loss 0.4225329399108887, Validation accuracy 0.894140625
Validation accuracy increased from 0.89 to 0.89
Epoch 36, Train loss 0.09430371734990993, Train accuracy 0.9661097299646247, Validation loss 0.43013455271720885, Validation accuracy 0.8885225176811218
Epoch 37, Train loss 0.08172451004131952, Train accuracy 0.9703835225240751, Validation loss 0.45491856932640073, Validation accuracy 0.8928768396377563
Epoch 38, Train loss 0.08247484554621307, Train accuracy 0.9707484018396247, Validation loss 0.45142591595649717, Validation accuracy 0.8925321698188782
Epoch 39, Train loss 0.0808411366941238, Train accuracy 0.9711922938850793, Validation loss 0.4661284327507019, Validation accuracy 0.8930951297283173
Epoch 40, Train loss 0.05227719025093724, Train accuracy 0.9816264201971617, Validation loss 0.42257604002952576, Validation accuracy 0.8970473349094391
Validation accuracy increased from 0.89 to 0.90
Epoch 41, Train loss 0.04292692052496767, Train accuracy 0.9855388846587051, Validation loss 0.4415379151701927, Validation accuracy 0.9013212323188782
Validation accuracy increased from 0.90 to 0.90
Epoch 42, Train loss 0.03598701360698959, Train accuracy 0.988646128976887, Validation loss 0.4521501824259758, Validation accuracy 0.9001493573188781
Epoch 43, Train loss 0.03306316235631874, Train accuracy 0.9890269884331659, Validation loss 0.45626192092895507, Validation accuracy 0.8987362146377563
Epoch 44, Train loss 0.03244196437828412, Train accuracy 0.9890900210223414, Validation loss 0.46487058848142626, Validation accuracy 0.8995634198188782
Epoch 45, Train loss 0.029422368393914603, Train accuracy 0.9904501065611839, Validation loss 0.4701916977763176, Validation accuracy 0.9009076297283173
Epoch 46, Train loss 0.029038401503137058, Train accuracy 0.9905326701700687, Validation loss 0.4869551032781601, Validation accuracy 0.8970243573188782
Epoch 47, Train loss 0.0281301597292027, Train accuracy 0.9900825636630709, Validation loss 0.5135329365730286, Validation accuracy 0.8964154422283173
Epoch 48, Train loss 0.02961705254115672, Train accuracy 0.9899618253111839, Validation loss 0.4893619865179062, Validation accuracy 0.8980238974094391
Epoch 49, Train loss 0.026068756425626238, Train accuracy 0.9914080253378912, Validation loss 0.5214386373758316, Validation accuracy 0.899609375
Epoch 50, Train loss 0.027528893980409273, Train accuracy 0.9910591261630709, Validation loss 0.5143545851111412, Validation accuracy 0.8998046875
Epoch 51, Train loss 0.026640422113070435, Train accuracy 0.9907484017312527, Validation loss 0.5185128837823868, Validation accuracy 0.8982421875
Epoch 52, Train loss 0.021871979382756927, Train accuracy 0.992558593777093, Validation loss 0.538069061934948, Validation accuracy 0.90078125
Epoch 53, Train loss 0.023708689519976775, Train accuracy 0.9915696020153436, Validation loss 0.5282632008194923, Validation accuracy 0.8984604775905609
Epoch 54, Train loss 0.025644701334055175, Train accuracy 0.9914364344017073, Validation loss 0.5158448487520217, Validation accuracy 0.9001493573188781
Epoch 55, Train loss 0.0228198538322679, Train accuracy 0.9922922585498203, Validation loss 0.5333946838974952, Validation accuracy 0.898046875
Epoch 56, Train loss 0.023019804053050888, Train accuracy 0.9919531247155233, Validation loss 0.5440638139843941, Validation accuracy 0.8988511025905609
Epoch 57, Train loss 0.02400311862319623, Train accuracy 0.9920862923291597, Validation loss 0.5589803963899612, Validation accuracy 0.8976332724094391
Epoch 58, Train loss 0.022394251071752726, Train accuracy 0.9924920099702749, Validation loss 0.5310019373893737, Validation accuracy 0.8990693926811218
Epoch 59, Train loss 0.02057636919463138, Train accuracy 0.9933735792609778, Validation loss 0.5389393627643585, Validation accuracy 0.8974379599094391
Epoch 60, Train loss 0.01778778107439972, Train accuracy 0.9944007457657293, Validation loss 0.5204371839761734, Validation accuracy 0.9011948525905609
Epoch 61, Train loss 0.014337974329960574, Train accuracy 0.9954438920725476, Validation loss 0.521241481602192, Validation accuracy 0.9017807900905609
Validation accuracy increased from 0.90 to 0.90
Epoch 62, Train loss 0.012669294241773472, Train accuracy 0.996125709942796, Validation loss 0.5174962669610977, Validation accuracy 0.9033432900905609
Validation accuracy increased from 0.90 to 0.90
Epoch 63, Train loss 0.013304500217517752, Train accuracy 0.9958433949134566, Validation loss 0.5243225082755089, Validation accuracy 0.9036649823188782
Validation accuracy increased from 0.90 to 0.90
Epoch 64, Train loss 0.013463233375990636, Train accuracy 0.9954660866748203, Validation loss 0.5292357012629509, Validation accuracy 0.9036649823188782
Validation accuracy increased from 0.90 to 0.90
Epoch 65, Train loss 0.011032679885498841, Train accuracy 0.996613991192796, Validation loss 0.5384056374430657, Validation accuracy 0.9032743573188782
Epoch 66, Train loss 0.011412904907377775, Train accuracy 0.9964710582386364, Validation loss 0.5326630800962449, Validation accuracy 0.9035615801811219
Epoch 67, Train loss 0.010579415360222232, Train accuracy 0.9969593394886364, Validation loss 0.5374982491135597, Validation accuracy 0.9029756426811218
Epoch 68, Train loss 0.010725895283526783, Train accuracy 0.9968359372155233, Validation loss 0.5421387627720833, Validation accuracy 0.905055147409439
Validation accuracy increased from 0.90 to 0.91
Epoch 69, Train loss 0.012378464360980697, Train accuracy 0.9959383877840909, Validation loss 0.5464753851294517, Validation accuracy 0.9009535849094391
Test loss: 0.4549879714846611 Test accuracy: 0.91435546875  resnet10_Adam_0.01
Test loss: 0.501547098532319 Test accuracy: 0.9197265625  resnet18_Adam_0.01
Test loss: 0.42687289193272593 Test accuracy: 0.8884765625  resnet12_Adam_0.01
Test loss: 0.6656518183648586 Test accuracy: 0.89736328125  resnet14_4_Adam_0.01
Test loss: 0.6155952177941799 Test accuracy: 0.89150390625  resnet14_5_Adam_0.01
Epoch 0, Train loss 1.588437857952985, Train accuracy 0.4160937500948256, Validation loss 1.4095831274986268, Validation accuracy 0.5068014711141586
Validation accuracy increased from 0.00 to 0.51
Epoch 1, Train loss 1.212239420549436, Train accuracy 0.5636354759335518, Validation loss 1.1837638854980468, Validation accuracy 0.5859375
Validation accuracy increased from 0.51 to 0.59
Epoch 2, Train loss 1.0370993973179297, Train accuracy 0.6312144886363636, Validation loss 1.076583781838417, Validation accuracy 0.6254480689764023
Validation accuracy increased from 0.59 to 0.63
Epoch 3, Train loss 0.9172530953179706, Train accuracy 0.6760298294777219, Validation loss 0.8725117743015289, Validation accuracy 0.6927159935235977
Validation accuracy increased from 0.63 to 0.69
Epoch 4, Train loss 0.8256263079291041, Train accuracy 0.7099742540581659, Validation loss 0.8413754284381867, Validation accuracy 0.704296875
Validation accuracy increased from 0.69 to 0.70
Epoch 5, Train loss 0.7517669346522201, Train accuracy 0.7353861860253594, Validation loss 0.7099520534276962, Validation accuracy 0.7502642452716828
Validation accuracy increased from 0.70 to 0.75
Epoch 6, Train loss 0.6923252872445367, Train accuracy 0.7576349431818182, Validation loss 0.7197767108678818, Validation accuracy 0.7491957724094391
Epoch 7, Train loss 0.6363948236473582, Train accuracy 0.7774547230113636, Validation loss 0.6984494030475616, Validation accuracy 0.7576056987047195
Validation accuracy increased from 0.75 to 0.76
Epoch 8, Train loss 0.6015666885809465, Train accuracy 0.7882830253378912, Validation loss 0.6327293783426284, Validation accuracy 0.7738970577716827
Validation accuracy increased from 0.76 to 0.77
Epoch 9, Train loss 0.5695032502778552, Train accuracy 0.8019451349973679, Validation loss 0.58205446600914, Validation accuracy 0.7980583637952805
Validation accuracy increased from 0.77 to 0.80
Epoch 10, Train loss 0.5294860040938313, Train accuracy 0.8151580254462633, Validation loss 0.5733778104186058, Validation accuracy 0.8055836409330368
Validation accuracy increased from 0.80 to 0.81
Epoch 11, Train loss 0.5064807520671324, Train accuracy 0.8239799358628013, Validation loss 0.5244551166892052, Validation accuracy 0.8191061586141586
Validation accuracy increased from 0.81 to 0.82
Epoch 12, Train loss 0.47861680964177306, Train accuracy 0.8332501775161787, Validation loss 0.5034707263112068, Validation accuracy 0.8241613060235977
Validation accuracy increased from 0.82 to 0.82
Epoch 13, Train loss 0.4531870889054103, Train accuracy 0.8429421162740751, Validation loss 0.496799111366272, Validation accuracy 0.8270909935235977
Validation accuracy increased from 0.82 to 0.83
Epoch 14, Train loss 0.43611992099745706, Train accuracy 0.851177201690999, Validation loss 0.5938263073563576, Validation accuracy 0.8042164534330368
Epoch 15, Train loss 0.41418162072924053, Train accuracy 0.8578142754056237, Validation loss 0.5180149391293526, Validation accuracy 0.8226217836141586
Epoch 16, Train loss 0.39985395239835436, Train accuracy 0.8600479401648045, Validation loss 0.47319586724042895, Validation accuracy 0.8389591008424759
Validation accuracy increased from 0.83 to 0.84
Epoch 17, Train loss 0.37828383154489775, Train accuracy 0.8696413351730867, Validation loss 0.44207666665315626, Validation accuracy 0.8493336409330368
Validation accuracy increased from 0.84 to 0.85
Epoch 18, Train loss 0.36275784501975233, Train accuracy 0.8726278408007189, Validation loss 0.46587919890880586, Validation accuracy 0.8408662676811218
Epoch 19, Train loss 0.35315616183321585, Train accuracy 0.8774636008522727, Validation loss 0.4568708285689354, Validation accuracy 0.8483111202716828
Epoch 20, Train loss 0.28941313609142194, Train accuracy 0.9033540480516173, Validation loss 0.38621286749839784, Validation accuracy 0.8692095577716827
Validation accuracy increased from 0.85 to 0.87
Epoch 21, Train loss 0.27620441491969605, Train accuracy 0.906724076718092, Validation loss 0.3875766783952713, Validation accuracy 0.8680147051811218
Epoch 22, Train loss 0.27045751202174206, Train accuracy 0.9077556817369028, Validation loss 0.38876358717679976, Validation accuracy 0.8688419133424758
Epoch 23, Train loss 0.26066482719033957, Train accuracy 0.9104216972535307, Validation loss 0.3724037267267704, Validation accuracy 0.8782513797283172
Validation accuracy increased from 0.87 to 0.88
Epoch 24, Train loss 0.2560651663860137, Train accuracy 0.9136878550052643, Validation loss 0.37828202098608016, Validation accuracy 0.8699908077716827
Epoch 25, Train loss 0.2507180884819139, Train accuracy 0.9146795096722516, Validation loss 0.3716070599853992, Validation accuracy 0.8748506426811218
Epoch 26, Train loss 0.2468966632573442, Train accuracy 0.9159987568855286, Validation loss 0.3768665999174118, Validation accuracy 0.870875459909439
Epoch 27, Train loss 0.2371801847422665, Train accuracy 0.9204820665446195, Validation loss 0.36140540391206744, Validation accuracy 0.8773207724094391
Epoch 28, Train loss 0.23293354887176643, Train accuracy 0.9218483662063425, Validation loss 0.3696677625179291, Validation accuracy 0.876194852590561
Epoch 29, Train loss 0.22890805275264112, Train accuracy 0.9231036931953647, Validation loss 0.39621505737304685, Validation accuracy 0.8778837323188782
Epoch 30, Train loss 0.22403153192929245, Train accuracy 0.9247745028273626, Validation loss 0.39032271802425383, Validation accuracy 0.8731158077716827
Epoch 31, Train loss 0.22237565012818034, Train accuracy 0.9243794388391755, Validation loss 0.376496396958828, Validation accuracy 0.8763442099094391
Epoch 32, Train loss 0.21844051947647875, Train accuracy 0.9251171875406395, Validation loss 0.372801573574543, Validation accuracy 0.8775850176811218
Epoch 33, Train loss 0.21255192541601983, Train accuracy 0.928588423200629, Validation loss 0.36494543552398684, Validation accuracy 0.8791015625
Validation accuracy increased from 0.88 to 0.88
Epoch 34, Train loss 0.20565167272632773, Train accuracy 0.9310271662067283, Validation loss 0.40911575555801394, Validation accuracy 0.8686236202716827
Epoch 35, Train loss 0.20244626827876677, Train accuracy 0.9304252483628013, Validation loss 0.376361121237278, Validation accuracy 0.8734604775905609
Epoch 36, Train loss 0.1989374543455514, Train accuracy 0.931527876379815, Validation loss 0.3833171039819717, Validation accuracy 0.8759535849094391
Epoch 37, Train loss 0.19520036486739462, Train accuracy 0.9344042966311629, Validation loss 0.37621071115136145, Validation accuracy 0.8739200383424759
Epoch 38, Train loss 0.19179063603620639, Train accuracy 0.9358780184252695, Validation loss 0.3718107596039772, Validation accuracy 0.8787339150905609
Epoch 39, Train loss 0.18865511917763136, Train accuracy 0.9365447441285307, Validation loss 0.382776302844286, Validation accuracy 0.8758501827716827
Epoch 40, Train loss 0.1650408722714267, Train accuracy 0.9450727982277219, Validation loss 0.35671960934996605, Validation accuracy 0.8845013797283172
Validation accuracy increased from 0.88 to 0.88
Epoch 41, Train loss 0.16109067383645612, Train accuracy 0.9473410865122621, Validation loss 0.3525428257882595, Validation accuracy 0.8847196698188782
Validation accuracy increased from 0.88 to 0.88
Epoch 42, Train loss 0.15679934904487294, Train accuracy 0.9489479755813425, Validation loss 0.3589584521949291, Validation accuracy 0.8827205896377563
Epoch 43, Train loss 0.15513778088445013, Train accuracy 0.9502024145966227, Validation loss 0.359422405064106, Validation accuracy 0.8856272965669632
Validation accuracy increased from 0.88 to 0.89
Epoch 44, Train loss 0.15551622982390903, Train accuracy 0.9490207741883668, Validation loss 0.3539251141250134, Validation accuracy 0.8859949439764023
Validation accuracy increased from 0.89 to 0.89
Epoch 45, Train loss 0.15126045776361768, Train accuracy 0.9505042613229968, Validation loss 0.35281741097569463, Validation accuracy 0.8875804215669632
Validation accuracy increased from 0.89 to 0.89
Epoch 46, Train loss 0.1486939629116519, Train accuracy 0.9525390622968023, Validation loss 0.3654606841504574, Validation accuracy 0.8843060672283173
Epoch 47, Train loss 0.1509413583288816, Train accuracy 0.9513503194532611, Validation loss 0.3565284930169582, Validation accuracy 0.8860868573188782
Epoch 48, Train loss 0.14985248116268354, Train accuracy 0.9515349787067283, Validation loss 0.3548170618712902, Validation accuracy 0.8863051474094391
Epoch 49, Train loss 0.14442615875635634, Train accuracy 0.953763316639445, Validation loss 0.357740955799818, Validation accuracy 0.8889935672283172
Validation accuracy increased from 0.89 to 0.89
Epoch 50, Train loss 0.1433918421495367, Train accuracy 0.9540642753920772, Validation loss 0.3531701236963272, Validation accuracy 0.8860409021377563
Epoch 51, Train loss 0.1431711598468775, Train accuracy 0.9536177201027219, Validation loss 0.36156457886099813, Validation accuracy 0.8880629599094391
Epoch 52, Train loss 0.14253476279025729, Train accuracy 0.9540012428029017, Validation loss 0.35485672727227213, Validation accuracy 0.8866498172283173
Epoch 53, Train loss 0.1411135791038925, Train accuracy 0.9538077058439905, Validation loss 0.356461164355278, Validation accuracy 0.8862362146377564
Epoch 54, Train loss 0.13597806966440243, Train accuracy 0.9554651985791597, Validation loss 0.3605971813201904, Validation accuracy 0.8864774823188781
Epoch 55, Train loss 0.13673729813573035, Train accuracy 0.9559987570074472, Validation loss 0.36183724254369737, Validation accuracy 0.8866038590669632
Epoch 56, Train loss 0.132360506887463, Train accuracy 0.9566228691149842, Validation loss 0.3621588110923767, Validation accuracy 0.8856272965669632
Epoch 57, Train loss 0.13429122536697172, Train accuracy 0.9565669389610941, Validation loss 0.36025789603590963, Validation accuracy 0.8853056073188782
Epoch 58, Train loss 0.13356039893220772, Train accuracy 0.956937144764445, Validation loss 0.36355206221342085, Validation accuracy 0.8866498172283173
Epoch 59, Train loss 0.13041623017158022, Train accuracy 0.9583797939121723, Validation loss 0.36337814554572107, Validation accuracy 0.8883616715669632
Epoch 60, Train loss 0.12339272197674621, Train accuracy 0.961575816639445, Validation loss 0.35175554677844045, Validation accuracy 0.8906594663858414
Validation accuracy increased from 0.89 to 0.89
Epoch 61, Train loss 0.12091452547941696, Train accuracy 0.9621750709008087, Validation loss 0.35514928549528124, Validation accuracy 0.8885569840669632
Epoch 62, Train loss 0.12307121405716646, Train accuracy 0.9607927910983562, Validation loss 0.35720080062747, Validation accuracy 0.8879940271377563
Epoch 63, Train loss 0.12081735585392876, Train accuracy 0.9622540836307135, Validation loss 0.3559341788291931, Validation accuracy 0.8883386939764023
Epoch 64, Train loss 0.12051446431062439, Train accuracy 0.9638077057898045, Validation loss 0.3574445962905884, Validation accuracy 0.8895335465669632
Epoch 65, Train loss 0.11899970958686688, Train accuracy 0.9633291902189905, Validation loss 0.35653612911701205, Validation accuracy 0.8891659021377564
Epoch 66, Train loss 0.12064086438410661, Train accuracy 0.9618607952513478, Validation loss 0.35693749189376833, Validation accuracy 0.8877527564764023
Epoch 67, Train loss 0.12091355707327073, Train accuracy 0.9619912996210835, Validation loss 0.35352059453725815, Validation accuracy 0.8897058814764023
Epoch 68, Train loss 0.11934664538553492, Train accuracy 0.9618137428029017, Validation loss 0.35703524574637413, Validation accuracy 0.8884076297283172
Epoch 69, Train loss 0.11882411557334391, Train accuracy 0.9619788706979968, Validation loss 0.3574323780834675, Validation accuracy 0.8866268396377563
Epoch 0, Train loss 1.471639140763066, Train accuracy 0.45994762060317124, Validation loss 1.1764024198055267, Validation accuracy 0.576171875
Validation accuracy increased from 0.00 to 0.58
Epoch 1, Train loss 0.9901108152487061, Train accuracy 0.6438361148942601, Validation loss 1.0323833256959916, Validation accuracy 0.6478515625
Validation accuracy increased from 0.58 to 0.65
Epoch 2, Train loss 0.7725735642015934, Train accuracy 0.727092506871982, Validation loss 0.8254468828439713, Validation accuracy 0.7129480689764023
Validation accuracy increased from 0.65 to 0.71
Epoch 3, Train loss 0.6489087390628728, Train accuracy 0.7727761007845402, Validation loss 0.6237035155296325, Validation accuracy 0.7893152564764023
Validation accuracy increased from 0.71 to 0.79
Epoch 4, Train loss 0.5548637238415804, Train accuracy 0.8061257099563425, Validation loss 0.5585281699895859, Validation accuracy 0.8118795961141586
Validation accuracy increased from 0.79 to 0.81
Epoch 5, Train loss 0.4986851262775334, Train accuracy 0.8266068890013478, Validation loss 0.5926929995417595, Validation accuracy 0.8007123172283173
Epoch 6, Train loss 0.4520103535191579, Train accuracy 0.8427929685197093, Validation loss 0.6031441926956177, Validation accuracy 0.7996438413858413
Epoch 7, Train loss 0.41321691193363885, Train accuracy 0.8553861860524524, Validation loss 0.5172563090920448, Validation accuracy 0.8303538590669632
Validation accuracy increased from 0.81 to 0.83
Epoch 8, Train loss 0.384480267170478, Train accuracy 0.8640642755410888, Validation loss 0.5534378290176392, Validation accuracy 0.8117532163858414
Epoch 9, Train loss 0.34370349923318083, Train accuracy 0.8812997158278119, Validation loss 0.437658803164959, Validation accuracy 0.8588579952716827
Validation accuracy increased from 0.83 to 0.86
Epoch 10, Train loss 0.31778082090683957, Train accuracy 0.8884810012849894, Validation loss 0.40986255556344986, Validation accuracy 0.8658432900905609
Validation accuracy increased from 0.86 to 0.87
Epoch 11, Train loss 0.30190014525909314, Train accuracy 0.893446377732537, Validation loss 0.45190546810626986, Validation accuracy 0.8521714150905609
Epoch 12, Train loss 0.27495326491242106, Train accuracy 0.9027583450078964, Validation loss 0.4953081414103508, Validation accuracy 0.8467945784330368
Epoch 13, Train loss 0.25727262517268007, Train accuracy 0.9106116829947992, Validation loss 0.45196495950222015, Validation accuracy 0.8571691185235977
Epoch 14, Train loss 0.2433309651572596, Train accuracy 0.9141663705760782, Validation loss 0.4105938941240311, Validation accuracy 0.8716337323188782
Validation accuracy increased from 0.87 to 0.87
Epoch 15, Train loss 0.22646395608105443, Train accuracy 0.9199627129869028, Validation loss 0.40760914534330367, Validation accuracy 0.8664751827716828
Epoch 16, Train loss 0.22213470144197345, Train accuracy 0.9213121448728171, Validation loss 0.40626332610845567, Validation accuracy 0.8700942099094391
Epoch 17, Train loss 0.19965537468140776, Train accuracy 0.9294327057220719, Validation loss 0.39666376262903214, Validation accuracy 0.8741153508424759
Validation accuracy increased from 0.87 to 0.87
Epoch 18, Train loss 0.187277044381269, Train accuracy 0.9329509941691702, Validation loss 0.38234508186578753, Validation accuracy 0.8814912676811218
Validation accuracy increased from 0.87 to 0.88
Epoch 19, Train loss 0.18148299226198683, Train accuracy 0.9352024146779017, Validation loss 0.4081003203988075, Validation accuracy 0.8730698525905609
Epoch 20, Train loss 0.11360834985548122, Train accuracy 0.9612997157329862, Validation loss 0.2813293218612671, Validation accuracy 0.9112362146377564
Validation accuracy increased from 0.88 to 0.91
Epoch 21, Train loss 0.08883216147395698, Train accuracy 0.9703959514471617, Validation loss 0.27680715546011925, Validation accuracy 0.9152918189764023
Validation accuracy increased from 0.91 to 0.92
Epoch 22, Train loss 0.08162738412449305, Train accuracy 0.9730149145153436, Validation loss 0.3014091342687607, Validation accuracy 0.9085018396377563
Epoch 23, Train loss 0.07410049470226196, Train accuracy 0.9758913351053541, Validation loss 0.3055066026747227, Validation accuracy 0.9077205896377564
Epoch 24, Train loss 0.06933818887707523, Train accuracy 0.976928266950629, Validation loss 0.30202784314751624, Validation accuracy 0.9119485288858413
Epoch 25, Train loss 0.06271338056434285, Train accuracy 0.9797656248238954, Validation loss 0.30754263922572134, Validation accuracy 0.9097886025905609
Epoch 26, Train loss 0.05812160854905166, Train accuracy 0.981575816531073, Validation loss 0.30806610733270645, Validation accuracy 0.9116038590669632
Epoch 27, Train loss 0.053721487331627446, Train accuracy 0.9831711646508087, Validation loss 0.3125982254743576, Validation accuracy 0.9147518396377563
Epoch 28, Train loss 0.052254013590176, Train accuracy 0.982580788094889, Validation loss 0.328852142393589, Validation accuracy 0.9124540448188782
Epoch 29, Train loss 0.0495910883394324, Train accuracy 0.9844549003649842, Validation loss 0.3384097427129745, Validation accuracy 0.9073759198188782
Epoch 30, Train loss 0.04691632615868002, Train accuracy 0.9851269528947093, Validation loss 0.3324263975024223, Validation accuracy 0.9133846521377563
Epoch 31, Train loss 0.046331101446412504, Train accuracy 0.9848446375267073, Validation loss 0.32125183045864103, Validation accuracy 0.9106962323188782
Epoch 32, Train loss 0.042313441321973434, Train accuracy 0.985998756844889, Validation loss 0.31293889284133913, Validation accuracy 0.9169462323188782
Validation accuracy increased from 0.92 to 0.92
Epoch 33, Train loss 0.04240908849963241, Train accuracy 0.9862713065337051, Validation loss 0.3362479031085968, Validation accuracy 0.9089384198188781
Epoch 34, Train loss 0.03759718788999387, Train accuracy 0.9877361502837051, Validation loss 0.3203191220760345, Validation accuracy 0.9133386939764023
Epoch 35, Train loss 0.03537900387626988, Train accuracy 0.9889124642041597, Validation loss 0.3491255596280098, Validation accuracy 0.9111098349094391
Epoch 36, Train loss 0.03696839879161085, Train accuracy 0.9878471232950687, Validation loss 0.33069916889071466, Validation accuracy 0.9125804215669632
Epoch 37, Train loss 0.03415660224114121, Train accuracy 0.9888174713335254, Validation loss 0.3236108489334583, Validation accuracy 0.9161420047283173
Epoch 38, Train loss 0.03216871412851932, Train accuracy 0.9898508522998203, Validation loss 0.3727287620306015, Validation accuracy 0.9087660849094391
Epoch 39, Train loss 0.03452946473209357, Train accuracy 0.9886079545725476, Validation loss 0.3362590201199055, Validation accuracy 0.9169002771377563
Epoch 40, Train loss 0.024433768449605188, Train accuracy 0.9926029829816385, Validation loss 0.32172599285840986, Validation accuracy 0.9171185672283173
Validation accuracy increased from 0.92 to 0.92
Epoch 41, Train loss 0.019683802418347277, Train accuracy 0.9946830607950687, Validation loss 0.3200357884168625, Validation accuracy 0.9202665448188782
Validation accuracy increased from 0.92 to 0.92
Epoch 42, Train loss 0.018617760666529648, Train accuracy 0.9946004971861839, Validation loss 0.31890192478895185, Validation accuracy 0.9182444840669632
Epoch 43, Train loss 0.016815167185003786, Train accuracy 0.9954057173295454, Validation loss 0.31986511796712874, Validation accuracy 0.9192440271377563
Epoch 44, Train loss 0.017056002173128283, Train accuracy 0.9954376772723414, Validation loss 0.3264927938580513, Validation accuracy 0.9193129599094391
Epoch 45, Train loss 0.01567212085832249, Train accuracy 0.9958052201704546, Validation loss 0.32675146088004114, Validation accuracy 0.9186580896377563
Epoch 46, Train loss 0.01611854130433957, Train accuracy 0.995881569317796, Validation loss 0.3287236079573631, Validation accuracy 0.9184857547283173
Epoch 47, Train loss 0.014816143790746784, Train accuracy 0.9961381392045454, Validation loss 0.33109100013971327, Validation accuracy 0.9166015625
Epoch 48, Train loss 0.015039128280477598, Train accuracy 0.9962810721587051, Validation loss 0.3293781064450741, Validation accuracy 0.9185087323188782
Epoch 49, Train loss 0.014722551441412757, Train accuracy 0.9961860792880709, Validation loss 0.3348662436008453, Validation accuracy 0.9210248172283173
Validation accuracy increased from 0.92 to 0.92
Epoch 50, Train loss 0.014158893101425334, Train accuracy 0.9966486150568182, Validation loss 0.3318016119301319, Validation accuracy 0.9186351090669632
Epoch 51, Train loss 0.013530920141916298, Train accuracy 0.9965092329816385, Validation loss 0.33755714148283006, Validation accuracy 0.9198529422283173
Epoch 52, Train loss 0.012556453526485711, Train accuracy 0.9969593394886364, Validation loss 0.33013150095939636, Validation accuracy 0.918727022409439
Epoch 53, Train loss 0.012749647946541452, Train accuracy 0.9967755682089112, Validation loss 0.33768660873174666, Validation accuracy 0.9186810672283172
Epoch 54, Train loss 0.011952077530705455, Train accuracy 0.9970419034361839, Validation loss 0.3312352538108826, Validation accuracy 0.9200252771377564
Epoch 55, Train loss 0.012677554084802978, Train accuracy 0.9967373934659091, Validation loss 0.3333395324647427, Validation accuracy 0.9193129599094391
Epoch 56, Train loss 0.012273302613969216, Train accuracy 0.9971244670450687, Validation loss 0.3383146099746227, Validation accuracy 0.9210018396377564
Epoch 57, Train loss 0.011399876717901365, Train accuracy 0.9973748224702749, Validation loss 0.3321054629981518, Validation accuracy 0.9200712323188782
Epoch 58, Train loss 0.011147219183674844, Train accuracy 0.9972478693181818, Validation loss 0.3405841149389744, Validation accuracy 0.9202205896377563
Epoch 59, Train loss 0.010913628000046381, Train accuracy 0.9973810369318182, Validation loss 0.33437983617186545, Validation accuracy 0.9195082724094391
Epoch 60, Train loss 0.01123263095029291, Train accuracy 0.997197265652093, Validation loss 0.3332697212696075, Validation accuracy 0.9191176474094391
Epoch 61, Train loss 0.009692773203079758, Train accuracy 0.9979580965909091, Validation loss 0.3296023927628994, Validation accuracy 0.9192899823188782
Epoch 62, Train loss 0.009194455282836729, Train accuracy 0.998046875, Validation loss 0.32978429049253466, Validation accuracy 0.9208295047283173
Epoch 63, Train loss 0.009630398580074225, Train accuracy 0.9977139559659091, Validation loss 0.33265382423996925, Validation accuracy 0.9204618573188782
Epoch 64, Train loss 0.009015106147589077, Train accuracy 0.9981516335498203, Validation loss 0.33481779769062997, Validation accuracy 0.9200942099094391
Epoch 65, Train loss 0.008946975973561744, Train accuracy 0.9982341971587051, Validation loss 0.3312476918101311, Validation accuracy 0.9194852948188782
Epoch 66, Train loss 0.008820887103369883, Train accuracy 0.9981356534090909, Validation loss 0.3349762737751007, Validation accuracy 0.9190946698188782
Epoch 67, Train loss 0.008399969528413336, Train accuracy 0.9981516335498203, Validation loss 0.3333474017679691, Validation accuracy 0.9190946698188782
Epoch 68, Train loss 0.009362257714118723, Train accuracy 0.9975807883522727, Validation loss 0.33514827862381935, Validation accuracy 0.9191176474094391
Epoch 69, Train loss 0.009428817516891286, Train accuracy 0.9977361505681818, Validation loss 0.33550958782434465, Validation accuracy 0.9202435672283172
Epoch 0, Train loss 1.6500545171174137, Train accuracy 0.38876420445740223, Validation loss 1.5158779859542846, Validation accuracy 0.4500344663858414
Validation accuracy increased from 0.00 to 0.45
Epoch 1, Train loss 1.2472839788957075, Train accuracy 0.5495987216180022, Validation loss 1.7260080337524415, Validation accuracy 0.46429227888584135
Validation accuracy increased from 0.45 to 0.46
Epoch 2, Train loss 1.0619942864233798, Train accuracy 0.619370561093092, Validation loss 1.10812808573246, Validation accuracy 0.6116153508424759
Validation accuracy increased from 0.46 to 0.61
Epoch 3, Train loss 0.9391557083211162, Train accuracy 0.6642888848754492, Validation loss 0.9751698225736618, Validation accuracy 0.6587431073188782
Validation accuracy increased from 0.61 to 0.66
Epoch 4, Train loss 0.8464142497290265, Train accuracy 0.6984614699401639, Validation loss 0.9095004886388779, Validation accuracy 0.6875344663858414
Validation accuracy increased from 0.66 to 0.69
Epoch 5, Train loss 0.7739667296409607, Train accuracy 0.7283655892718922, Validation loss 0.8322060734033585, Validation accuracy 0.7207490801811218
Validation accuracy increased from 0.69 to 0.72
Epoch 6, Train loss 0.7175707190551541, Train accuracy 0.7482572797347199, Validation loss 0.8900429487228394, Validation accuracy 0.7040670961141586
Epoch 7, Train loss 0.6699995588172566, Train accuracy 0.7652254971590909, Validation loss 0.630514669418335, Validation accuracy 0.7838694840669632
Validation accuracy increased from 0.72 to 0.78
Epoch 8, Train loss 0.6402954642068256, Train accuracy 0.7758780182762579, Validation loss 1.0767367482185364, Validation accuracy 0.650390625
Epoch 9, Train loss 0.6079551604661074, Train accuracy 0.7871022725647147, Validation loss 0.6258180499076843, Validation accuracy 0.7849724262952804
Validation accuracy increased from 0.78 to 0.78
Epoch 10, Train loss 0.5814437231218273, Train accuracy 0.797954545440999, Validation loss 0.5875857785344124, Validation accuracy 0.8024241715669632
Validation accuracy increased from 0.78 to 0.80
Epoch 11, Train loss 0.5583970687267455, Train accuracy 0.8029616475105286, Validation loss 0.6055642649531364, Validation accuracy 0.7861443012952805
Epoch 12, Train loss 0.5420168572190133, Train accuracy 0.8101580254733562, Validation loss 0.6097352728247643, Validation accuracy 0.7944967836141587
Epoch 13, Train loss 0.5230730037120256, Train accuracy 0.8162331320345402, Validation loss 0.5857818067073822, Validation accuracy 0.8034122258424758
Validation accuracy increased from 0.80 to 0.80
Epoch 14, Train loss 0.5078132486140187, Train accuracy 0.8243226205760782, Validation loss 0.5670952647924423, Validation accuracy 0.8064108461141586
Validation accuracy increased from 0.80 to 0.81
Epoch 15, Train loss 0.48906554925170814, Train accuracy 0.8293022015555338, Validation loss 0.6099334567785263, Validation accuracy 0.7896829038858414
Epoch 16, Train loss 0.4720655987885865, Train accuracy 0.8352929685603488, Validation loss 0.5269870057702064, Validation accuracy 0.8194508284330368
Validation accuracy increased from 0.81 to 0.82
Epoch 17, Train loss 0.46218880435282533, Train accuracy 0.8393892043016173, Validation loss 0.5883990436792373, Validation accuracy 0.8091222435235977
Epoch 18, Train loss 0.45191457342695107, Train accuracy 0.8408158733086153, Validation loss 0.5391434445977211, Validation accuracy 0.8156824439764023
Epoch 19, Train loss 0.4426833265884356, Train accuracy 0.8459996448999102, Validation loss 0.4443759977817535, Validation accuracy 0.8437959551811218
Validation accuracy increased from 0.82 to 0.84
Epoch 20, Train loss 0.37959763822569087, Train accuracy 0.8680912642316385, Validation loss 0.42179164886474607, Validation accuracy 0.8518956810235977
Validation accuracy increased from 0.84 to 0.85
Epoch 21, Train loss 0.3688668937168338, Train accuracy 0.8724822442639958, Validation loss 0.4011410415172577, Validation accuracy 0.8625
Validation accuracy increased from 0.85 to 0.86
Epoch 22, Train loss 0.3605408326468684, Train accuracy 0.8754154829816385, Validation loss 0.40563566982746124, Validation accuracy 0.8624770224094391
Epoch 23, Train loss 0.3560438428751447, Train accuracy 0.8773810369047251, Validation loss 0.4022224351763725, Validation accuracy 0.8663143396377564
Validation accuracy increased from 0.86 to 0.87
Epoch 24, Train loss 0.35168328119272535, Train accuracy 0.8781001418828964, Validation loss 0.38667413145303725, Validation accuracy 0.8673368573188782
Validation accuracy increased from 0.87 to 0.87
Epoch 25, Train loss 0.3502074805173007, Train accuracy 0.8787064985795454, Validation loss 0.40156405568122866, Validation accuracy 0.8626953125
Epoch 26, Train loss 0.3417729516936974, Train accuracy 0.8813192471861839, Validation loss 0.39114804565906525, Validation accuracy 0.866969209909439
Epoch 27, Train loss 0.33942789457399736, Train accuracy 0.8818048648536205, Validation loss 0.4000800110399723, Validation accuracy 0.8650390625
Epoch 28, Train loss 0.3343886054882949, Train accuracy 0.8846795098348097, Validation loss 0.41516788601875304, Validation accuracy 0.8588120400905609
Epoch 29, Train loss 0.32929274355146015, Train accuracy 0.8857102272185412, Validation loss 0.3944390073418617, Validation accuracy 0.8614774823188782
Epoch 30, Train loss 0.3227097748524763, Train accuracy 0.8883291902867231, Validation loss 0.3794046089053154, Validation accuracy 0.8720473349094391
Validation accuracy increased from 0.87 to 0.87
Epoch 31, Train loss 0.3263695483857935, Train accuracy 0.8858939984982664, Validation loss 0.39252825677394865, Validation accuracy 0.8683938413858414
Epoch 32, Train loss 0.32289688949557865, Train accuracy 0.8870454545725476, Validation loss 0.41187331080436707, Validation accuracy 0.8647977948188782
Epoch 33, Train loss 0.31667663842778315, Train accuracy 0.8905557526106184, Validation loss 0.4058313764631748, Validation accuracy 0.8651079952716827
Epoch 34, Train loss 0.3153153025460514, Train accuracy 0.8892169743776321, Validation loss 0.42857237309217455, Validation accuracy 0.8547794133424759
Epoch 35, Train loss 0.31115426952865993, Train accuracy 0.8916361860253594, Validation loss 0.3945667691528797, Validation accuracy 0.8677734375
Epoch 36, Train loss 0.30921436786990275, Train accuracy 0.8914772725918076, Validation loss 0.3884280227124691, Validation accuracy 0.869921875
Epoch 37, Train loss 0.30593867489898746, Train accuracy 0.8931951346722516, Validation loss 0.4084015034139156, Validation accuracy 0.8676011025905609
Epoch 38, Train loss 0.3026525896381248, Train accuracy 0.8935200639746406, Validation loss 0.4509523272514343, Validation accuracy 0.8526309758424759
Epoch 39, Train loss 0.3015444324436513, Train accuracy 0.8942329544912685, Validation loss 0.4501462563872337, Validation accuracy 0.8534926474094391
Epoch 40, Train loss 0.2719211936505003, Train accuracy 0.9056756035848097, Validation loss 0.3643876455724239, Validation accuracy 0.8793772965669632
Validation accuracy increased from 0.87 to 0.88
Epoch 41, Train loss 0.2674655772068284, Train accuracy 0.9090678265148943, Validation loss 0.3647041544318199, Validation accuracy 0.8786420047283172
Epoch 42, Train loss 0.26452525899830187, Train accuracy 0.9081143465909091, Validation loss 0.3604855716228485, Validation accuracy 0.8764935672283173
Epoch 43, Train loss 0.2642998494715853, Train accuracy 0.9098792611197992, Validation loss 0.360438372194767, Validation accuracy 0.8760799646377564
Epoch 44, Train loss 0.2612296264110641, Train accuracy 0.9093723364851691, Validation loss 0.35594395101070403, Validation accuracy 0.8776654422283172
Epoch 45, Train loss 0.25992143831469794, Train accuracy 0.9091051136228171, Validation loss 0.35815498530864714, Validation accuracy 0.8786649823188781
Epoch 46, Train loss 0.26268787478858774, Train accuracy 0.9084019884467125, Validation loss 0.35747372135519984, Validation accuracy 0.8788143396377563
Epoch 47, Train loss 0.25586258552291175, Train accuracy 0.9108620380813425, Validation loss 0.3679437771439552, Validation accuracy 0.873265165090561
Epoch 48, Train loss 0.2564688138663769, Train accuracy 0.9111257100647147, Validation loss 0.3639717109501362, Validation accuracy 0.8772977948188782
Epoch 49, Train loss 0.25496225304562936, Train accuracy 0.9111905182627115, Validation loss 0.3656973697245121, Validation accuracy 0.8751723349094391
Epoch 50, Train loss 0.2548791372471235, Train accuracy 0.9108016690747305, Validation loss 0.36164821311831474, Validation accuracy 0.8782284021377563
Epoch 51, Train loss 0.25154268233613536, Train accuracy 0.9131178977814588, Validation loss 0.36463565602898595, Validation accuracy 0.8784926474094391
Epoch 52, Train loss 0.2529422599314289, Train accuracy 0.9123526276512579, Validation loss 0.36851272359490395, Validation accuracy 0.8770795047283173
Epoch 53, Train loss 0.24980547211386941, Train accuracy 0.9122762781652537, Validation loss 0.37034311294555666, Validation accuracy 0.8730009198188782
Epoch 54, Train loss 0.2525912352244962, Train accuracy 0.9116495028138161, Validation loss 0.3619729965925217, Validation accuracy 0.8765625
Epoch 55, Train loss 0.24740764066915621, Train accuracy 0.9145339131355286, Validation loss 0.3611640684306622, Validation accuracy 0.8813534021377564
Validation accuracy increased from 0.88 to 0.88
Epoch 56, Train loss 0.24740397041155535, Train accuracy 0.9133327413689006, Validation loss 0.36020981445908545, Validation accuracy 0.8800321698188782
Epoch 57, Train loss 0.2455924382771958, Train accuracy 0.9146289060061629, Validation loss 0.35681369006633756, Validation accuracy 0.8799862146377564
Epoch 58, Train loss 0.24177026147530836, Train accuracy 0.9162366830489852, Validation loss 0.35628981366753576, Validation accuracy 0.8819852948188782
Validation accuracy increased from 0.88 to 0.88
Epoch 59, Train loss 0.23982270586897025, Train accuracy 0.9164524146101691, Validation loss 0.36510497108101847, Validation accuracy 0.8802274823188782
Epoch 60, Train loss 0.23193718222054568, Train accuracy 0.9198251065205444, Validation loss 0.3512153074145317, Validation accuracy 0.8816636025905609
Epoch 61, Train loss 0.23377513199705968, Train accuracy 0.9191095524213531, Validation loss 0.3503683261573315, Validation accuracy 0.8818129599094391
Epoch 62, Train loss 0.22711154259741306, Train accuracy 0.9222194599834356, Validation loss 0.3543455235660076, Validation accuracy 0.8817440271377563
Epoch 63, Train loss 0.2325291523540562, Train accuracy 0.9199840196154334, Validation loss 0.35126677006483076, Validation accuracy 0.8817670047283173
Epoch 64, Train loss 0.23099453256211497, Train accuracy 0.9212810722264376, Validation loss 0.3513400100171566, Validation accuracy 0.8823988974094391
Validation accuracy increased from 0.88 to 0.88
Epoch 65, Train loss 0.2298207167028026, Train accuracy 0.9220862923697992, Validation loss 0.3528648138046265, Validation accuracy 0.8821346521377563
Epoch 66, Train loss 0.2302405848591165, Train accuracy 0.9200062142177061, Validation loss 0.34991547018289565, Validation accuracy 0.8833295047283173
Validation accuracy increased from 0.88 to 0.88
Epoch 67, Train loss 0.2269704214043238, Train accuracy 0.921658380465074, Validation loss 0.35308214873075483, Validation accuracy 0.8812270224094391
Epoch 68, Train loss 0.22814245335757732, Train accuracy 0.9212588776241649, Validation loss 0.3499530404806137, Validation accuracy 0.8839154422283173
Validation accuracy increased from 0.88 to 0.88
Epoch 69, Train loss 0.22738565767014568, Train accuracy 0.9230060367421671, Validation loss 0.35355918705463407, Validation accuracy 0.8815946698188781
Epoch 0, Train loss 1.5361811742186546, Train accuracy 0.42896040461280127, Validation loss 1.7292553782463074, Validation accuracy 0.4454733461141586
Validation accuracy increased from 0.00 to 0.45
Epoch 1, Train loss 1.0907989838583902, Train accuracy 0.6067622513933615, Validation loss 1.1208877265453339, Validation accuracy 0.6268037676811218
Validation accuracy increased from 0.45 to 0.63
Epoch 2, Train loss 0.8947861882095988, Train accuracy 0.6799893463877115, Validation loss 0.8600697040557861, Validation accuracy 0.6993221521377564
Validation accuracy increased from 0.63 to 0.70
Epoch 3, Train loss 0.7684225856580518, Train accuracy 0.7301225140690804, Validation loss 0.8402785807847977, Validation accuracy 0.7101217836141587
Validation accuracy increased from 0.70 to 0.71
Epoch 4, Train loss 0.6725242552770809, Train accuracy 0.7630717327648943, Validation loss 0.9443249791860581, Validation accuracy 0.6974494487047196
Epoch 5, Train loss 0.6188948227261956, Train accuracy 0.7821493250402537, Validation loss 0.7153631657361984, Validation accuracy 0.7577091008424759
Validation accuracy increased from 0.71 to 0.76
Epoch 6, Train loss 0.5631473706188527, Train accuracy 0.8033291900699789, Validation loss 0.5862354382872581, Validation accuracy 0.7992761939764023
Validation accuracy increased from 0.76 to 0.80
Epoch 7, Train loss 0.5301811747591604, Train accuracy 0.8158904473212633, Validation loss 0.6857608914375305, Validation accuracy 0.7729549646377564
Epoch 8, Train loss 0.4874559683217244, Train accuracy 0.8299263136630709, Validation loss 0.6685626298189163, Validation accuracy 0.7826746314764023
Epoch 9, Train loss 0.4595792545852336, Train accuracy 0.8374698151918974, Validation loss 0.5088594704866409, Validation accuracy 0.8294806987047195
Validation accuracy increased from 0.80 to 0.83
Epoch 10, Train loss 0.43275263803926384, Train accuracy 0.8490589487959038, Validation loss 0.7910082310438156, Validation accuracy 0.7547679215669632
Epoch 11, Train loss 0.40957388027825137, Train accuracy 0.8566965552216227, Validation loss 0.5254170149564743, Validation accuracy 0.8280675560235977
Epoch 12, Train loss 0.38898283293978736, Train accuracy 0.8633416193452749, Validation loss 0.44493617713451383, Validation accuracy 0.849827665090561
Validation accuracy increased from 0.83 to 0.85
Epoch 13, Train loss 0.3706925379281694, Train accuracy 0.8689541901377115, Validation loss 0.5266349196434021, Validation accuracy 0.8323874086141586
Epoch 14, Train loss 0.3595806309445338, Train accuracy 0.8738680752840909, Validation loss 0.5534141734242439, Validation accuracy 0.8324103862047195
Epoch 15, Train loss 0.3351192506538196, Train accuracy 0.8808815696022727, Validation loss 0.5891967982053756, Validation accuracy 0.8135799646377564
Epoch 16, Train loss 0.3272387116131457, Train accuracy 0.8857421875, Validation loss 0.4410907804965973, Validation accuracy 0.85078125
Validation accuracy increased from 0.85 to 0.85
Epoch 17, Train loss 0.30469342617487366, Train accuracy 0.8930477625267073, Validation loss 0.6189516469836235, Validation accuracy 0.8031364887952804
Epoch 18, Train loss 0.2898305921222676, Train accuracy 0.8974058946425264, Validation loss 0.47789823561906813, Validation accuracy 0.8452091008424759
Epoch 19, Train loss 0.27654219461096957, Train accuracy 0.9038547585633668, Validation loss 0.5126051053404808, Validation accuracy 0.8413947612047196
Epoch 20, Train loss 0.20391606641086665, Train accuracy 0.9301775568588213, Validation loss 0.35873794108629226, Validation accuracy 0.8827665448188782
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.18063913692127576, Train accuracy 0.9385955255817283, Validation loss 0.35512374341487885, Validation accuracy 0.8872357547283173
Validation accuracy increased from 0.88 to 0.89
Epoch 22, Train loss 0.1693070410242812, Train accuracy 0.942739701745185, Validation loss 0.36206226497888566, Validation accuracy 0.8888442099094391
Validation accuracy increased from 0.89 to 0.89
Epoch 23, Train loss 0.1609085465950722, Train accuracy 0.9437792968343605, Validation loss 0.3730384767055511, Validation accuracy 0.8835477948188781
Epoch 24, Train loss 0.15388046429407867, Train accuracy 0.9463760653002695, Validation loss 0.35269171223044393, Validation accuracy 0.8883961409330368
Epoch 25, Train loss 0.1452613941563124, Train accuracy 0.9502503550188108, Validation loss 0.3646380215883255, Validation accuracy 0.8866727948188782
Epoch 26, Train loss 0.1369229954752055, Train accuracy 0.9525621448728171, Validation loss 0.36400746554136276, Validation accuracy 0.88828125
Epoch 27, Train loss 0.13728049321269448, Train accuracy 0.9524005681953647, Validation loss 0.4119443789124489, Validation accuracy 0.875218290090561
Epoch 28, Train loss 0.1276793281378394, Train accuracy 0.9560431462119926, Validation loss 0.39723134189844134, Validation accuracy 0.8837201297283173
Epoch 29, Train loss 0.12462442723864858, Train accuracy 0.9568261717530814, Validation loss 0.4015156850218773, Validation accuracy 0.8827665448188782
Epoch 30, Train loss 0.11574752870100466, Train accuracy 0.9598322087390856, Validation loss 0.4514193445444107, Validation accuracy 0.8718979775905609
Epoch 31, Train loss 0.11241069808602333, Train accuracy 0.9618670097128912, Validation loss 0.447561539709568, Validation accuracy 0.87265625
Epoch 32, Train loss 0.108650458405133, Train accuracy 0.963900035416538, Validation loss 0.40825845301151276, Validation accuracy 0.8873046875
Epoch 33, Train loss 0.10375314650379798, Train accuracy 0.964739879085259, Validation loss 0.4817301481962204, Validation accuracy 0.8691636025905609
Epoch 34, Train loss 0.1004280148878355, Train accuracy 0.9653329188850793, Validation loss 0.4390011951327324, Validation accuracy 0.8773897051811218
Epoch 35, Train loss 0.09908768706108359, Train accuracy 0.9648091261359778, Validation loss 0.3965922951698303, Validation accuracy 0.8886029422283173
Epoch 36, Train loss 0.09273158212785017, Train accuracy 0.9689923650161787, Validation loss 0.4311864972114563, Validation accuracy 0.8835018396377563
Epoch 37, Train loss 0.08881220094520938, Train accuracy 0.9692009941420772, Validation loss 0.44873363226652146, Validation accuracy 0.879124540090561
Epoch 38, Train loss 0.08711716056462716, Train accuracy 0.970364879139445, Validation loss 0.4383512020111084, Validation accuracy 0.8827205896377563
Epoch 39, Train loss 0.08273788617754524, Train accuracy 0.9717569246210835, Validation loss 0.5160307720303535, Validation accuracy 0.8666819840669632
Epoch 40, Train loss 0.06023161817045713, Train accuracy 0.9810937497426163, Validation loss 0.3798844628036022, Validation accuracy 0.8952435672283172
Validation accuracy increased from 0.89 to 0.90
Epoch 41, Train loss 0.05222491954918951, Train accuracy 0.9853773079812527, Validation loss 0.3848577797412872, Validation accuracy 0.8942440271377563
Epoch 42, Train loss 0.04905519310638986, Train accuracy 0.986328125, Validation loss 0.39082363024353983, Validation accuracy 0.8944163590669632
Epoch 43, Train loss 0.04880377103108913, Train accuracy 0.9853169386359778, Validation loss 0.39981997311115264, Validation accuracy 0.8926585465669632
Epoch 44, Train loss 0.04583049041684717, Train accuracy 0.9872833805328066, Validation loss 0.38851816952228546, Validation accuracy 0.8977136939764023
Validation accuracy increased from 0.90 to 0.90
Epoch 45, Train loss 0.043546392995102164, Train accuracy 0.9878151633522727, Validation loss 0.38373614475131035, Validation accuracy 0.8984949439764023
Validation accuracy increased from 0.90 to 0.90
Epoch 46, Train loss 0.04219252659558234, Train accuracy 0.9882910153405233, Validation loss 0.39087496474385264, Validation accuracy 0.8963694840669632
Epoch 47, Train loss 0.04066758367910304, Train accuracy 0.9886337000538002, Validation loss 0.39205809086561205, Validation accuracy 0.8967830896377563
Epoch 48, Train loss 0.041224264931357044, Train accuracy 0.9881516332653436, Validation loss 0.3985196977853775, Validation accuracy 0.8963694840669632
Epoch 49, Train loss 0.03809424287597225, Train accuracy 0.9900727983225476, Validation loss 0.3939222007989883, Validation accuracy 0.8958065271377563
Epoch 50, Train loss 0.03844604841221801, Train accuracy 0.9894992895424366, Validation loss 0.40035322606563567, Validation accuracy 0.8946576297283173
Epoch 51, Train loss 0.03710223579863933, Train accuracy 0.9896954900839112, Validation loss 0.3972965680062771, Validation accuracy 0.8929457724094391
Epoch 52, Train loss 0.036028814105189995, Train accuracy 0.9899715906517073, Validation loss 0.395248019695282, Validation accuracy 0.8938534021377563
Epoch 53, Train loss 0.03558958577394316, Train accuracy 0.9904438917609778, Validation loss 0.39380580112338065, Validation accuracy 0.8954848349094391
Epoch 54, Train loss 0.03349186296426607, Train accuracy 0.9910493608225476, Validation loss 0.39659540355205536, Validation accuracy 0.8985868573188782
Validation accuracy increased from 0.90 to 0.90
Epoch 55, Train loss 0.031795413302130655, Train accuracy 0.9917693534357981, Validation loss 0.42206971347332, Validation accuracy 0.8930261939764023
Epoch 56, Train loss 0.03273674828233197, Train accuracy 0.9912997159090909, Validation loss 0.40750088840723037, Validation accuracy 0.8960248172283173
Epoch 57, Train loss 0.031153754288838667, Train accuracy 0.9914648434655233, Validation loss 0.4021503232419491, Validation accuracy 0.8979549646377564
Epoch 58, Train loss 0.03089354740222916, Train accuracy 0.9919247156517073, Validation loss 0.4108347840607166, Validation accuracy 0.8935546875
Epoch 59, Train loss 0.0304896455808458, Train accuracy 0.9918927557089112, Validation loss 0.41408745646476747, Validation accuracy 0.8938534021377563
Epoch 60, Train loss 0.02692952254173261, Train accuracy 0.993538707156073, Validation loss 0.40093210339546204, Validation accuracy 0.8983455896377563
Epoch 61, Train loss 0.02527478542073037, Train accuracy 0.9941503903405233, Validation loss 0.4012206122279167, Validation accuracy 0.8960018396377564
Epoch 62, Train loss 0.023404557120308957, Train accuracy 0.9949840198863636, Validation loss 0.40179207623004914, Validation accuracy 0.8971507340669632
Epoch 63, Train loss 0.024683732782829215, Train accuracy 0.9941885650835254, Validation loss 0.4046564295887947, Validation accuracy 0.8960477948188782
Epoch 64, Train loss 0.023959889420604504, Train accuracy 0.9944105111062527, Validation loss 0.39838068187236786, Validation accuracy 0.8985868573188782
Validation accuracy increased from 0.90 to 0.90
Epoch 65, Train loss 0.023310062221505425, Train accuracy 0.9950727982954546, Validation loss 0.4052390828728676, Validation accuracy 0.8989315271377564
Validation accuracy increased from 0.90 to 0.90
Epoch 66, Train loss 0.022341304273471575, Train accuracy 0.9952725497159091, Validation loss 0.4030099704861641, Validation accuracy 0.8954159021377563
Epoch 67, Train loss 0.024180079662156375, Train accuracy 0.9943341619589112, Validation loss 0.3979796476662159, Validation accuracy 0.8989315271377564
Validation accuracy increased from 0.90 to 0.90
Epoch 68, Train loss 0.02455431450983848, Train accuracy 0.9944673295725476, Validation loss 0.40539164245128634, Validation accuracy 0.9004940271377564
Validation accuracy increased from 0.90 to 0.90
Epoch 69, Train loss 0.023120220004453917, Train accuracy 0.9947620738636364, Validation loss 0.4082987576723099, Validation accuracy 0.8973690271377563
Epoch 0, Train loss 1.5867395610971884, Train accuracy 0.40844815326007927, Validation loss 1.4938621819019318, Validation accuracy 0.4631433829665184
Validation accuracy increased from 0.00 to 0.46
Epoch 1, Train loss 1.1289920624006877, Train accuracy 0.5903924005952749, Validation loss 1.2704717457294463, Validation accuracy 0.5772058814764023
Validation accuracy increased from 0.46 to 0.58
Epoch 2, Train loss 0.9180896583605896, Train accuracy 0.6738236861472781, Validation loss 0.8376654744148254, Validation accuracy 0.7001953125
Validation accuracy increased from 0.58 to 0.70
Epoch 3, Train loss 0.795860306783156, Train accuracy 0.7177139557898045, Validation loss 0.8526960879564285, Validation accuracy 0.7006893396377564
Validation accuracy increased from 0.70 to 0.70
Epoch 4, Train loss 0.7047852071171458, Train accuracy 0.7519522370262579, Validation loss 0.76125068962574, Validation accuracy 0.7416704952716827
Validation accuracy increased from 0.70 to 0.74
Epoch 5, Train loss 0.6402391391721639, Train accuracy 0.7711772014471617, Validation loss 0.8030896306037902, Validation accuracy 0.7368681073188782
Epoch 6, Train loss 0.5860170970924876, Train accuracy 0.7957830252972516, Validation loss 0.5979104578495026, Validation accuracy 0.7885340064764023
Validation accuracy increased from 0.74 to 0.79
Epoch 7, Train loss 0.5531144372441552, Train accuracy 0.8060822087255392, Validation loss 0.8252588599920273, Validation accuracy 0.7270450383424759
Epoch 8, Train loss 0.5196356477046554, Train accuracy 0.8174564984034408, Validation loss 0.6335247218608856, Validation accuracy 0.7781364887952804
Epoch 9, Train loss 0.48916542022065684, Train accuracy 0.8280983662063425, Validation loss 0.57273980230093, Validation accuracy 0.8098460465669632
Validation accuracy increased from 0.79 to 0.81
Epoch 10, Train loss 0.46335968747735023, Train accuracy 0.8379261361604388, Validation loss 0.5957059741020203, Validation accuracy 0.8019875913858414
Epoch 11, Train loss 0.44826121001758357, Train accuracy 0.841791548173536, Validation loss 0.5632063433527946, Validation accuracy 0.8076746314764023
Epoch 12, Train loss 0.4208922108465975, Train accuracy 0.8527237214148045, Validation loss 0.5173710033297538, Validation accuracy 0.8331227034330368
Validation accuracy increased from 0.81 to 0.83
Epoch 13, Train loss 0.4049788217314265, Train accuracy 0.8578755327246406, Validation loss 0.6108368933200836, Validation accuracy 0.8046989887952805
Epoch 14, Train loss 0.38613583613187075, Train accuracy 0.8650656958872621, Validation loss 0.5664655849337578, Validation accuracy 0.8158088237047195
Epoch 15, Train loss 0.3763465461405841, Train accuracy 0.8675177554515275, Validation loss 0.5058761328458786, Validation accuracy 0.8351447612047196
Validation accuracy increased from 0.83 to 0.84
Epoch 16, Train loss 0.35659043135290797, Train accuracy 0.8748224431818182, Validation loss 0.4469865709543228, Validation accuracy 0.8489430159330368
Validation accuracy increased from 0.84 to 0.85
Epoch 17, Train loss 0.34251515330238774, Train accuracy 0.8797567469829862, Validation loss 0.5386669248342514, Validation accuracy 0.8251608461141586
Epoch 18, Train loss 0.33432847896421497, Train accuracy 0.8823757100511681, Validation loss 0.6371574252843857, Validation accuracy 0.8134650737047195
Epoch 19, Train loss 0.32096206837079744, Train accuracy 0.8868856531652537, Validation loss 0.4466944620013237, Validation accuracy 0.8474034935235977
Epoch 20, Train loss 0.25137999128888955, Train accuracy 0.9120987213470719, Validation loss 0.34796676263213155, Validation accuracy 0.8836626827716827
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.23278259553692557, Train accuracy 0.9186807528815486, Validation loss 0.3477414265275002, Validation accuracy 0.8837201297283173
Validation accuracy increased from 0.88 to 0.88
Epoch 22, Train loss 0.22282725411721252, Train accuracy 0.9231933592395349, Validation loss 0.3658856265246868, Validation accuracy 0.8772173702716828
Epoch 23, Train loss 0.21414963528513908, Train accuracy 0.9254794032736258, Validation loss 0.3607876770198345, Validation accuracy 0.88125
Epoch 24, Train loss 0.20983136538416147, Train accuracy 0.9267604757439006, Validation loss 0.3783044211566448, Validation accuracy 0.8783662676811218
Epoch 25, Train loss 0.20434194159778682, Train accuracy 0.9288361150432717, Validation loss 0.35851155817508695, Validation accuracy 0.8818129599094391
Epoch 26, Train loss 0.19934364298189228, Train accuracy 0.9299680397591807, Validation loss 0.35557579025626185, Validation accuracy 0.8863051474094391
Validation accuracy increased from 0.88 to 0.89
Epoch 27, Train loss 0.1954113438048146, Train accuracy 0.9309037639336153, Validation loss 0.373614551872015, Validation accuracy 0.8833295047283173
Epoch 28, Train loss 0.18915712316943842, Train accuracy 0.9335040836171671, Validation loss 0.34710114225745203, Validation accuracy 0.8897748172283173
Validation accuracy increased from 0.89 to 0.89
Epoch 29, Train loss 0.1870853014459664, Train accuracy 0.9345348010008986, Validation loss 0.37198284417390826, Validation accuracy 0.8812729775905609
Epoch 30, Train loss 0.18169182873415676, Train accuracy 0.9355522014878013, Validation loss 0.3691505201160908, Validation accuracy 0.8831571698188782
Epoch 31, Train loss 0.1768630560995503, Train accuracy 0.9384179687635466, Validation loss 0.3713546819984913, Validation accuracy 0.8818589150905609
Epoch 32, Train loss 0.1731641908514906, Train accuracy 0.93950905515389, Validation loss 0.3667883202433586, Validation accuracy 0.8849149823188782
Epoch 33, Train loss 0.1653478513048454, Train accuracy 0.9424351917749102, Validation loss 0.3743036188185215, Validation accuracy 0.8827205896377563
Epoch 34, Train loss 0.16276438009332528, Train accuracy 0.9432217681949789, Validation loss 0.4046908736228943, Validation accuracy 0.8765395224094391
Epoch 35, Train loss 0.15473460503430528, Train accuracy 0.9452254971997305, Validation loss 0.3719785243272781, Validation accuracy 0.8862362146377564
Epoch 36, Train loss 0.1557413445446979, Train accuracy 0.9452849785712633, Validation loss 0.37513936385512353, Validation accuracy 0.8856962323188782
Epoch 37, Train loss 0.1520314970985055, Train accuracy 0.9468448151918974, Validation loss 0.38399681225419047, Validation accuracy 0.8815716922283172
Epoch 38, Train loss 0.14863453708081084, Train accuracy 0.9472132457250898, Validation loss 0.3837748639285564, Validation accuracy 0.8800551474094391
Epoch 39, Train loss 0.14691578448665413, Train accuracy 0.9474414062093605, Validation loss 0.41420748382806777, Validation accuracy 0.8800551474094391
Epoch 40, Train loss 0.12066941031000832, Train accuracy 0.958148082210259, Validation loss 0.359280813485384, Validation accuracy 0.8913602948188781
Validation accuracy increased from 0.89 to 0.89
Epoch 41, Train loss 0.11193859534846111, Train accuracy 0.9613165838474577, Validation loss 0.3501799196004868, Validation accuracy 0.8948299646377563
Validation accuracy increased from 0.89 to 0.89
Epoch 42, Train loss 0.10702605553987352, Train accuracy 0.9631933593614534, Validation loss 0.3737347461283207, Validation accuracy 0.8880170047283172
Epoch 43, Train loss 0.10326270219361917, Train accuracy 0.964495738460259, Validation loss 0.35569540560245516, Validation accuracy 0.8969554215669632
Validation accuracy increased from 0.89 to 0.90
Epoch 44, Train loss 0.10101678666912696, Train accuracy 0.966059126298536, Validation loss 0.36269499734044075, Validation accuracy 0.8936121314764023
Epoch 45, Train loss 0.0999097223393619, Train accuracy 0.9658815694803541, Validation loss 0.3684916876256466, Validation accuracy 0.8889705896377563
Epoch 46, Train loss 0.09682133296419951, Train accuracy 0.9669628905301745, Validation loss 0.37402097061276435, Validation accuracy 0.8940716922283173
Epoch 47, Train loss 0.09495177217335864, Train accuracy 0.9681258875538002, Validation loss 0.3683341793715954, Validation accuracy 0.8928998172283172
Epoch 48, Train loss 0.09233835180798038, Train accuracy 0.9690580608492548, Validation loss 0.371164134144783, Validation accuracy 0.8926815271377564
Epoch 49, Train loss 0.09050875028002668, Train accuracy 0.9698730466718023, Validation loss 0.36906728222966195, Validation accuracy 0.8911420047283173
Epoch 50, Train loss 0.08914813590871001, Train accuracy 0.9700479402460835, Validation loss 0.37684658393263815, Validation accuracy 0.8909466922283172
Epoch 51, Train loss 0.08976165863515978, Train accuracy 0.9696990410712633, Validation loss 0.36870400086045263, Validation accuracy 0.8955882340669632
Epoch 52, Train loss 0.08676633651537652, Train accuracy 0.9711257100782611, Validation loss 0.383710890263319, Validation accuracy 0.8916819840669632
Epoch 53, Train loss 0.09017462162724273, Train accuracy 0.9689444245939905, Validation loss 0.37525302097201346, Validation accuracy 0.8967830896377563
Epoch 54, Train loss 0.084006325235929, Train accuracy 0.9722727272998203, Validation loss 0.3773662127554417, Validation accuracy 0.8950252771377564
Epoch 55, Train loss 0.08215365055101839, Train accuracy 0.9724227626892653, Validation loss 0.38790230005979537, Validation accuracy 0.8944623172283173
Epoch 56, Train loss 0.08389793552288954, Train accuracy 0.9711443534628912, Validation loss 0.3964169532060623, Validation accuracy 0.8909696698188782
Epoch 57, Train loss 0.07940774707292969, Train accuracy 0.9734685722399842, Validation loss 0.3878841921687126, Validation accuracy 0.8920726090669632
Epoch 58, Train loss 0.07856440247798507, Train accuracy 0.9739248932085254, Validation loss 0.3974747806787491, Validation accuracy 0.8927045047283173
Epoch 59, Train loss 0.08185085622509095, Train accuracy 0.9716708094558932, Validation loss 0.38941976651549337, Validation accuracy 0.8928079038858414
Epoch 60, Train loss 0.07287394283974374, Train accuracy 0.9758496091447093, Validation loss 0.38281615227460863, Validation accuracy 0.8945886939764023
Epoch 61, Train loss 0.06892330023798753, Train accuracy 0.9769122868098996, Validation loss 0.3850547783076763, Validation accuracy 0.8941980689764023
Epoch 62, Train loss 0.06893592812544243, Train accuracy 0.9775870025835254, Validation loss 0.38544144108891487, Validation accuracy 0.8963694840669632
Epoch 63, Train loss 0.06858625271442262, Train accuracy 0.9772221236066385, Validation loss 0.3869569331407547, Validation accuracy 0.8928998172283172
Epoch 64, Train loss 0.06524012043056163, Train accuracy 0.9793723364445296, Validation loss 0.384597160667181, Validation accuracy 0.8936351090669632
Epoch 65, Train loss 0.0673550815871832, Train accuracy 0.9781134585765275, Validation loss 0.38370453491806983, Validation accuracy 0.8955652564764023
Epoch 66, Train loss 0.06512311858717691, Train accuracy 0.9790518463335254, Validation loss 0.38689628392457964, Validation accuracy 0.8969324439764023
Epoch 67, Train loss 0.0638809118589217, Train accuracy 0.9796608662740751, Validation loss 0.38819999545812606, Validation accuracy 0.8932215064764023
Epoch 68, Train loss 0.06366709072608501, Train accuracy 0.9802627841180022, Validation loss 0.3930920369923115, Validation accuracy 0.8959788590669632
Epoch 69, Train loss 0.0618804140990092, Train accuracy 0.9808780181814324, Validation loss 0.39168780520558355, Validation accuracy 0.8928998172283172
Test loss: 0.4038114078342915 Test accuracy: 0.8763671875  resnet10_SGD_0.01
Test loss: 0.37442749068140985 Test accuracy: 0.91435546875  resnet18_SGD_0.01
Test loss: 0.39607927575707436 Test accuracy: 0.8708984375  resnet12_SGD_0.01
Test loss: 0.43575260117650033 Test accuracy: 0.89375  resnet14_4_SGD_0.01
Test loss: 0.4047935590147972 Test accuracy: 0.88720703125  resnet14_5_SGD_0.01
Epoch 0, Train loss 1.9900515831329606, Train accuracy 0.28850142048163846, Validation loss 1.7117799520492554, Validation accuracy 0.3621323525905609
Validation accuracy increased from 0.00 to 0.36
Epoch 1, Train loss 1.6355142816901207, Train accuracy 0.4020481179045005, Validation loss 1.5462426781654357, Validation accuracy 0.4380055144429207
Validation accuracy increased from 0.36 to 0.44
Epoch 2, Train loss 1.5097990157929333, Train accuracy 0.4517427200282162, Validation loss 1.4354585707187653, Validation accuracy 0.47524126917123793
Validation accuracy increased from 0.44 to 0.48
Epoch 3, Train loss 1.4311267523603006, Train accuracy 0.48037109371613373, Validation loss 1.3717133402824402, Validation accuracy 0.5013901650905609
Validation accuracy increased from 0.48 to 0.50
Epoch 4, Train loss 1.376699760556221, Train accuracy 0.5000346235253594, Validation loss 1.3274133801460266, Validation accuracy 0.5169692099094391
Validation accuracy increased from 0.50 to 0.52
Epoch 5, Train loss 1.3307083865458316, Train accuracy 0.5198899146846749, Validation loss 1.303587555885315, Validation accuracy 0.5303538590669632
Validation accuracy increased from 0.52 to 0.53
Epoch 6, Train loss 1.2899226180531762, Train accuracy 0.5368465908210386, Validation loss 1.2492042481899261, Validation accuracy 0.5527228862047195
Validation accuracy increased from 0.53 to 0.55
Epoch 7, Train loss 1.2560610561208292, Train accuracy 0.5506622869182717, Validation loss 1.2390482664108275, Validation accuracy 0.5523092836141587
Epoch 8, Train loss 1.2265311201865023, Train accuracy 0.5613538707521829, Validation loss 1.198560458421707, Validation accuracy 0.5764820784330368
Validation accuracy increased from 0.55 to 0.58
Epoch 9, Train loss 1.1953434666449374, Train accuracy 0.572377485646443, Validation loss 1.166188544034958, Validation accuracy 0.5813419133424759
Validation accuracy increased from 0.58 to 0.58
Epoch 10, Train loss 1.1701353978026996, Train accuracy 0.5829314630139958, Validation loss 1.1437630891799926, Validation accuracy 0.5907398909330368
Validation accuracy increased from 0.58 to 0.59
Epoch 11, Train loss 1.1466485800390893, Train accuracy 0.5930140269073573, Validation loss 1.1449220776557922, Validation accuracy 0.5924057900905609
Validation accuracy increased from 0.59 to 0.59
Epoch 12, Train loss 1.1216596679931337, Train accuracy 0.6015340909361839, Validation loss 1.1150815576314925, Validation accuracy 0.6009995400905609
Validation accuracy increased from 0.59 to 0.60
Epoch 13, Train loss 1.1012719541110776, Train accuracy 0.6089435368776321, Validation loss 1.084195038676262, Validation accuracy 0.6131778508424759
Validation accuracy increased from 0.60 to 0.61
Epoch 14, Train loss 1.0805410912091082, Train accuracy 0.6168936433439905, Validation loss 1.0913341104984284, Validation accuracy 0.6118451297283173
Epoch 15, Train loss 1.0627179741859436, Train accuracy 0.6240518465638161, Validation loss 1.0418089628219604, Validation accuracy 0.632594209909439
Validation accuracy increased from 0.61 to 0.63
Epoch 16, Train loss 1.0440620150078426, Train accuracy 0.6298632811416279, Validation loss 1.0307408690452575, Validation accuracy 0.6364774823188781
Validation accuracy increased from 0.63 to 0.64
Epoch 17, Train loss 1.0255951542745938, Train accuracy 0.6369477981193499, Validation loss 1.0189078509807588, Validation accuracy 0.6421760112047196
Validation accuracy increased from 0.64 to 0.64
Epoch 18, Train loss 1.0091651684858582, Train accuracy 0.6446768465367231, Validation loss 1.0031376212835312, Validation accuracy 0.6500344663858414
Validation accuracy increased from 0.64 to 0.65
Epoch 19, Train loss 0.9976494837213646, Train accuracy 0.6483496092259884, Validation loss 1.010832631587982, Validation accuracy 0.6512063413858413
Validation accuracy increased from 0.65 to 0.65
Epoch 20, Train loss 0.9769219661300833, Train accuracy 0.658588423309001, Validation loss 0.970477482676506, Validation accuracy 0.6608226090669632
Validation accuracy increased from 0.65 to 0.66
Epoch 21, Train loss 0.9697096933695403, Train accuracy 0.6599280895157293, Validation loss 0.965026980638504, Validation accuracy 0.6640510112047195
Validation accuracy increased from 0.66 to 0.66
Epoch 22, Train loss 0.9660598960789767, Train accuracy 0.661606889218092, Validation loss 0.9691948294639587, Validation accuracy 0.6628561586141586
Epoch 23, Train loss 0.9573066742582754, Train accuracy 0.6630237925459038, Validation loss 0.9527556777000428, Validation accuracy 0.6669806987047195
Validation accuracy increased from 0.66 to 0.67
Epoch 24, Train loss 0.9523513618518006, Train accuracy 0.6657040125944398, Validation loss 0.9463115811347962, Validation accuracy 0.6716222435235977
Validation accuracy increased from 0.67 to 0.67
Epoch 25, Train loss 0.9491517716510729, Train accuracy 0.666889204559001, Validation loss 0.9471526920795441, Validation accuracy 0.6688878685235977
Epoch 26, Train loss 0.9426733919165351, Train accuracy 0.6695658733898943, Validation loss 0.9417464733123779, Validation accuracy 0.6677619487047195
Epoch 27, Train loss 0.939535031941804, Train accuracy 0.6706409799781713, Validation loss 0.9385177344083786, Validation accuracy 0.6738740801811218
Validation accuracy increased from 0.67 to 0.67
Epoch 28, Train loss 0.9379656172611497, Train accuracy 0.6704438918016173, Validation loss 0.9307014226913453, Validation accuracy 0.6749655336141587
Validation accuracy increased from 0.67 to 0.67
Epoch 29, Train loss 0.9322903738780455, Train accuracy 0.6702769886363636, Validation loss 0.9288165032863617, Validation accuracy 0.6771369487047195
Validation accuracy increased from 0.67 to 0.68
Epoch 30, Train loss 0.9271655130115423, Train accuracy 0.6742480468343605, Validation loss 0.9310908496379853, Validation accuracy 0.6757238060235977
Epoch 31, Train loss 0.9239523898471486, Train accuracy 0.6746253550729968, Validation loss 0.9208329170942307, Validation accuracy 0.6796530336141586
Validation accuracy increased from 0.68 to 0.68
Epoch 32, Train loss 0.9186268787492405, Train accuracy 0.6806223365393552, Validation loss 0.9165229290723801, Validation accuracy 0.6852941185235977
Validation accuracy increased from 0.68 to 0.69
Epoch 33, Train loss 0.9138131761415438, Train accuracy 0.6799200993369926, Validation loss 0.9190347552299499, Validation accuracy 0.6789981633424759
Epoch 34, Train loss 0.9080887900834734, Train accuracy 0.6818581321700052, Validation loss 0.9142659157514572, Validation accuracy 0.6803193926811218
Epoch 35, Train loss 0.9039734798398885, Train accuracy 0.6832191050052643, Validation loss 0.912106791138649, Validation accuracy 0.6858800560235977
Validation accuracy increased from 0.69 to 0.69
Epoch 36, Train loss 0.9030236693268473, Train accuracy 0.6838929331438108, Validation loss 0.8995006889104843, Validation accuracy 0.6878331810235977
Validation accuracy increased from 0.69 to 0.69
Epoch 37, Train loss 0.8969158970496871, Train accuracy 0.6878879615529017, Validation loss 0.9019931495189667, Validation accuracy 0.6872242659330368
Epoch 38, Train loss 0.891858153722503, Train accuracy 0.6874831318855286, Validation loss 0.895722621679306, Validation accuracy 0.6903262883424759
Validation accuracy increased from 0.69 to 0.69
Epoch 39, Train loss 0.8898511190306057, Train accuracy 0.6876944245939905, Validation loss 0.8968313455581665, Validation accuracy 0.6913258284330368
Validation accuracy increased from 0.69 to 0.69
Epoch 40, Train loss 0.8828976435417478, Train accuracy 0.6930699571967125, Validation loss 0.8862527012825012, Validation accuracy 0.6905675560235978
Epoch 41, Train loss 0.8818465721878138, Train accuracy 0.6897594105790962, Validation loss 0.8848126381635666, Validation accuracy 0.6928653508424759
Validation accuracy increased from 0.69 to 0.69
Epoch 42, Train loss 0.8810325115919113, Train accuracy 0.6897674003107981, Validation loss 0.8866455048322678, Validation accuracy 0.6934742659330368
Validation accuracy increased from 0.69 to 0.69
Epoch 43, Train loss 0.8789900321174752, Train accuracy 0.6930814984847199, Validation loss 0.8846011370420456, Validation accuracy 0.6908892452716827
Epoch 44, Train loss 0.8759638474068858, Train accuracy 0.6938085935332559, Validation loss 0.8823299705982208, Validation accuracy 0.6930606633424758
Epoch 45, Train loss 0.8758558607236906, Train accuracy 0.6937659799375318, Validation loss 0.8823361903429031, Validation accuracy 0.6945772051811219
Validation accuracy increased from 0.69 to 0.69
Epoch 46, Train loss 0.8717004504393447, Train accuracy 0.6952903053977273, Validation loss 0.8818225651979447, Validation accuracy 0.6951631426811218
Validation accuracy increased from 0.69 to 0.70
Epoch 47, Train loss 0.8717064132744615, Train accuracy 0.6952068534764376, Validation loss 0.8815156042575836, Validation accuracy 0.6946001827716828
Epoch 48, Train loss 0.8726989867335017, Train accuracy 0.6943314986472781, Validation loss 0.8804612934589386, Validation accuracy 0.6944048702716827
Epoch 49, Train loss 0.871608575975353, Train accuracy 0.6954687498509884, Validation loss 0.877122899889946, Validation accuracy 0.6957950383424759
Validation accuracy increased from 0.70 to 0.70
Epoch 50, Train loss 0.8709147250787779, Train accuracy 0.6945108307356184, Validation loss 0.8765636891126632, Validation accuracy 0.6955997258424759
Epoch 51, Train loss 0.8666519150137901, Train accuracy 0.699457563798536, Validation loss 0.8748638212680817, Validation accuracy 0.6940602034330368
Epoch 52, Train loss 0.8671550046313893, Train accuracy 0.6966335224834356, Validation loss 0.8760372310876846, Validation accuracy 0.6947725176811218
Epoch 53, Train loss 0.8657977655529976, Train accuracy 0.6985706676813689, Validation loss 0.874974536895752, Validation accuracy 0.6967716008424759
Validation accuracy increased from 0.70 to 0.70
Epoch 54, Train loss 0.8612546036866578, Train accuracy 0.6999076703055338, Validation loss 0.8730405539274215, Validation accuracy 0.7006318926811218
Validation accuracy increased from 0.70 to 0.70
Epoch 55, Train loss 0.8647033927792852, Train accuracy 0.6974760297347199, Validation loss 0.8720299690961838, Validation accuracy 0.6982881426811218
Epoch 56, Train loss 0.861374939029867, Train accuracy 0.6986150568859144, Validation loss 0.8704298675060272, Validation accuracy 0.6977251827716827
Epoch 57, Train loss 0.8602584790099751, Train accuracy 0.7002991830760782, Validation loss 0.8708885878324508, Validation accuracy 0.6952320784330368
Epoch 58, Train loss 0.8581433739851821, Train accuracy 0.700927734375, Validation loss 0.8685226440429688, Validation accuracy 0.6984834551811219
Epoch 59, Train loss 0.8604788363657214, Train accuracy 0.701199396090074, Validation loss 0.8664630711078644, Validation accuracy 0.6965762883424759
Epoch 60, Train loss 0.8533728864382614, Train accuracy 0.7006214487959038, Validation loss 0.8666502714157105, Validation accuracy 0.6985294133424759
Epoch 61, Train loss 0.855549945411357, Train accuracy 0.6990713778544556, Validation loss 0.8653152346611023, Validation accuracy 0.6977711409330368
Epoch 62, Train loss 0.8546955555000089, Train accuracy 0.7029323506761681, Validation loss 0.8654926091432571, Validation accuracy 0.6990464150905609
Epoch 63, Train loss 0.8563134575431998, Train accuracy 0.7004003904082559, Validation loss 0.8643465548753738, Validation accuracy 0.6998276650905609
Epoch 64, Train loss 0.8551652478900823, Train accuracy 0.7008966617286205, Validation loss 0.8650643110275269, Validation accuracy 0.6996553301811218
Epoch 65, Train loss 0.8562543893402274, Train accuracy 0.7019087357277219, Validation loss 0.8641753524541855, Validation accuracy 0.7008272051811218
Validation accuracy increased from 0.70 to 0.70
Epoch 66, Train loss 0.8519827902994372, Train accuracy 0.7034454901110042, Validation loss 0.863163635134697, Validation accuracy 0.7006548702716827
Epoch 67, Train loss 0.8555143665183674, Train accuracy 0.7019779827784408, Validation loss 0.8628304570913314, Validation accuracy 0.6996553301811218
Epoch 68, Train loss 0.8525020195679232, Train accuracy 0.7030415480787103, Validation loss 0.8627546191215515, Validation accuracy 0.7019761025905609
Validation accuracy increased from 0.70 to 0.70
Epoch 69, Train loss 0.8522462015124884, Train accuracy 0.704129083590074, Validation loss 0.8636694878339768, Validation accuracy 0.6997242659330368
Epoch 0, Train loss 1.8000709448348393, Train accuracy 0.3393377130004493, Validation loss 1.5401166379451752, Validation accuracy 0.43309972435235977
Validation accuracy increased from 0.00 to 0.43
Epoch 1, Train loss 1.4411628686568954, Train accuracy 0.47030983662063425, Validation loss 1.3175992310047149, Validation accuracy 0.5219784021377564
Validation accuracy increased from 0.43 to 0.52
Epoch 2, Train loss 1.2981512742963703, Train accuracy 0.5284934304654598, Validation loss 1.2309187352657318, Validation accuracy 0.5629480689764023
Validation accuracy increased from 0.52 to 0.56
Epoch 3, Train loss 1.196425013244152, Train accuracy 0.5683069957250898, Validation loss 1.1375111520290375, Validation accuracy 0.5857077211141586
Validation accuracy increased from 0.56 to 0.59
Epoch 4, Train loss 1.1162798384373838, Train accuracy 0.5983993251892653, Validation loss 1.1089894592761993, Validation accuracy 0.6020680159330368
Validation accuracy increased from 0.59 to 0.60
Epoch 5, Train loss 1.0463475219228051, Train accuracy 0.6262926134196195, Validation loss 1.0596591740846635, Validation accuracy 0.6282054215669632
Validation accuracy increased from 0.60 to 0.63
Epoch 6, Train loss 0.9830868999389085, Train accuracy 0.6491264203055338, Validation loss 0.9597017467021942, Validation accuracy 0.6609949439764022
Validation accuracy increased from 0.63 to 0.66
Epoch 7, Train loss 0.9367620091546666, Train accuracy 0.6674067825078964, Validation loss 0.9050236910581588, Validation accuracy 0.6813878685235977
Validation accuracy increased from 0.66 to 0.68
Epoch 8, Train loss 0.8925864564424212, Train accuracy 0.6811230467124418, Validation loss 0.9314914911985397, Validation accuracy 0.6655330896377564
Epoch 9, Train loss 0.8440927792001854, Train accuracy 0.6980912641368129, Validation loss 0.9044902741909027, Validation accuracy 0.6790785849094391
Epoch 10, Train loss 0.810335545038635, Train accuracy 0.7158309658142653, Validation loss 0.8075205862522126, Validation accuracy 0.7150275737047196
Validation accuracy increased from 0.68 to 0.72
Epoch 11, Train loss 0.779222106730396, Train accuracy 0.7227397015826269, Validation loss 0.7900000154972077, Validation accuracy 0.7192555159330368
Validation accuracy increased from 0.72 to 0.72
Epoch 12, Train loss 0.7448693767867305, Train accuracy 0.7375550425865434, Validation loss 0.7948994129896164, Validation accuracy 0.7232651650905609
Validation accuracy increased from 0.72 to 0.72
Epoch 13, Train loss 0.7167095880616795, Train accuracy 0.7472860440611839, Validation loss 0.7412163466215134, Validation accuracy 0.7409122258424758
Validation accuracy increased from 0.72 to 0.74
Epoch 14, Train loss 0.685549358413978, Train accuracy 0.7582075636495244, Validation loss 0.7362627774477005, Validation accuracy 0.7448414534330368
Validation accuracy increased from 0.74 to 0.74
Epoch 15, Train loss 0.6583994821729985, Train accuracy 0.7687357951971617, Validation loss 0.6809333294630051, Validation accuracy 0.7627757340669632
Validation accuracy increased from 0.74 to 0.76
Epoch 16, Train loss 0.6393771847202019, Train accuracy 0.7753755324943499, Validation loss 0.7010528892278671, Validation accuracy 0.7535615801811218
Epoch 17, Train loss 0.6143040848387913, Train accuracy 0.7859827767718922, Validation loss 0.6688589572906494, Validation accuracy 0.7716796875
Validation accuracy increased from 0.76 to 0.77
Epoch 18, Train loss 0.5918626411055977, Train accuracy 0.7918545806949789, Validation loss 0.6509704887866974, Validation accuracy 0.7702665448188781
Epoch 19, Train loss 0.5723347839984027, Train accuracy 0.7999094460498203, Validation loss 0.642176941037178, Validation accuracy 0.7780790448188781
Validation accuracy increased from 0.77 to 0.78
Epoch 20, Train loss 0.5253636654127728, Train accuracy 0.8163006034764376, Validation loss 0.5899125441908837, Validation accuracy 0.7950022965669632
Validation accuracy increased from 0.78 to 0.80
Epoch 21, Train loss 0.5146855866028504, Train accuracy 0.821147904815999, Validation loss 0.5934827387332916, Validation accuracy 0.7956686586141586
Validation accuracy increased from 0.80 to 0.80
Epoch 22, Train loss 0.5046195413239978, Train accuracy 0.8240846944126216, Validation loss 0.5930032208561897, Validation accuracy 0.7951516538858414
Epoch 23, Train loss 0.499952128326351, Train accuracy 0.826654829423536, Validation loss 0.5797401890158653, Validation accuracy 0.7986213237047195
Validation accuracy increased from 0.80 to 0.80
Epoch 24, Train loss 0.48646778867326, Train accuracy 0.8313227983360941, Validation loss 0.586529441177845, Validation accuracy 0.8007467836141586
Validation accuracy increased from 0.80 to 0.80
Epoch 25, Train loss 0.48807520690289413, Train accuracy 0.8289666192775423, Validation loss 0.5895000755786896, Validation accuracy 0.8022058814764023
Validation accuracy increased from 0.80 to 0.80
Epoch 26, Train loss 0.4775278205898675, Train accuracy 0.8339062499051745, Validation loss 0.5729664996266365, Validation accuracy 0.8009880512952805
Epoch 27, Train loss 0.466962076892907, Train accuracy 0.8362340198999102, Validation loss 0.5743091493844986, Validation accuracy 0.8016659021377563
Epoch 28, Train loss 0.46107861890711566, Train accuracy 0.8417373932898045, Validation loss 0.5639165967702866, Validation accuracy 0.8058478862047196
Validation accuracy increased from 0.80 to 0.81
Epoch 29, Train loss 0.4556342673233964, Train accuracy 0.8431551845913584, Validation loss 0.5663129165768623, Validation accuracy 0.8066521137952805
Validation accuracy increased from 0.81 to 0.81
Epoch 30, Train loss 0.45264590497721324, Train accuracy 0.8421209159899842, Validation loss 0.5589275300502777, Validation accuracy 0.8079044133424759
Validation accuracy increased from 0.81 to 0.81
Epoch 31, Train loss 0.4431582386182113, Train accuracy 0.8455522016368129, Validation loss 0.5520372003316879, Validation accuracy 0.8085363060235977
Validation accuracy increased from 0.81 to 0.81
Epoch 32, Train loss 0.4384680791673335, Train accuracy 0.8470836291936311, Validation loss 0.553124375641346, Validation accuracy 0.8101217836141587
Validation accuracy increased from 0.81 to 0.81
Epoch 33, Train loss 0.43416660566898907, Train accuracy 0.8497238988903436, Validation loss 0.5573134914040565, Validation accuracy 0.8093175560235977
Epoch 34, Train loss 0.42825946533544496, Train accuracy 0.8533922230655496, Validation loss 0.5488466024398804, Validation accuracy 0.8101677387952805
Validation accuracy increased from 0.81 to 0.81
Epoch 35, Train loss 0.41866338286887517, Train accuracy 0.8560111861337315, Validation loss 0.5541663035750389, Validation accuracy 0.8093635112047195
Epoch 36, Train loss 0.4139712151478637, Train accuracy 0.8570916192098097, Validation loss 0.5496173813939095, Validation accuracy 0.8138786762952804
Validation accuracy increased from 0.81 to 0.81
Epoch 37, Train loss 0.410836735740304, Train accuracy 0.8586141690611839, Validation loss 0.547276172041893, Validation accuracy 0.8093635112047195
Epoch 38, Train loss 0.4006977431814779, Train accuracy 0.8617986505004492, Validation loss 0.5555534347891807, Validation accuracy 0.8116613060235978
Epoch 39, Train loss 0.39749949086796155, Train accuracy 0.8636647727001797, Validation loss 0.5385032340884208, Validation accuracy 0.8186925560235977
Validation accuracy increased from 0.81 to 0.82
Epoch 40, Train loss 0.38255893388255074, Train accuracy 0.8674511716447093, Validation loss 0.5253462255001068, Validation accuracy 0.8212316185235977
Validation accuracy increased from 0.82 to 0.82
Epoch 41, Train loss 0.38079473562538624, Train accuracy 0.8675150922076269, Validation loss 0.5299993351101875, Validation accuracy 0.8218405336141587
Validation accuracy increased from 0.82 to 0.82
Epoch 42, Train loss 0.37865843336013233, Train accuracy 0.8703400211578066, Validation loss 0.529509399831295, Validation accuracy 0.8179113060235977
Epoch 43, Train loss 0.37616157345473766, Train accuracy 0.8723517398942601, Validation loss 0.5278329461812973, Validation accuracy 0.8206686586141586
Epoch 44, Train loss 0.36999830502000725, Train accuracy 0.8725079900839112, Validation loss 0.5300850763916969, Validation accuracy 0.8208409935235977
Epoch 45, Train loss 0.37243023616346443, Train accuracy 0.8718847656114534, Validation loss 0.5297413319349289, Validation accuracy 0.8218405336141587
Validation accuracy increased from 0.82 to 0.82
Epoch 46, Train loss 0.3675326718525453, Train accuracy 0.8732208806005392, Validation loss 0.5281217053532601, Validation accuracy 0.8200597435235977
Epoch 47, Train loss 0.3664792688902129, Train accuracy 0.8750532669099894, Validation loss 0.525701554119587, Validation accuracy 0.8258501827716828
Validation accuracy increased from 0.82 to 0.83
Epoch 48, Train loss 0.360520794310353, Train accuracy 0.8763414418155496, Validation loss 0.5286559149622917, Validation accuracy 0.8229434758424758
Epoch 49, Train loss 0.36301954835653305, Train accuracy 0.8771271306005392, Validation loss 0.5248440250754356, Validation accuracy 0.8199103862047196
Epoch 50, Train loss 0.35943664457987656, Train accuracy 0.8755779472941702, Validation loss 0.528331683576107, Validation accuracy 0.8221852034330368
Epoch 51, Train loss 0.3568240658126094, Train accuracy 0.8771182528950952, Validation loss 0.5262342691421509, Validation accuracy 0.8241613060235977
Epoch 52, Train loss 0.35579977675595065, Train accuracy 0.8793146305463531, Validation loss 0.5275841489434242, Validation accuracy 0.8239430159330368
Epoch 53, Train loss 0.352887488393621, Train accuracy 0.8802379261363636, Validation loss 0.5315893307328224, Validation accuracy 0.8220358461141586
Epoch 54, Train loss 0.355563668449494, Train accuracy 0.8779456676407293, Validation loss 0.5222291693091392, Validation accuracy 0.8223805159330368
Epoch 55, Train loss 0.3520104004578157, Train accuracy 0.8796484375541861, Validation loss 0.5262776717543602, Validation accuracy 0.8212086409330368
Epoch 56, Train loss 0.34789104327898135, Train accuracy 0.8815083449537103, Validation loss 0.5277758717536927, Validation accuracy 0.8215762883424759
Epoch 57, Train loss 0.3457862590016289, Train accuracy 0.8831711645153436, Validation loss 0.5300800338387489, Validation accuracy 0.8253561586141587
Epoch 58, Train loss 0.3438546594909646, Train accuracy 0.8826091973619028, Validation loss 0.5307975172996521, Validation accuracy 0.8253561586141587
Epoch 59, Train loss 0.34071944577788765, Train accuracy 0.8844256035306237, Validation loss 0.5262210965156555, Validation accuracy 0.8247242659330368
Epoch 60, Train loss 0.33715411461889744, Train accuracy 0.8859517045996406, Validation loss 0.5226353734731675, Validation accuracy 0.8239430159330368
Epoch 61, Train loss 0.3375517615879124, Train accuracy 0.8851109729571776, Validation loss 0.5214750990271568, Validation accuracy 0.8266544133424759
Validation accuracy increased from 0.83 to 0.83
Epoch 62, Train loss 0.337398497895761, Train accuracy 0.8850062144073573, Validation loss 0.5214310690760613, Validation accuracy 0.8241383284330368
Epoch 63, Train loss 0.33627269230782986, Train accuracy 0.8844921873374418, Validation loss 0.5217857167124749, Validation accuracy 0.8260914534330368
Epoch 64, Train loss 0.33552164618264546, Train accuracy 0.8852095170454546, Validation loss 0.5212283551692962, Validation accuracy 0.8232077211141586
Epoch 65, Train loss 0.3317819561131976, Train accuracy 0.8872833807360042, Validation loss 0.5220510259270668, Validation accuracy 0.8260684758424759
Epoch 66, Train loss 0.33274949358945544, Train accuracy 0.8860973011363636, Validation loss 0.5223773747682572, Validation accuracy 0.8249195784330368
Epoch 67, Train loss 0.3321322047744285, Train accuracy 0.8865571733225476, Validation loss 0.5268942967057229, Validation accuracy 0.8233800560235978
Epoch 68, Train loss 0.33456801741637965, Train accuracy 0.8865500708872621, Validation loss 0.5252097323536873, Validation accuracy 0.8241383284330368
Epoch 69, Train loss 0.33082015304402873, Train accuracy 0.8875488279895349, Validation loss 0.5226262971758843, Validation accuracy 0.8251378685235977
Epoch 0, Train loss 2.0569328753785654, Train accuracy 0.2418927556242455, Validation loss 1.9043449580669403, Validation accuracy 0.28645450323820115
Validation accuracy increased from 0.00 to 0.29
Epoch 1, Train loss 1.8364471210674806, Train accuracy 0.3284357244318182, Validation loss 1.7740052223205567, Validation accuracy 0.3524241730570793
Validation accuracy increased from 0.29 to 0.35
Epoch 2, Train loss 1.727637042376128, Train accuracy 0.3721022726121274, Validation loss 1.6666721522808075, Validation accuracy 0.38723575323820114
Validation accuracy increased from 0.35 to 0.39
Epoch 3, Train loss 1.649794069880789, Train accuracy 0.39408735795454547, Validation loss 1.5839338839054107, Validation accuracy 0.4135569855570793
Validation accuracy increased from 0.39 to 0.41
Epoch 4, Train loss 1.5954892466014081, Train accuracy 0.41542524844408035, Validation loss 1.5384272336959839, Validation accuracy 0.4332146137952805
Validation accuracy increased from 0.41 to 0.43
Epoch 5, Train loss 1.5517269704829564, Train accuracy 0.42956942472268234, Validation loss 1.4842707335948944, Validation accuracy 0.45215992629528046
Validation accuracy increased from 0.43 to 0.45
Epoch 6, Train loss 1.5129491551355883, Train accuracy 0.44569868594408035, Validation loss 1.4643366813659668, Validation accuracy 0.46461397111415864
Validation accuracy increased from 0.45 to 0.46
Epoch 7, Train loss 1.4791661751541225, Train accuracy 0.46190074560317124, Validation loss 1.4298268496990203, Validation accuracy 0.4766773894429207
Validation accuracy increased from 0.46 to 0.48
Epoch 8, Train loss 1.4491937417875638, Train accuracy 0.47281250002031977, Validation loss 1.3916054964065552, Validation accuracy 0.49296875
Validation accuracy increased from 0.48 to 0.49
Epoch 9, Train loss 1.4262429150668057, Train accuracy 0.48023082383654336, Validation loss 1.3801641583442688, Validation accuracy 0.4980238974094391
Validation accuracy increased from 0.49 to 0.50
Epoch 10, Train loss 1.4003676541826942, Train accuracy 0.49115944586016913, Validation loss 1.3571474432945252, Validation accuracy 0.5112821698188782
Validation accuracy increased from 0.50 to 0.51
Epoch 11, Train loss 1.3786963732405142, Train accuracy 0.5007670454003594, Validation loss 1.3248397171497346, Validation accuracy 0.5239085465669632
Validation accuracy increased from 0.51 to 0.52
Epoch 12, Train loss 1.3597003959796645, Train accuracy 0.5089169032871723, Validation loss 1.3061571955680846, Validation accuracy 0.5326516538858413
Validation accuracy increased from 0.52 to 0.53
Epoch 13, Train loss 1.340396885844794, Train accuracy 0.5162642046131871, Validation loss 1.286003404855728, Validation accuracy 0.5431985288858414
Validation accuracy increased from 0.53 to 0.54
Epoch 14, Train loss 1.319373651661656, Train accuracy 0.5234241831031713, Validation loss 1.2712926685810089, Validation accuracy 0.5480353862047196
Validation accuracy increased from 0.54 to 0.55
Epoch 15, Train loss 1.3001256734132767, Train accuracy 0.5309064276516438, Validation loss 1.249889886379242, Validation accuracy 0.5539407163858414
Validation accuracy increased from 0.55 to 0.55
Epoch 16, Train loss 1.2832126339728183, Train accuracy 0.5389648435468023, Validation loss 1.2359847664833068, Validation accuracy 0.5567784935235978
Validation accuracy increased from 0.55 to 0.56
Epoch 17, Train loss 1.2665925594893368, Train accuracy 0.5451145239851691, Validation loss 1.2173658788204194, Validation accuracy 0.5700827211141586
Validation accuracy increased from 0.56 to 0.57
Epoch 18, Train loss 1.2499847534027966, Train accuracy 0.5498126775703647, Validation loss 1.2029642760753632, Validation accuracy 0.5675206810235978
Epoch 19, Train loss 1.2367382835258136, Train accuracy 0.5571644174104388, Validation loss 1.1849738776683807, Validation accuracy 0.5789981633424759
Validation accuracy increased from 0.57 to 0.58
Epoch 20, Train loss 1.2236876013604077, Train accuracy 0.5618519176813689, Validation loss 1.1790843307971954, Validation accuracy 0.5782858461141587
Epoch 21, Train loss 1.2151827703822742, Train accuracy 0.5641352981328964, Validation loss 1.1722367644309997, Validation accuracy 0.5836626827716828
Validation accuracy increased from 0.58 to 0.58
Epoch 22, Train loss 1.2124301174824887, Train accuracy 0.5643474784764376, Validation loss 1.1697456657886505, Validation accuracy 0.5814108461141586
Epoch 23, Train loss 1.2066811363805423, Train accuracy 0.5682013492015275, Validation loss 1.1627701103687287, Validation accuracy 0.5827320784330368
Epoch 24, Train loss 1.1990122991529377, Train accuracy 0.5690935724838213, Validation loss 1.1604510486125945, Validation accuracy 0.5862017452716828
Validation accuracy increased from 0.58 to 0.59
Epoch 25, Train loss 1.1977681253444066, Train accuracy 0.5698419744995508, Validation loss 1.1555193722248078, Validation accuracy 0.5889361202716827
Validation accuracy increased from 0.59 to 0.59
Epoch 26, Train loss 1.1935550448569385, Train accuracy 0.5739124644209038, Validation loss 1.153460931777954, Validation accuracy 0.5893497258424759
Validation accuracy increased from 0.59 to 0.59
Epoch 27, Train loss 1.1843285736712543, Train accuracy 0.5752148435197093, Validation loss 1.1510954916477203, Validation accuracy 0.5858570784330368
Epoch 28, Train loss 1.1849957284602253, Train accuracy 0.5750799006359144, Validation loss 1.1460938632488251, Validation accuracy 0.595703125
Validation accuracy increased from 0.59 to 0.60
Epoch 29, Train loss 1.175189657644792, Train accuracy 0.5812784091315486, Validation loss 1.142640435695648, Validation accuracy 0.5934283077716828
Epoch 30, Train loss 1.174986589361321, Train accuracy 0.5797043679790064, Validation loss 1.1380786269903183, Validation accuracy 0.5927274823188782
Epoch 31, Train loss 1.1712567091665484, Train accuracy 0.5827654474838213, Validation loss 1.1355148285627366, Validation accuracy 0.5957490801811218
Validation accuracy increased from 0.60 to 0.60
Epoch 32, Train loss 1.1668764569542625, Train accuracy 0.5823934657329862, Validation loss 1.1270765662193298, Validation accuracy 0.5994370400905609
Validation accuracy increased from 0.60 to 0.60
Epoch 33, Train loss 1.1595437892458655, Train accuracy 0.5853808593343605, Validation loss 1.1245194852352143, Validation accuracy 0.6002412676811218
Validation accuracy increased from 0.60 to 0.60
Epoch 34, Train loss 1.155023472214287, Train accuracy 0.5885981886901639, Validation loss 1.1237094312906266, Validation accuracy 0.603515625
Validation accuracy increased from 0.60 to 0.60
Epoch 35, Train loss 1.1509470777078108, Train accuracy 0.5888920453461733, Validation loss 1.113701057434082, Validation accuracy 0.603297334909439
Epoch 36, Train loss 1.1493055481802334, Train accuracy 0.5907013494182717, Validation loss 1.1113281458616258, Validation accuracy 0.6056181073188782
Validation accuracy increased from 0.60 to 0.61
Epoch 37, Train loss 1.1462553563443096, Train accuracy 0.5900292968885466, Validation loss 1.109121200442314, Validation accuracy 0.6063993573188782
Validation accuracy increased from 0.61 to 0.61
Epoch 38, Train loss 1.1419834975491872, Train accuracy 0.5914177911525423, Validation loss 1.1041095227003097, Validation accuracy 0.6089154422283173
Validation accuracy increased from 0.61 to 0.61
Epoch 39, Train loss 1.1390429257669232, Train accuracy 0.5927246094427325, Validation loss 1.099667054414749, Validation accuracy 0.6112132340669632
Validation accuracy increased from 0.61 to 0.61
Epoch 40, Train loss 1.1308905262161384, Train accuracy 0.595110972835259, Validation loss 1.098930075764656, Validation accuracy 0.6122127771377563
Validation accuracy increased from 0.61 to 0.61
Epoch 41, Train loss 1.1326857944103805, Train accuracy 0.5956809303977273, Validation loss 1.098102393746376, Validation accuracy 0.609156709909439
Epoch 42, Train loss 1.1306853964924812, Train accuracy 0.5975133167071776, Validation loss 1.0978842049837112, Validation accuracy 0.6110868573188781
Epoch 43, Train loss 1.125841392034834, Train accuracy 0.5999964489178224, Validation loss 1.094838234782219, Validation accuracy 0.6116268396377563
Epoch 44, Train loss 1.1268450282514095, Train accuracy 0.5953790836713531, Validation loss 1.092283520102501, Validation accuracy 0.6144071698188782
Validation accuracy increased from 0.61 to 0.61
Epoch 45, Train loss 1.1256056983362546, Train accuracy 0.5973659445616332, Validation loss 1.0930711567401885, Validation accuracy 0.6171185672283173
Validation accuracy increased from 0.61 to 0.62
Epoch 46, Train loss 1.1263677762313322, Train accuracy 0.5979456674646247, Validation loss 1.0931879878044128, Validation accuracy 0.6165326297283172
Epoch 47, Train loss 1.1216415132988582, Train accuracy 0.5986869673837315, Validation loss 1.0918236792087554, Validation accuracy 0.6159237146377563
Epoch 48, Train loss 1.124983622269197, Train accuracy 0.5978027341718023, Validation loss 1.0888813704252243, Validation accuracy 0.6171185672283173
Validation accuracy increased from 0.62 to 0.62
Epoch 49, Train loss 1.1234892196953297, Train accuracy 0.5981010296805338, Validation loss 1.087667429447174, Validation accuracy 0.6165096521377563
Epoch 50, Train loss 1.1191824400289492, Train accuracy 0.6006853692233562, Validation loss 1.0865934103727342, Validation accuracy 0.6159007340669632
Epoch 51, Train loss 1.1201549131761899, Train accuracy 0.6008593748238954, Validation loss 1.087835830450058, Validation accuracy 0.6192440271377564
Validation accuracy increased from 0.62 to 0.62
Epoch 52, Train loss 1.1186928014186295, Train accuracy 0.6012526632032611, Validation loss 1.0838223159313203, Validation accuracy 0.6178768396377563
Epoch 53, Train loss 1.1145058138804003, Train accuracy 0.6033167612146247, Validation loss 1.0856419771909713, Validation accuracy 0.6211741715669632
Validation accuracy increased from 0.62 to 0.62
Epoch 54, Train loss 1.1167648797008125, Train accuracy 0.603054864840074, Validation loss 1.0817871570587159, Validation accuracy 0.6174862146377563
Epoch 55, Train loss 1.114411024884744, Train accuracy 0.6030779474160888, Validation loss 1.0815424919128418, Validation accuracy 0.6186810672283173
Epoch 56, Train loss 1.1137499944730238, Train accuracy 0.6034303978085518, Validation loss 1.0799354791641236, Validation accuracy 0.6205882340669632
Epoch 57, Train loss 1.1140334616330536, Train accuracy 0.601214488460259, Validation loss 1.0774088323116302, Validation accuracy 0.6209558814764022
Epoch 58, Train loss 1.1111342175440355, Train accuracy 0.6036408025432717, Validation loss 1.0775025337934494, Validation accuracy 0.6238855689764022
Validation accuracy increased from 0.62 to 0.62
Epoch 59, Train loss 1.1100506680932911, Train accuracy 0.6024440696293657, Validation loss 1.0767127335071565, Validation accuracy 0.6221737146377564
Epoch 60, Train loss 1.1125809597698124, Train accuracy 0.6040793677622621, Validation loss 1.0760309398174286, Validation accuracy 0.6208295047283172
Epoch 61, Train loss 1.1078774912113494, Train accuracy 0.6058362925594504, Validation loss 1.073664927482605, Validation accuracy 0.6210248172283173
Epoch 62, Train loss 1.1074005006389185, Train accuracy 0.6047336645424366, Validation loss 1.0729391157627106, Validation accuracy 0.6206112146377564
Epoch 63, Train loss 1.1070394458418542, Train accuracy 0.6058078834956343, Validation loss 1.075520431995392, Validation accuracy 0.6248851090669632
Validation accuracy increased from 0.62 to 0.62
Epoch 64, Train loss 1.10627384822477, Train accuracy 0.6047096946700052, Validation loss 1.0736513167619706, Validation accuracy 0.6242761939764023
Epoch 65, Train loss 1.1035970347848805, Train accuracy 0.6067498224702749, Validation loss 1.0741671681404115, Validation accuracy 0.6202435672283173
Epoch 66, Train loss 1.1030039340257645, Train accuracy 0.6068803265013478, Validation loss 1.0728266000747682, Validation accuracy 0.6208295047283172
Epoch 67, Train loss 1.104490084742958, Train accuracy 0.6077956320209936, Validation loss 1.0755870580673217, Validation accuracy 0.6231502771377564
Epoch 68, Train loss 1.1049392429942435, Train accuracy 0.6068536930463531, Validation loss 1.0725411623716354, Validation accuracy 0.6223920047283172
Epoch 69, Train loss 1.104249732060866, Train accuracy 0.6073348721997305, Validation loss 1.0721323937177658, Validation accuracy 0.6210248172283173
Epoch 0, Train loss 1.9034013903953813, Train accuracy 0.3012935012917627, Validation loss 1.6812325716018677, Validation accuracy 0.3815487131476402
Validation accuracy increased from 0.00 to 0.38
Epoch 1, Train loss 1.6369086287238381, Train accuracy 0.3953391333872622, Validation loss 1.5281788885593415, Validation accuracy 0.4357077211141586
Validation accuracy increased from 0.38 to 0.44
Epoch 2, Train loss 1.5275389884005894, Train accuracy 0.43765358660708775, Validation loss 1.443207573890686, Validation accuracy 0.46081112176179884
Validation accuracy increased from 0.44 to 0.46
Epoch 3, Train loss 1.4514274515888907, Train accuracy 0.4654873934659091, Validation loss 1.37517591714859, Validation accuracy 0.49741498231887815
Validation accuracy increased from 0.46 to 0.50
Epoch 4, Train loss 1.3923615196889096, Train accuracy 0.4898757101459937, Validation loss 1.3200147032737732, Validation accuracy 0.5221277564764023
Validation accuracy increased from 0.50 to 0.52
Epoch 5, Train loss 1.3460314815694636, Train accuracy 0.5109801136634566, Validation loss 1.2888534486293792, Validation accuracy 0.5360868573188782
Validation accuracy increased from 0.52 to 0.54
Epoch 6, Train loss 1.3024913790551098, Train accuracy 0.527819602157582, Validation loss 1.2545503318309783, Validation accuracy 0.5498851090669632
Validation accuracy increased from 0.54 to 0.55
Epoch 7, Train loss 1.261826824058186, Train accuracy 0.5420827415179122, Validation loss 1.2242970645427704, Validation accuracy 0.5605813413858414
Validation accuracy increased from 0.55 to 0.56
Epoch 8, Train loss 1.2270776121453806, Train accuracy 0.5590882457115434, Validation loss 1.207419353723526, Validation accuracy 0.5689797788858414
Validation accuracy increased from 0.56 to 0.57
Epoch 9, Train loss 1.1957734416831622, Train accuracy 0.5697336647320878, Validation loss 1.1860497057437898, Validation accuracy 0.5736443012952804
Validation accuracy increased from 0.57 to 0.57
Epoch 10, Train loss 1.163040010089224, Train accuracy 0.5815882455896247, Validation loss 1.1303646266460419, Validation accuracy 0.5974034935235977
Validation accuracy increased from 0.57 to 0.60
Epoch 11, Train loss 1.139097910374403, Train accuracy 0.5909889912740751, Validation loss 1.1121147274971008, Validation accuracy 0.6017003685235978
Validation accuracy increased from 0.60 to 0.60
Epoch 12, Train loss 1.1125371699983424, Train accuracy 0.6019620028409091, Validation loss 1.097939145565033, Validation accuracy 0.6061236202716828
Validation accuracy increased from 0.60 to 0.61
Epoch 13, Train loss 1.0859189555048943, Train accuracy 0.6122798293151639, Validation loss 1.0685091644525528, Validation accuracy 0.6187729775905609
Validation accuracy increased from 0.61 to 0.62
Epoch 14, Train loss 1.0590160119939933, Train accuracy 0.6208984374322675, Validation loss 1.0630972266197205, Validation accuracy 0.6239200383424759
Validation accuracy increased from 0.62 to 0.62
Epoch 15, Train loss 1.0371129018339245, Train accuracy 0.6310218393125318, Validation loss 1.0338252574205398, Validation accuracy 0.6339154422283173
Validation accuracy increased from 0.62 to 0.63
Epoch 16, Train loss 1.0148464089090175, Train accuracy 0.6390687142583457, Validation loss 1.0201380550861359, Validation accuracy 0.6413602948188781
Validation accuracy increased from 0.63 to 0.64
Epoch 17, Train loss 0.9983206499706615, Train accuracy 0.643826349215074, Validation loss 1.0325392365455628, Validation accuracy 0.6302045047283172
Epoch 18, Train loss 0.97184211963957, Train accuracy 0.6527468040585518, Validation loss 0.9628783583641052, Validation accuracy 0.6543658077716827
Validation accuracy increased from 0.64 to 0.65
Epoch 19, Train loss 0.9579763012853536, Train accuracy 0.6583451703190804, Validation loss 0.9473610043525695, Validation accuracy 0.6673598349094391
Validation accuracy increased from 0.65 to 0.67
Epoch 20, Train loss 0.9264028258621693, Train accuracy 0.6722824929112737, Validation loss 0.933015975356102, Validation accuracy 0.6735409021377563
Validation accuracy increased from 0.67 to 0.67
Epoch 21, Train loss 0.9197641942988742, Train accuracy 0.6753329191018235, Validation loss 0.9136788815259933, Validation accuracy 0.6776424646377563
Validation accuracy increased from 0.67 to 0.68
Epoch 22, Train loss 0.9112952703779394, Train accuracy 0.6775097653947093, Validation loss 0.9066655844449997, Validation accuracy 0.6859030336141586
Validation accuracy increased from 0.68 to 0.69
Epoch 23, Train loss 0.9039262313057076, Train accuracy 0.6805726205083457, Validation loss 0.8986545830965043, Validation accuracy 0.6858226090669632
Epoch 24, Train loss 0.9005826477977362, Train accuracy 0.6802689985118129, Validation loss 0.8936880379915237, Validation accuracy 0.6889246314764023
Validation accuracy increased from 0.69 to 0.69
Epoch 25, Train loss 0.8923274532637813, Train accuracy 0.6834517043422569, Validation loss 0.8882593810558319, Validation accuracy 0.6931985288858413
Validation accuracy increased from 0.69 to 0.69
Epoch 26, Train loss 0.8862798291851174, Train accuracy 0.6883700283413584, Validation loss 0.8814672797918319, Validation accuracy 0.6931295961141586
Epoch 27, Train loss 0.879110686480999, Train accuracy 0.6891246448186311, Validation loss 0.8803914844989776, Validation accuracy 0.6877527564764023
Epoch 28, Train loss 0.8729112740944732, Train accuracy 0.6921102628111839, Validation loss 0.8721873521804809, Validation accuracy 0.6947380512952804
Validation accuracy increased from 0.69 to 0.69
Epoch 29, Train loss 0.8665344708345153, Train accuracy 0.6934685724025423, Validation loss 0.8891721814870834, Validation accuracy 0.6886833637952805
Epoch 30, Train loss 0.8654712523249063, Train accuracy 0.695218394764445, Validation loss 0.8612389773130417, Validation accuracy 0.6990349262952804
Validation accuracy increased from 0.69 to 0.70
Epoch 31, Train loss 0.8527537293054841, Train accuracy 0.6995143819261681, Validation loss 0.8542767882347106, Validation accuracy 0.7005284935235977
Validation accuracy increased from 0.70 to 0.70
Epoch 32, Train loss 0.8505035696381872, Train accuracy 0.6992205256088213, Validation loss 0.8622190058231354, Validation accuracy 0.6955422788858414
Epoch 33, Train loss 0.8441461829299276, Train accuracy 0.702659800987352, Validation loss 0.8478758007287979, Validation accuracy 0.7028722435235977
Validation accuracy increased from 0.70 to 0.70
Epoch 34, Train loss 0.8400881876322356, Train accuracy 0.7053320313041861, Validation loss 0.8529304832220077, Validation accuracy 0.7019416362047195
Epoch 35, Train loss 0.8308916203677654, Train accuracy 0.7070063918151639, Validation loss 0.8451709747314453, Validation accuracy 0.6990119487047195
Epoch 36, Train loss 0.8259939788417383, Train accuracy 0.7092933238229968, Validation loss 0.8446394562721252, Validation accuracy 0.7015969663858413
Epoch 37, Train loss 0.8222959197380326, Train accuracy 0.710336470129815, Validation loss 0.8266600161790848, Validation accuracy 0.7138097435235977
Validation accuracy increased from 0.70 to 0.71
Epoch 38, Train loss 0.8144593519920652, Train accuracy 0.7132510651241649, Validation loss 0.8206888735294342, Validation accuracy 0.7099724262952805
Epoch 39, Train loss 0.8074562248181213, Train accuracy 0.717172407629815, Validation loss 0.8418209940195084, Validation accuracy 0.6988166362047196
Epoch 40, Train loss 0.7969361550428651, Train accuracy 0.719866832210259, Validation loss 0.8095624655485153, Validation accuracy 0.7132697612047195
Epoch 41, Train loss 0.7945787876167081, Train accuracy 0.7222443182360042, Validation loss 0.8096701592206955, Validation accuracy 0.7123161762952804
Epoch 42, Train loss 0.7948262620378624, Train accuracy 0.72021839462898, Validation loss 0.8090790033340454, Validation accuracy 0.7108800560235977
Epoch 43, Train loss 0.7910446934401989, Train accuracy 0.7217249643396247, Validation loss 0.804388228058815, Validation accuracy 0.7140050560235978
Validation accuracy increased from 0.71 to 0.71
Epoch 44, Train loss 0.7867653281851248, Train accuracy 0.7235227271237157, Validation loss 0.8068527281284332, Validation accuracy 0.7142693012952804
Validation accuracy increased from 0.71 to 0.71
Epoch 45, Train loss 0.7865146574648944, Train accuracy 0.7235324928029017, Validation loss 0.8038583666086196, Validation accuracy 0.7165670961141586
Validation accuracy increased from 0.71 to 0.72
Epoch 46, Train loss 0.7866669253192164, Train accuracy 0.723754438825629, Validation loss 0.802690201997757, Validation accuracy 0.7160041362047196
Epoch 47, Train loss 0.7869380468671973, Train accuracy 0.7229403409768235, Validation loss 0.7989296048879624, Validation accuracy 0.7163717836141587
Epoch 48, Train loss 0.7818654497916048, Train accuracy 0.7229066050865434, Validation loss 0.7973486572504044, Validation accuracy 0.7174747258424758
Validation accuracy increased from 0.72 to 0.72
Epoch 49, Train loss 0.7804540321230888, Train accuracy 0.7245916192504492, Validation loss 0.7953051090240478, Validation accuracy 0.7198644310235978
Validation accuracy increased from 0.72 to 0.72
Epoch 50, Train loss 0.779356063766913, Train accuracy 0.7254367897456343, Validation loss 0.7948424100875855, Validation accuracy 0.7177619487047195
Epoch 51, Train loss 0.7754628323018551, Train accuracy 0.7285910865122621, Validation loss 0.7955964088439942, Validation accuracy 0.7173253685235977
Epoch 52, Train loss 0.7738621282306585, Train accuracy 0.7279687500135466, Validation loss 0.7886037170886994, Validation accuracy 0.7202550560235977
Validation accuracy increased from 0.72 to 0.72
Epoch 53, Train loss 0.769054248590361, Train accuracy 0.7287144884467125, Validation loss 0.7907650500535965, Validation accuracy 0.7211856633424759
Validation accuracy increased from 0.72 to 0.72
Epoch 54, Train loss 0.7688013379546729, Train accuracy 0.7291752486066385, Validation loss 0.7921035438776016, Validation accuracy 0.7217716008424759
Validation accuracy increased from 0.72 to 0.72
Epoch 55, Train loss 0.7656322958117182, Train accuracy 0.7312997159632769, Validation loss 0.7912202298641204, Validation accuracy 0.7184742659330368
Epoch 56, Train loss 0.7675603709437631, Train accuracy 0.730727095156908, Validation loss 0.7861393988132477, Validation accuracy 0.7207720577716827
Epoch 57, Train loss 0.7664439898322929, Train accuracy 0.7298206676813689, Validation loss 0.7833539426326752, Validation accuracy 0.7233111202716828
Validation accuracy increased from 0.72 to 0.72
Epoch 58, Train loss 0.7663135762241754, Train accuracy 0.7314124642447992, Validation loss 0.7841681510210037, Validation accuracy 0.7237017452716827
Validation accuracy increased from 0.72 to 0.72
Epoch 59, Train loss 0.7599122199145231, Train accuracy 0.73291015625, Validation loss 0.7785487443208694, Validation accuracy 0.7274126827716827
Validation accuracy increased from 0.72 to 0.73
Epoch 60, Train loss 0.7556241831996224, Train accuracy 0.733872514218092, Validation loss 0.7798894971609116, Validation accuracy 0.7297334551811219
Validation accuracy increased from 0.73 to 0.73
Epoch 61, Train loss 0.7566609165885232, Train accuracy 0.7337109375406395, Validation loss 0.7771289795637131, Validation accuracy 0.7276079952716827
Epoch 62, Train loss 0.7569426663897254, Train accuracy 0.7351367185738954, Validation loss 0.7799960911273957, Validation accuracy 0.7260684758424759
Epoch 63, Train loss 0.7546959390694444, Train accuracy 0.7344486859034408, Validation loss 0.7765545189380646, Validation accuracy 0.7275850176811218
Epoch 64, Train loss 0.7537979500537569, Train accuracy 0.7348100140013478, Validation loss 0.7764532893896103, Validation accuracy 0.7301700383424758
Validation accuracy increased from 0.73 to 0.73
Epoch 65, Train loss 0.7498392791233279, Train accuracy 0.7366743605922569, Validation loss 0.776844522356987, Validation accuracy 0.7270220577716827
Epoch 66, Train loss 0.7529476816681299, Train accuracy 0.736825283955444, Validation loss 0.7759270071983337, Validation accuracy 0.7288028508424759
Epoch 67, Train loss 0.7461561994119124, Train accuracy 0.7372913706031713, Validation loss 0.7746305286884307, Validation accuracy 0.7309283077716827
Validation accuracy increased from 0.73 to 0.73
Epoch 68, Train loss 0.7511789162050594, Train accuracy 0.7371528761630709, Validation loss 0.7750300407409668, Validation accuracy 0.7295611202716827
Epoch 69, Train loss 0.7519192820922895, Train accuracy 0.7374760298566385, Validation loss 0.774834868311882, Validation accuracy 0.7289522051811218
Epoch 0, Train loss 2.036852091550827, Train accuracy 0.23252219452776693, Validation loss 1.7727074146270752, Validation accuracy 0.3282169118523598
Validation accuracy increased from 0.00 to 0.33
Epoch 1, Train loss 1.7123821729963475, Train accuracy 0.358055752786723, Validation loss 1.6042867422103881, Validation accuracy 0.40685891509056094
Validation accuracy increased from 0.33 to 0.41
Epoch 2, Train loss 1.5883179232478142, Train accuracy 0.4062704189934514, Validation loss 1.5010797083377838, Validation accuracy 0.44643841981887816
Validation accuracy increased from 0.41 to 0.45
Epoch 3, Train loss 1.5096132152459838, Train accuracy 0.44120117175308143, Validation loss 1.4376660764217377, Validation accuracy 0.46834788620471957
Validation accuracy increased from 0.45 to 0.47
Epoch 4, Train loss 1.4519153921441599, Train accuracy 0.46779208088463003, Validation loss 1.3891656577587128, Validation accuracy 0.4923253670334816
Validation accuracy increased from 0.47 to 0.49
Epoch 5, Train loss 1.4104710851203313, Train accuracy 0.4834295098077167, Validation loss 1.3596807539463043, Validation accuracy 0.5038258269429207
Validation accuracy increased from 0.49 to 0.50
Epoch 6, Train loss 1.3700487830422141, Train accuracy 0.49841796860776166, Validation loss 1.320971918106079, Validation accuracy 0.5162798717617989
Validation accuracy increased from 0.50 to 0.52
Epoch 7, Train loss 1.3355075046420097, Train accuracy 0.5110466973009434, Validation loss 1.280969750881195, Validation accuracy 0.5327895224094391
Validation accuracy increased from 0.52 to 0.53
Epoch 8, Train loss 1.3026878901503303, Train accuracy 0.5225985439663584, Validation loss 1.2930373311042787, Validation accuracy 0.5361098349094391
Validation accuracy increased from 0.53 to 0.54
Epoch 9, Train loss 1.2773549150336871, Train accuracy 0.5345312499187209, Validation loss 1.2343094885349273, Validation accuracy 0.5574563413858413
Validation accuracy increased from 0.54 to 0.56
Epoch 10, Train loss 1.2464497468688271, Train accuracy 0.5465429686009884, Validation loss 1.2134775578975678, Validation accuracy 0.5583295047283172
Validation accuracy increased from 0.56 to 0.56
Epoch 11, Train loss 1.2201278887011788, Train accuracy 0.5571901632303541, Validation loss 1.185892218351364, Validation accuracy 0.5723000913858414
Validation accuracy increased from 0.56 to 0.57
Epoch 12, Train loss 1.1949582370844753, Train accuracy 0.5680628551000898, Validation loss 1.1649960935115815, Validation accuracy 0.5822380512952805
Validation accuracy increased from 0.57 to 0.58
Epoch 13, Train loss 1.1738506623289802, Train accuracy 0.5756516334685412, Validation loss 1.1429171025753022, Validation accuracy 0.5921530336141586
Validation accuracy increased from 0.58 to 0.59
Epoch 14, Train loss 1.1477758654139258, Train accuracy 0.5843483663418076, Validation loss 1.1387094557285309, Validation accuracy 0.5974724262952804
Validation accuracy increased from 0.59 to 0.60
Epoch 15, Train loss 1.1253445385531946, Train accuracy 0.5928560014475476, Validation loss 1.1267226040363312, Validation accuracy 0.6005055159330368
Validation accuracy increased from 0.60 to 0.60
Epoch 16, Train loss 1.105517166243358, Train accuracy 0.6009374999187209, Validation loss 1.0902308702468873, Validation accuracy 0.6144875913858414
Validation accuracy increased from 0.60 to 0.61
Epoch 17, Train loss 1.0831621096215465, Train accuracy 0.6124414063312791, Validation loss 1.0848148226737977, Validation accuracy 0.6163258284330368
Validation accuracy increased from 0.61 to 0.62
Epoch 18, Train loss 1.0650310387665576, Train accuracy 0.6181667257439006, Validation loss 1.0578203529119492, Validation accuracy 0.628147977590561
Validation accuracy increased from 0.62 to 0.63
Epoch 19, Train loss 1.046746458180926, Train accuracy 0.6278089488094504, Validation loss 1.0356233239173889, Validation accuracy 0.6311466008424759
Validation accuracy increased from 0.63 to 0.63
Epoch 20, Train loss 1.019800009036606, Train accuracy 0.6331081319261681, Validation loss 1.0209692388772964, Validation accuracy 0.6441176474094391
Validation accuracy increased from 0.63 to 0.64
Epoch 21, Train loss 1.0161342637782746, Train accuracy 0.6352592327378013, Validation loss 1.0139411866664887, Validation accuracy 0.6419117659330368
Epoch 22, Train loss 1.0072740008207886, Train accuracy 0.6397496448321776, Validation loss 1.0029121458530426, Validation accuracy 0.6453125
Validation accuracy increased from 0.64 to 0.65
Epoch 23, Train loss 1.0061243454163724, Train accuracy 0.6380486505275423, Validation loss 1.0023150742053986, Validation accuracy 0.648046875
Validation accuracy increased from 0.65 to 0.65
Epoch 24, Train loss 0.9937974570149725, Train accuracy 0.6444451348348097, Validation loss 0.9969949007034302, Validation accuracy 0.648219209909439
Validation accuracy increased from 0.65 to 0.65
Epoch 25, Train loss 0.9942246614532038, Train accuracy 0.6439772725782611, Validation loss 0.9927584022283554, Validation accuracy 0.6508042275905609
Validation accuracy increased from 0.65 to 0.65
Epoch 26, Train loss 0.9868611131202091, Train accuracy 0.6474192115393552, Validation loss 0.9887751132249832, Validation accuracy 0.6530790448188781
Validation accuracy increased from 0.65 to 0.65
Epoch 27, Train loss 0.9767558784647421, Train accuracy 0.6513822796669874, Validation loss 0.9936403006315231, Validation accuracy 0.6495863974094391
Epoch 28, Train loss 0.9729862423105673, Train accuracy 0.6516734730790962, Validation loss 0.9829772889614106, Validation accuracy 0.6547104775905609
Validation accuracy increased from 0.65 to 0.65
Epoch 29, Train loss 0.9661470871757377, Train accuracy 0.6552787639878013, Validation loss 0.9747895687818527, Validation accuracy 0.6549747258424758
Validation accuracy increased from 0.65 to 0.65
Epoch 30, Train loss 0.9633822397074916, Train accuracy 0.6576890979300846, Validation loss 0.967152526974678, Validation accuracy 0.66015625
Validation accuracy increased from 0.65 to 0.66
Epoch 31, Train loss 0.9598413739692081, Train accuracy 0.6583052199672569, Validation loss 0.9631532102823257, Validation accuracy 0.6615004599094391
Validation accuracy increased from 0.66 to 0.66
Epoch 32, Train loss 0.9552850872278214, Train accuracy 0.6616184301674366, Validation loss 0.9595944076776505, Validation accuracy 0.6639705896377563
Validation accuracy increased from 0.66 to 0.66
Epoch 33, Train loss 0.9455624520778656, Train accuracy 0.6626846590502695, Validation loss 0.9618872821331024, Validation accuracy 0.6653147965669632
Validation accuracy increased from 0.66 to 0.67
Epoch 34, Train loss 0.946394469588995, Train accuracy 0.6588565341450952, Validation loss 0.9529371172189712, Validation accuracy 0.6703929215669632
Validation accuracy increased from 0.67 to 0.67
Epoch 35, Train loss 0.9403463669798591, Train accuracy 0.6639657315205444, Validation loss 0.954244065284729, Validation accuracy 0.6667279422283172
Epoch 36, Train loss 0.9340113577517596, Train accuracy 0.6698783734305338, Validation loss 0.9458472967147827, Validation accuracy 0.6715188413858414
Validation accuracy increased from 0.67 to 0.67
Epoch 37, Train loss 0.928584138778123, Train accuracy 0.6688405539501797, Validation loss 0.9422147750854493, Validation accuracy 0.6740579038858414
Validation accuracy increased from 0.67 to 0.67
Epoch 38, Train loss 0.9253443350846117, Train accuracy 0.6707919033413584, Validation loss 0.9369836956262588, Validation accuracy 0.6768956810235978
Validation accuracy increased from 0.67 to 0.68
Epoch 39, Train loss 0.9203645038333806, Train accuracy 0.6714586290446195, Validation loss 0.927665176987648, Validation accuracy 0.6789177387952805
Validation accuracy increased from 0.68 to 0.68
Epoch 40, Train loss 0.9151179292662577, Train accuracy 0.6736221591180022, Validation loss 0.9253493219614028, Validation accuracy 0.6775965064764022
Epoch 41, Train loss 0.9111440476368774, Train accuracy 0.6751784445209936, Validation loss 0.9259855270385742, Validation accuracy 0.6792853862047196
Validation accuracy increased from 0.68 to 0.68
Epoch 42, Train loss 0.9095093624835665, Train accuracy 0.6744549003514376, Validation loss 0.9256914168596267, Validation accuracy 0.6789636939764023
Epoch 43, Train loss 0.9130014706064354, Train accuracy 0.6753968393260782, Validation loss 0.9202034682035446, Validation accuracy 0.6819738060235977
Validation accuracy increased from 0.68 to 0.68
Epoch 44, Train loss 0.902901007709178, Train accuracy 0.6789151277731765, Validation loss 0.9189642637968063, Validation accuracy 0.6806525737047195
Epoch 45, Train loss 0.9061118526892229, Train accuracy 0.6781347654759884, Validation loss 0.9187078148126602, Validation accuracy 0.6791130512952804
Epoch 46, Train loss 0.8996451507237825, Train accuracy 0.6809002130546353, Validation loss 0.9143366366624832, Validation accuracy 0.6812385112047196
Epoch 47, Train loss 0.9000269635157152, Train accuracy 0.6803267046131871, Validation loss 0.9149752587080002, Validation accuracy 0.6806295961141586
Epoch 48, Train loss 0.897837916558439, Train accuracy 0.6804367896508087, Validation loss 0.9155100494623184, Validation accuracy 0.6806525737047195
Epoch 49, Train loss 0.9021655351600864, Train accuracy 0.6799121092666279, Validation loss 0.9150060266256332, Validation accuracy 0.6825827211141586
Validation accuracy increased from 0.68 to 0.68
Epoch 50, Train loss 0.8955003057013858, Train accuracy 0.6816255324943499, Validation loss 0.9139356195926667, Validation accuracy 0.6829733461141586
Validation accuracy increased from 0.68 to 0.68
Epoch 51, Train loss 0.8943186649544672, Train accuracy 0.6830557527189905, Validation loss 0.9111298590898513, Validation accuracy 0.6826746314764023
Epoch 52, Train loss 0.8917566426098347, Train accuracy 0.6825479401106184, Validation loss 0.9103569358587265, Validation accuracy 0.6870749086141587
Validation accuracy increased from 0.68 to 0.69
Epoch 53, Train loss 0.88947334242138, Train accuracy 0.682259410281073, Validation loss 0.9092071443796158, Validation accuracy 0.6866613060235978
Epoch 54, Train loss 0.8919949379156936, Train accuracy 0.6830255680463531, Validation loss 0.9064236074686051, Validation accuracy 0.6872472435235977
Validation accuracy increased from 0.69 to 0.69
Epoch 55, Train loss 0.885714538056742, Train accuracy 0.6854216974567283, Validation loss 0.9080569475889206, Validation accuracy 0.6859719663858413
Epoch 56, Train loss 0.8877983167767525, Train accuracy 0.6855593039230867, Validation loss 0.90769864320755, Validation accuracy 0.6859719663858413
Epoch 57, Train loss 0.8857659897343679, Train accuracy 0.6857368607412685, Validation loss 0.9042345076799393, Validation accuracy 0.6876608461141587
Validation accuracy increased from 0.69 to 0.69
Epoch 58, Train loss 0.8850319971415129, Train accuracy 0.6859206320209936, Validation loss 0.9040149718523025, Validation accuracy 0.6870749086141587
Epoch 59, Train loss 0.8791473619639874, Train accuracy 0.6881702769209038, Validation loss 0.9007956862449646, Validation accuracy 0.6879021137952804
Validation accuracy increased from 0.69 to 0.69
Epoch 60, Train loss 0.8830435360697183, Train accuracy 0.6868581321429122, Validation loss 0.8985453844070435, Validation accuracy 0.6880514711141587
Validation accuracy increased from 0.69 to 0.69
Epoch 61, Train loss 0.8784069794822823, Train accuracy 0.6878817470913584, Validation loss 0.9013224601745605, Validation accuracy 0.6898322612047195
Validation accuracy increased from 0.69 to 0.69
Epoch 62, Train loss 0.881539890373295, Train accuracy 0.6879847300323573, Validation loss 0.898614090681076, Validation accuracy 0.6897863060235977
Epoch 63, Train loss 0.8774195235561241, Train accuracy 0.686762251298536, Validation loss 0.8980162352323532, Validation accuracy 0.6895909935235978
Epoch 64, Train loss 0.8788108344782483, Train accuracy 0.6890101205896247, Validation loss 0.9000617325305938, Validation accuracy 0.6900275737047196
Validation accuracy increased from 0.69 to 0.69
Epoch 65, Train loss 0.875916487113996, Train accuracy 0.6891335225240751, Validation loss 0.9012866884469986, Validation accuracy 0.6892693012952804
Epoch 66, Train loss 0.8756397180259228, Train accuracy 0.688626597889445, Validation loss 0.8988985657691956, Validation accuracy 0.6913947612047195
Validation accuracy increased from 0.69 to 0.69
Epoch 67, Train loss 0.8790442079982974, Train accuracy 0.6875221946022727, Validation loss 0.8990100294351577, Validation accuracy 0.6861443012952805
Epoch 68, Train loss 0.8782894905995239, Train accuracy 0.6902006390419874, Validation loss 0.8978080511093139, Validation accuracy 0.6890050560235977
Epoch 69, Train loss 0.8741956319321286, Train accuracy 0.6905664059926163, Validation loss 0.8985352635383606, Validation accuracy 0.6910271137952805
Test loss: 0.8872494250535965 Test accuracy: 0.690234375  resnet10_AdaDelta_0.01
Test loss: 0.5660291485488415 Test accuracy: 0.81484375  resnet18_AdaDelta_0.01
Test loss: 1.1003306791186334 Test accuracy: 0.60751953125  resnet12_AdaDelta_0.01
Test loss: 0.8051085352897644 Test accuracy: 0.71806640625  resnet14_4_AdaDelta_0.01
Test loss: 0.9045559749007225 Test accuracy: 0.67978515625  resnet14_5_AdaDelta_0.01
Epoch 0, Train loss 1.399840359660712, Train accuracy 0.49659357219934464, Validation loss 1.3819933533668518, Validation accuracy 0.5271369487047195
Validation accuracy increased from 0.00 to 0.53
Epoch 1, Train loss 0.9668829075314782, Train accuracy 0.6528755324808034, Validation loss 0.9709366977214813, Validation accuracy 0.6712201297283172
Validation accuracy increased from 0.53 to 0.67
Epoch 2, Train loss 0.7716689126735384, Train accuracy 0.7281995737417177, Validation loss 0.9168225944042205, Validation accuracy 0.6977481633424759
Validation accuracy increased from 0.67 to 0.70
Epoch 3, Train loss 0.6568059108474038, Train accuracy 0.7699911221861839, Validation loss 0.6774401247501374, Validation accuracy 0.7706112146377564
Validation accuracy increased from 0.70 to 0.77
Epoch 4, Train loss 0.5779347292740237, Train accuracy 0.7992498224431818, Validation loss 0.584421557188034, Validation accuracy 0.7925666362047196
Validation accuracy increased from 0.77 to 0.79
Epoch 5, Train loss 0.5190274952487512, Train accuracy 0.8178879615258087, Validation loss 0.596398514509201, Validation accuracy 0.7934168189764023
Validation accuracy increased from 0.79 to 0.79
Epoch 6, Train loss 0.47945843332193117, Train accuracy 0.8317409445616332, Validation loss 0.5158294320106507, Validation accuracy 0.8269416362047195
Validation accuracy increased from 0.79 to 0.83
Epoch 7, Train loss 0.4397172805937854, Train accuracy 0.8478764204139059, Validation loss 0.4916018724441528, Validation accuracy 0.8326976090669632
Validation accuracy increased from 0.83 to 0.83
Epoch 8, Train loss 0.40113630348985846, Train accuracy 0.859633345156908, Validation loss 0.45454998314380646, Validation accuracy 0.8482881426811218
Validation accuracy increased from 0.83 to 0.85
Epoch 9, Train loss 0.3715675422413783, Train accuracy 0.8696093748916279, Validation loss 0.44292552173137667, Validation accuracy 0.8464039534330368
Epoch 10, Train loss 0.3456844723021442, Train accuracy 0.8789213421669874, Validation loss 0.46344459652900694, Validation accuracy 0.8470358461141586
Epoch 11, Train loss 0.32163862376050517, Train accuracy 0.8875399502840909, Validation loss 0.4690143704414368, Validation accuracy 0.8408318012952805
Epoch 12, Train loss 0.3014147157188166, Train accuracy 0.894178799607537, Validation loss 0.3860893167555332, Validation accuracy 0.8759306073188782
Validation accuracy increased from 0.85 to 0.88
Epoch 13, Train loss 0.28096393919126555, Train accuracy 0.9005388847806237, Validation loss 0.4137823462486267, Validation accuracy 0.8700942099094391
Epoch 14, Train loss 0.26719641931016336, Train accuracy 0.9055300070480867, Validation loss 0.3694557145237923, Validation accuracy 0.8805376827716828
Validation accuracy increased from 0.88 to 0.88
Epoch 15, Train loss 0.25312957692552696, Train accuracy 0.9105610793287103, Validation loss 0.4410386234521866, Validation accuracy 0.8582950383424759
Epoch 16, Train loss 0.2301594354212284, Train accuracy 0.9196324571967125, Validation loss 0.40720548778772353, Validation accuracy 0.8692325383424759
Epoch 17, Train loss 0.22470388383689252, Train accuracy 0.9209410510957241, Validation loss 0.3871152400970459, Validation accuracy 0.8747472435235977
Epoch 18, Train loss 0.21109970777549528, Train accuracy 0.9260245026512579, Validation loss 0.3327360115945339, Validation accuracy 0.8958295047283172
Validation accuracy increased from 0.88 to 0.90
Epoch 19, Train loss 0.19719255398112265, Train accuracy 0.9310901987959038, Validation loss 0.3582799777388573, Validation accuracy 0.8807559758424759
Epoch 20, Train loss 0.12760139942507853, Train accuracy 0.9581649503247305, Validation loss 0.26956078708171843, Validation accuracy 0.9140625
Validation accuracy increased from 0.90 to 0.91
Epoch 21, Train loss 0.1035286192570559, Train accuracy 0.9658087712119926, Validation loss 0.2707290224730968, Validation accuracy 0.914453125
Validation accuracy increased from 0.91 to 0.91
Epoch 22, Train loss 0.09323730313388462, Train accuracy 0.9692294032058932, Validation loss 0.28511875197291375, Validation accuracy 0.9153837323188782
Validation accuracy increased from 0.91 to 0.92
Epoch 23, Train loss 0.09096090794032947, Train accuracy 0.9698126773265275, Validation loss 0.31000958681106566, Validation accuracy 0.9087660849094391
Epoch 24, Train loss 0.08228820028968832, Train accuracy 0.9720392399890856, Validation loss 0.28425958231091497, Validation accuracy 0.9190257340669632
Validation accuracy increased from 0.92 to 0.92
Epoch 25, Train loss 0.07873585485768589, Train accuracy 0.9730912640013478, Validation loss 0.2880065843462944, Validation accuracy 0.9162568926811219
Epoch 26, Train loss 0.07475991720672358, Train accuracy 0.9753861860795454, Validation loss 0.2924506708979607, Validation accuracy 0.9146254599094391
Epoch 27, Train loss 0.07166740860239687, Train accuracy 0.9758212000808932, Validation loss 0.3100018799304962, Validation accuracy 0.9102022051811218
Epoch 28, Train loss 0.07016346821646122, Train accuracy 0.9758655892854388, Validation loss 0.30498858392238615, Validation accuracy 0.9167049646377563
Epoch 29, Train loss 0.06235451477749104, Train accuracy 0.9793501418422569, Validation loss 0.31749379858374593, Validation accuracy 0.9123046875
Epoch 30, Train loss 0.06453547173772346, Train accuracy 0.9787189272994344, Validation loss 0.31995357051491735, Validation accuracy 0.9107192099094391
Epoch 31, Train loss 0.06165455310309136, Train accuracy 0.9786869673566385, Validation loss 0.3460936725139618, Validation accuracy 0.905491727590561
Epoch 32, Train loss 0.05787291884718632, Train accuracy 0.9805584160441702, Validation loss 0.3416062191128731, Validation accuracy 0.9086167275905609
Epoch 33, Train loss 0.05335718705530532, Train accuracy 0.9820516688579862, Validation loss 0.32244150042533876, Validation accuracy 0.9090073525905609
Epoch 34, Train loss 0.053406347912228244, Train accuracy 0.9817693534899842, Validation loss 0.3108203552663326, Validation accuracy 0.9160615801811218
Epoch 35, Train loss 0.04807829639387571, Train accuracy 0.9839888137172569, Validation loss 0.33640204593539236, Validation accuracy 0.9102826297283173
Epoch 36, Train loss 0.048011690536937254, Train accuracy 0.9836807528680022, Validation loss 0.3448652185499668, Validation accuracy 0.9098920047283172
Epoch 37, Train loss 0.04976882126224651, Train accuracy 0.9831800423562527, Validation loss 0.3611184053122997, Validation accuracy 0.9103860288858414
Epoch 38, Train loss 0.04329244388711893, Train accuracy 0.985722656277093, Validation loss 0.35139409005641936, Validation accuracy 0.9116268396377564
Epoch 39, Train loss 0.04216997037027878, Train accuracy 0.9860555753111839, Validation loss 0.34051802232861517, Validation accuracy 0.9095243573188782
Epoch 40, Train loss 0.027455540532669562, Train accuracy 0.9917089840905233, Validation loss 0.30015257820487024, Validation accuracy 0.9226102948188781
Validation accuracy increased from 0.92 to 0.92
Epoch 41, Train loss 0.02242587020737119, Train accuracy 0.9936905184930022, Validation loss 0.30066740363836286, Validation accuracy 0.9237821698188782
Validation accuracy increased from 0.92 to 0.92
Epoch 42, Train loss 0.02074041202484461, Train accuracy 0.9942231889475476, Validation loss 0.3014496393501759, Validation accuracy 0.9223690271377564
Epoch 43, Train loss 0.020123803572708064, Train accuracy 0.9943625710227273, Validation loss 0.3052639916539192, Validation accuracy 0.9222196698188782
Epoch 44, Train loss 0.019100973731838167, Train accuracy 0.9947780540043657, Validation loss 0.30624478608369826, Validation accuracy 0.9216107547283172
Epoch 45, Train loss 0.01770855191385966, Train accuracy 0.9953107244589112, Validation loss 0.30862763449549674, Validation accuracy 0.9233226090669632
Epoch 46, Train loss 0.01628507998644967, Train accuracy 0.9957705963064324, Validation loss 0.3043302997946739, Validation accuracy 0.9235638797283172
Epoch 47, Train loss 0.016235359941757368, Train accuracy 0.995393288067796, Validation loss 0.3115177981555462, Validation accuracy 0.9233226090669632
Epoch 48, Train loss 0.016248575418351473, Train accuracy 0.9955832741477273, Validation loss 0.3151979476213455, Validation accuracy 0.9252757340669632
Validation accuracy increased from 0.92 to 0.93
Epoch 49, Train loss 0.015230071847327054, Train accuracy 0.9958718039772727, Validation loss 0.314643856883049, Validation accuracy 0.9237362146377563
Epoch 50, Train loss 0.014721345738507807, Train accuracy 0.9960875355384566, Validation loss 0.33291096016764643, Validation accuracy 0.9212431073188782
Epoch 51, Train loss 0.013992097775123759, Train accuracy 0.9961603338068182, Validation loss 0.33013069331645967, Validation accuracy 0.9198759198188782
Epoch 52, Train loss 0.014309423666087572, Train accuracy 0.9962935014204546, Validation loss 0.3270794190466404, Validation accuracy 0.9224379599094391
Epoch 53, Train loss 0.014289260016415607, Train accuracy 0.995976562527093, Validation loss 0.3297230340540409, Validation accuracy 0.9220243573188782
Epoch 54, Train loss 0.013497948303913952, Train accuracy 0.9962047230113636, Validation loss 0.33256562128663064, Validation accuracy 0.921484375
Epoch 55, Train loss 0.013943409962600774, Train accuracy 0.9958718039772727, Validation loss 0.3309538163244724, Validation accuracy 0.9233915448188782
Epoch 56, Train loss 0.012669970204693858, Train accuracy 0.9965598366477273, Validation loss 0.34586612358689306, Validation accuracy 0.9220473349094391
Epoch 57, Train loss 0.01346883641963359, Train accuracy 0.9963538707657293, Validation loss 0.3481090269982815, Validation accuracy 0.9264476090669632
Validation accuracy increased from 0.93 to 0.93
Epoch 58, Train loss 0.011913872726092284, Train accuracy 0.996858131817796, Validation loss 0.3457724846899509, Validation accuracy 0.9237362146377563
Epoch 59, Train loss 0.012287806267109276, Train accuracy 0.996702769601887, Validation loss 0.34968878850340845, Validation accuracy 0.9225643396377563
Epoch 60, Train loss 0.010177589081153697, Train accuracy 0.9974920099431818, Validation loss 0.3331424377858639, Validation accuracy 0.9233685672283173
Epoch 61, Train loss 0.009311768543821845, Train accuracy 0.9977805397727273, Validation loss 0.33782888352870943, Validation accuracy 0.9228056073188782
Epoch 62, Train loss 0.007908476371085271, Train accuracy 0.9982466264204546, Validation loss 0.34326536059379575, Validation accuracy 0.9229779422283173
Epoch 63, Train loss 0.008224873116308696, Train accuracy 0.9980344457382505, Validation loss 0.33793447613716127, Validation accuracy 0.9249310672283173
Epoch 64, Train loss 0.007647131018033674, Train accuracy 0.9983291903680022, Validation loss 0.3414208009839058, Validation accuracy 0.9251263797283172
Epoch 65, Train loss 0.008105624467134476, Train accuracy 0.998046875, Validation loss 0.34804865121841433, Validation accuracy 0.9225873172283172
Epoch 66, Train loss 0.007313265321003696, Train accuracy 0.9985289417884566, Validation loss 0.3458904929459095, Validation accuracy 0.9241498172283172
Epoch 67, Train loss 0.006943745843521107, Train accuracy 0.9984845525839112, Validation loss 0.3449161075055599, Validation accuracy 0.9221966922283172
Epoch 68, Train loss 0.006866867427147968, Train accuracy 0.9984241832386364, Validation loss 0.34603697136044503, Validation accuracy 0.9247357547283173
Epoch 69, Train loss 0.00662374241338429, Train accuracy 0.9986461292613636, Validation loss 0.3450887642800808, Validation accuracy 0.9262522965669632
Epoch 0, Train loss 1.4848145883191715, Train accuracy 0.4525088776241649, Validation loss 1.3009469568729402, Validation accuracy 0.5519646137952805
Validation accuracy increased from 0.00 to 0.55
Epoch 1, Train loss 1.0209226709875194, Train accuracy 0.6321732953868129, Validation loss 0.9336144298315048, Validation accuracy 0.6757008284330368
Validation accuracy increased from 0.55 to 0.68
Epoch 2, Train loss 0.8025522584264929, Train accuracy 0.7163876064799048, Validation loss 0.8981123864650726, Validation accuracy 0.6935891538858414
Validation accuracy increased from 0.68 to 0.69
Epoch 3, Train loss 0.6669344228099693, Train accuracy 0.7656152343208139, Validation loss 0.6447002738714218, Validation accuracy 0.7774931073188782
Validation accuracy increased from 0.69 to 0.78
Epoch 4, Train loss 0.5738946615972302, Train accuracy 0.7991246448999102, Validation loss 0.6181153774261474, Validation accuracy 0.7898092836141586
Validation accuracy increased from 0.78 to 0.79
Epoch 5, Train loss 0.5043459421193058, Train accuracy 0.8233105469156395, Validation loss 0.6942614525556564, Validation accuracy 0.7854319840669632
Epoch 6, Train loss 0.4639097442003814, Train accuracy 0.838401988487352, Validation loss 0.5838428303599358, Validation accuracy 0.8096047788858414
Validation accuracy increased from 0.79 to 0.81
Epoch 7, Train loss 0.4254999849945307, Train accuracy 0.8525053266097199, Validation loss 0.5037640392780304, Validation accuracy 0.8268497258424758
Validation accuracy increased from 0.81 to 0.83
Epoch 8, Train loss 0.3865759230472825, Train accuracy 0.8644921874458139, Validation loss 0.48177472352981565, Validation accuracy 0.8372931987047195
Validation accuracy increased from 0.83 to 0.84
Epoch 9, Train loss 0.35741844375363807, Train accuracy 0.8762713067910888, Validation loss 0.45602376013994217, Validation accuracy 0.8462545961141587
Validation accuracy increased from 0.84 to 0.85
Epoch 10, Train loss 0.3302187506448139, Train accuracy 0.8853675425052643, Validation loss 0.3962092578411102, Validation accuracy 0.8711167275905609
Validation accuracy increased from 0.85 to 0.87
Epoch 11, Train loss 0.3059749332341281, Train accuracy 0.8923366476189006, Validation loss 0.38793725073337554, Validation accuracy 0.8718175560235977
Validation accuracy increased from 0.87 to 0.87
Epoch 12, Train loss 0.28290463450618764, Train accuracy 0.9002539061687209, Validation loss 0.35774139910936353, Validation accuracy 0.8836971521377563
Validation accuracy increased from 0.87 to 0.88
Epoch 13, Train loss 0.2637469837103378, Train accuracy 0.9076038707386364, Validation loss 0.37973344027996064, Validation accuracy 0.876734834909439
Epoch 14, Train loss 0.24642578698694706, Train accuracy 0.9132563918828964, Validation loss 0.3618656359612942, Validation accuracy 0.8826631426811218
Epoch 15, Train loss 0.2316763395951553, Train accuracy 0.9190172227946195, Validation loss 0.37351551204919814, Validation accuracy 0.881617647409439
Epoch 16, Train loss 0.21751712512394245, Train accuracy 0.9227645596997305, Validation loss 0.31461193040013313, Validation accuracy 0.894749540090561
Validation accuracy increased from 0.88 to 0.89
Epoch 17, Train loss 0.20237216268750755, Train accuracy 0.9274733662605286, Validation loss 0.35129242315888404, Validation accuracy 0.8927734375
Epoch 18, Train loss 0.19251341072165154, Train accuracy 0.9329518821429122, Validation loss 0.4407864883542061, Validation accuracy 0.8714613974094391
Epoch 19, Train loss 0.18140126184814356, Train accuracy 0.9354856176809832, Validation loss 0.35855961218476295, Validation accuracy 0.8838120400905609
Epoch 20, Train loss 0.11220079662532291, Train accuracy 0.9613787284628912, Validation loss 0.2694559670984745, Validation accuracy 0.9183938413858413
Validation accuracy increased from 0.89 to 0.92
Epoch 21, Train loss 0.08711936216886071, Train accuracy 0.9701651277189905, Validation loss 0.26819505020976064, Validation accuracy 0.9159007340669632
Epoch 22, Train loss 0.08087581518868153, Train accuracy 0.9717879969288002, Validation loss 0.30137345418334005, Validation accuracy 0.9149471521377563
Epoch 23, Train loss 0.0719171413008801, Train accuracy 0.9751615764742548, Validation loss 0.2924020431935787, Validation accuracy 0.9175896137952805
Epoch 24, Train loss 0.07248727098869329, Train accuracy 0.9744105112146247, Validation loss 0.312976286560297, Validation accuracy 0.9168083637952804
Epoch 25, Train loss 0.0652738983256065, Train accuracy 0.9774724786931818, Validation loss 0.30641806945204736, Validation accuracy 0.9177849262952804
Epoch 26, Train loss 0.061441260543440214, Train accuracy 0.9786141687496142, Validation loss 0.308237424492836, Validation accuracy 0.9203929215669632
Validation accuracy increased from 0.92 to 0.92
Epoch 27, Train loss 0.05979895313926549, Train accuracy 0.9788556461307135, Validation loss 0.3227563753724098, Validation accuracy 0.9180491715669632
Epoch 28, Train loss 0.05625551415141672, Train accuracy 0.9796670807356184, Validation loss 0.33177815526723864, Validation accuracy 0.9150965064764023
Epoch 29, Train loss 0.05572980595752597, Train accuracy 0.9803773080083457, Validation loss 0.321358422935009, Validation accuracy 0.9180261939764023
Epoch 30, Train loss 0.05369381212883375, Train accuracy 0.9803169386630709, Validation loss 0.33914925456047057, Validation accuracy 0.9169002771377563
Epoch 31, Train loss 0.04949702113993804, Train accuracy 0.981566050851887, Validation loss 0.33374815434217453, Validation accuracy 0.9226447612047195
Validation accuracy increased from 0.92 to 0.92
Epoch 32, Train loss 0.04703887877456674, Train accuracy 0.983313209969889, Validation loss 0.3450631149113178, Validation accuracy 0.9163373172283172
Epoch 33, Train loss 0.04781644737919454, Train accuracy 0.9831036932089112, Validation loss 0.3453373447060585, Validation accuracy 0.9162683814764023
Epoch 34, Train loss 0.041537314785686744, Train accuracy 0.9855362214148045, Validation loss 0.3841692514717579, Validation accuracy 0.9137982547283172
Epoch 35, Train loss 0.0425748021225445, Train accuracy 0.9847878193990751, Validation loss 0.3680712766945362, Validation accuracy 0.9198988974094391
Epoch 36, Train loss 0.04469517854952507, Train accuracy 0.9842737923291597, Validation loss 0.34911680296063424, Validation accuracy 0.9203929215669632
Epoch 37, Train loss 0.038739812491588636, Train accuracy 0.9865056818181818, Validation loss 0.3530273146927357, Validation accuracy 0.9193704038858413
Epoch 38, Train loss 0.03860981263410808, Train accuracy 0.9864612926136364, Validation loss 0.3790302246809006, Validation accuracy 0.9169232547283173
Epoch 39, Train loss 0.03559924878275276, Train accuracy 0.9876855466176163, Validation loss 0.3550423502922058, Validation accuracy 0.9165670961141587
Epoch 40, Train loss 0.022635869904082607, Train accuracy 0.9923588423566385, Validation loss 0.32773810997605324, Validation accuracy 0.9265739887952804
Validation accuracy increased from 0.92 to 0.93
Epoch 41, Train loss 0.016325643435596827, Train accuracy 0.9946670809930022, Validation loss 0.3274167366325855, Validation accuracy 0.9277228862047195
Validation accuracy increased from 0.93 to 0.93
Epoch 42, Train loss 0.01302423990802543, Train accuracy 0.9961985085498203, Validation loss 0.3482347548007965, Validation accuracy 0.9267463237047195
Epoch 43, Train loss 0.013484343031119683, Train accuracy 0.9960271661931818, Validation loss 0.3407046914100647, Validation accuracy 0.9236672788858413
Epoch 44, Train loss 0.011557985828072891, Train accuracy 0.9962366829541597, Validation loss 0.3442800842225552, Validation accuracy 0.9261833637952804
Epoch 45, Train loss 0.011072427763296715, Train accuracy 0.9965154474431818, Validation loss 0.3562854461371899, Validation accuracy 0.9244255512952805
Epoch 46, Train loss 0.01185763418206162, Train accuracy 0.9962935014204546, Validation loss 0.35480705723166467, Validation accuracy 0.9283088237047196
Validation accuracy increased from 0.93 to 0.93
Epoch 47, Train loss 0.010283350619085302, Train accuracy 0.9968421520157293, Validation loss 0.376852934807539, Validation accuracy 0.9255974262952804
Epoch 48, Train loss 0.009571545853263657, Train accuracy 0.9967151988636364, Validation loss 0.38022842183709143, Validation accuracy 0.9267922788858414
Epoch 49, Train loss 0.00982228692671263, Train accuracy 0.9967373934659091, Validation loss 0.3857541911303997, Validation accuracy 0.9262063413858413
Epoch 50, Train loss 0.010143730545347684, Train accuracy 0.996826171875, Validation loss 0.38711759001016616, Validation accuracy 0.9257238060235977
Epoch 51, Train loss 0.010108876600663114, Train accuracy 0.9969753196293657, Validation loss 0.39063566625118257, Validation accuracy 0.9257697612047195
Epoch 52, Train loss 0.009927185316138837, Train accuracy 0.9967311790043657, Validation loss 0.38874412029981614, Validation accuracy 0.9248621314764023
Epoch 53, Train loss 0.00865819718720476, Train accuracy 0.9972922585227273, Validation loss 0.39164366722106936, Validation accuracy 0.9252297788858413
Epoch 54, Train loss 0.009730168755512832, Train accuracy 0.9964426491748203, Validation loss 0.3921986699104309, Validation accuracy 0.9258386939764023
Epoch 55, Train loss 0.010707329142777862, Train accuracy 0.9963982599702749, Validation loss 0.3988218575716019, Validation accuracy 0.9232996314764023
Epoch 56, Train loss 0.008538292647162134, Train accuracy 0.9972256747159091, Validation loss 0.38948587477207186, Validation accuracy 0.9270105689764023
Epoch 57, Train loss 0.009002338420858987, Train accuracy 0.9970862926407293, Validation loss 0.3859316796064377, Validation accuracy 0.9258157163858414
Epoch 58, Train loss 0.009476354493513512, Train accuracy 0.9969149502840909, Validation loss 0.394616861641407, Validation accuracy 0.9271829038858413
Epoch 59, Train loss 0.010284165415214375, Train accuracy 0.9964932528409091, Validation loss 0.3956312730908394, Validation accuracy 0.9288717836141587
Validation accuracy increased from 0.93 to 0.93
Epoch 60, Train loss 0.006430503945673329, Train accuracy 0.9980246803977273, Validation loss 0.38339582532644273, Validation accuracy 0.9280905336141586
Epoch 61, Train loss 0.005483239430759568, Train accuracy 0.9983575994318182, Validation loss 0.37731771171092987, Validation accuracy 0.9306525737047195
Validation accuracy increased from 0.93 to 0.93
Epoch 62, Train loss 0.005585512763156492, Train accuracy 0.998173828152093, Validation loss 0.3725171133875847, Validation accuracy 0.9269646137952805
Epoch 63, Train loss 0.005316180381421212, Train accuracy 0.9982022372159091, Validation loss 0.3784045621752739, Validation accuracy 0.9296760112047195
Epoch 64, Train loss 0.004786178121569471, Train accuracy 0.9984685724431818, Validation loss 0.38073819056153296, Validation accuracy 0.9294806987047195
Epoch 65, Train loss 0.004416192988917994, Train accuracy 0.9988236860795454, Validation loss 0.37520466521382334, Validation accuracy 0.9294577211141586
Epoch 66, Train loss 0.0037472389311998004, Train accuracy 0.9989568536931818, Validation loss 0.3725683316588402, Validation accuracy 0.9292624086141587
Epoch 67, Train loss 0.004322089812459043, Train accuracy 0.9987349076704546, Validation loss 0.3799612566828728, Validation accuracy 0.9279411762952805
Epoch 68, Train loss 0.004347201604601155, Train accuracy 0.9987127130681818, Validation loss 0.3837574392557144, Validation accuracy 0.9300896137952804
Epoch 69, Train loss 0.004376944996031604, Train accuracy 0.9985955255952749, Validation loss 0.37953804060816765, Validation accuracy 0.9310431987047195
Validation accuracy increased from 0.93 to 0.93
Epoch 0, Train loss 1.5012599636207928, Train accuracy 0.4436212713745507, Validation loss 1.3452442646026612, Validation accuracy 0.5078814342617989
Validation accuracy increased from 0.00 to 0.51
Epoch 1, Train loss 1.1261388683183626, Train accuracy 0.5922887074676427, Validation loss 1.084410521388054, Validation accuracy 0.6114889711141587
Validation accuracy increased from 0.51 to 0.61
Epoch 2, Train loss 0.9620147283104333, Train accuracy 0.6581063565205444, Validation loss 1.115006485581398, Validation accuracy 0.6267003685235977
Validation accuracy increased from 0.61 to 0.63
Epoch 3, Train loss 0.856250557709824, Train accuracy 0.6972123577513478, Validation loss 1.0927252799272538, Validation accuracy 0.6187959551811218
Epoch 4, Train loss 0.7644089416346767, Train accuracy 0.7324174361472781, Validation loss 0.7991177558898925, Validation accuracy 0.7288488060235977
Validation accuracy increased from 0.63 to 0.73
Epoch 5, Train loss 0.7036785459653898, Train accuracy 0.7524147724563425, Validation loss 0.7530849486589432, Validation accuracy 0.7435891538858413
Validation accuracy increased from 0.73 to 0.74
Epoch 6, Train loss 0.652069635011933, Train accuracy 0.7729509943588213, Validation loss 0.7056238353252411, Validation accuracy 0.7639591008424759
Validation accuracy increased from 0.74 to 0.76
Epoch 7, Train loss 0.6119468229060824, Train accuracy 0.7867116477679122, Validation loss 0.6141163915395736, Validation accuracy 0.7903377771377563
Validation accuracy increased from 0.76 to 0.79
Epoch 8, Train loss 0.5754488510164347, Train accuracy 0.8011390268802643, Validation loss 0.6654333174228668, Validation accuracy 0.7801815271377563
Epoch 9, Train loss 0.5499683642251925, Train accuracy 0.8107475140555338, Validation loss 0.6131850779056549, Validation accuracy 0.7909352034330368
Validation accuracy increased from 0.79 to 0.79
Epoch 10, Train loss 0.5283545518124645, Train accuracy 0.8162491121752695, Validation loss 0.6053592413663864, Validation accuracy 0.7956112146377563
Validation accuracy increased from 0.79 to 0.80
Epoch 11, Train loss 0.5085905837741765, Train accuracy 0.8231036930598996, Validation loss 0.5693351119756699, Validation accuracy 0.8003791362047196
Validation accuracy increased from 0.80 to 0.80
Epoch 12, Train loss 0.48989638059654017, Train accuracy 0.8307581676000898, Validation loss 0.5235509529709816, Validation accuracy 0.8216681987047195
Validation accuracy increased from 0.80 to 0.82
Epoch 13, Train loss 0.4700351355766708, Train accuracy 0.8360040838068182, Validation loss 0.5677272096276283, Validation accuracy 0.8124655336141586
Epoch 14, Train loss 0.4552522291514007, Train accuracy 0.8418288352814588, Validation loss 0.489473295211792, Validation accuracy 0.8336397051811218
Validation accuracy increased from 0.82 to 0.83
Epoch 15, Train loss 0.4393108156933026, Train accuracy 0.8470925068990751, Validation loss 0.49342442899942396, Validation accuracy 0.8303883284330368
Epoch 16, Train loss 0.4238587883724408, Train accuracy 0.8515829189934514, Validation loss 0.5089300617575645, Validation accuracy 0.8239889711141586
Epoch 17, Train loss 0.4110329924997958, Train accuracy 0.8568963066420772, Validation loss 0.4597412824630737, Validation accuracy 0.8413258284330368
Validation accuracy increased from 0.83 to 0.84
Epoch 18, Train loss 0.40678479183803906, Train accuracy 0.8586328124458139, Validation loss 0.48307813704013824, Validation accuracy 0.8352481633424759
Epoch 19, Train loss 0.3931759194555608, Train accuracy 0.8624662641774524, Validation loss 0.5664700418710709, Validation accuracy 0.8137293189764023
Epoch 20, Train loss 0.331807816401124, Train accuracy 0.8869238279082559, Validation loss 0.37587020844221114, Validation accuracy 0.873265165090561
Validation accuracy increased from 0.84 to 0.87
Epoch 21, Train loss 0.31705550189045345, Train accuracy 0.8900603692639958, Validation loss 0.37365321815013885, Validation accuracy 0.8704273909330368
Epoch 22, Train loss 0.3135431922802871, Train accuracy 0.8911416903138161, Validation loss 0.39925199151039126, Validation accuracy 0.8694278508424759
Epoch 23, Train loss 0.3032185085625811, Train accuracy 0.8947523080489852, Validation loss 0.376055534183979, Validation accuracy 0.8713809758424759
Epoch 24, Train loss 0.2990884192457253, Train accuracy 0.8976287286389958, Validation loss 0.3654341891407967, Validation accuracy 0.8738740801811218
Validation accuracy increased from 0.87 to 0.87
Epoch 25, Train loss 0.29678901555863296, Train accuracy 0.8968678977001797, Validation loss 0.3884723141789436, Validation accuracy 0.8710363060235977
Epoch 26, Train loss 0.29238431926139374, Train accuracy 0.8989337713203647, Validation loss 0.3749557465314865, Validation accuracy 0.8708409935235977
Epoch 27, Train loss 0.28640715769407427, Train accuracy 0.9012766334820878, Validation loss 0.4162812352180481, Validation accuracy 0.8618336409330368
Epoch 28, Train loss 0.28107462357729673, Train accuracy 0.9025230824270032, Validation loss 0.38252533972263336, Validation accuracy 0.872265625
Epoch 29, Train loss 0.279145609841428, Train accuracy 0.9018616832115434, Validation loss 0.38635163456201554, Validation accuracy 0.8678653508424758
Epoch 30, Train loss 0.27402908160266554, Train accuracy 0.9048313210633668, Validation loss 0.36998233646154405, Validation accuracy 0.8740464150905609
Validation accuracy increased from 0.87 to 0.87
Epoch 31, Train loss 0.27012162130664696, Train accuracy 0.906521661715074, Validation loss 0.4227868586778641, Validation accuracy 0.8631318926811218
Epoch 32, Train loss 0.2644398613748225, Train accuracy 0.9084854403680022, Validation loss 0.3628669664263725, Validation accuracy 0.8778033077716827
Validation accuracy increased from 0.87 to 0.88
Epoch 33, Train loss 0.2628885935145346, Train accuracy 0.9082626063715328, Validation loss 0.3946707174181938, Validation accuracy 0.8680376827716827
Epoch 34, Train loss 0.25855985893444583, Train accuracy 0.9105584160848097, Validation loss 0.37780653685331345, Validation accuracy 0.8754595577716827
Epoch 35, Train loss 0.2594078447331082, Train accuracy 0.9082084514878013, Validation loss 0.38403863459825516, Validation accuracy 0.875758272409439
Epoch 36, Train loss 0.2532484537329186, Train accuracy 0.9116557172753594, Validation loss 0.38175526112318037, Validation accuracy 0.8765395224094391
Epoch 37, Train loss 0.24535920428620142, Train accuracy 0.9148819246752695, Validation loss 0.38368368744850156, Validation accuracy 0.8763671875
Epoch 38, Train loss 0.24788522110743957, Train accuracy 0.9124778051945296, Validation loss 0.3765644632279873, Validation accuracy 0.8762408077716828
Epoch 39, Train loss 0.2412088964642449, Train accuracy 0.9178249287334356, Validation loss 0.3731727197766304, Validation accuracy 0.8796070784330368
Validation accuracy increased from 0.88 to 0.88
Epoch 40, Train loss 0.22218304974111644, Train accuracy 0.9218963066285307, Validation loss 0.35262315794825555, Validation accuracy 0.8830537676811219
Validation accuracy increased from 0.88 to 0.88
Epoch 41, Train loss 0.2138988289304755, Train accuracy 0.9264648434790698, Validation loss 0.3540782108902931, Validation accuracy 0.886500459909439
Validation accuracy increased from 0.88 to 0.89
Epoch 42, Train loss 0.20840051948008212, Train accuracy 0.9285289414904334, Validation loss 0.35417141318321227, Validation accuracy 0.885546875
Epoch 43, Train loss 0.21123184632001954, Train accuracy 0.9261097298427061, Validation loss 0.3529579058289528, Validation accuracy 0.8886948525905609
Validation accuracy increased from 0.89 to 0.89
Epoch 44, Train loss 0.20896925802596591, Train accuracy 0.9277299358086153, Validation loss 0.3514669083058834, Validation accuracy 0.8836397051811218
Epoch 45, Train loss 0.20684523846615444, Train accuracy 0.9283833449537103, Validation loss 0.3523504614830017, Validation accuracy 0.8853745400905609
Epoch 46, Train loss 0.2015655544501814, Train accuracy 0.9296857243911787, Validation loss 0.3485973849892616, Validation accuracy 0.8871323525905609
Epoch 47, Train loss 0.20277854457328265, Train accuracy 0.92925514890389, Validation loss 0.3506466314196587, Validation accuracy 0.8845932900905609
Epoch 48, Train loss 0.20463884621858597, Train accuracy 0.9288272369991649, Validation loss 0.35083607137203215, Validation accuracy 0.887890625
Epoch 49, Train loss 0.2002464605664665, Train accuracy 0.9291184304112737, Validation loss 0.3487729750573635, Validation accuracy 0.8857192099094391
Epoch 50, Train loss 0.19950134501877156, Train accuracy 0.9314426491883668, Validation loss 0.3499924041330814, Validation accuracy 0.8871553301811218
Epoch 51, Train loss 0.20013245267116211, Train accuracy 0.9302761006084356, Validation loss 0.3566113129258156, Validation accuracy 0.8861787676811218
Epoch 52, Train loss 0.1950077854774215, Train accuracy 0.9320134940472516, Validation loss 0.3606030762195587, Validation accuracy 0.8836167275905609
Epoch 53, Train loss 0.19352044448764485, Train accuracy 0.9327805397862737, Validation loss 0.35242835581302645, Validation accuracy 0.8863970577716828
Epoch 54, Train loss 0.19353982763872904, Train accuracy 0.9327876418828964, Validation loss 0.3509387381374836, Validation accuracy 0.8852481633424759
Epoch 55, Train loss 0.19271753546358508, Train accuracy 0.9320321377705444, Validation loss 0.34932075515389444, Validation accuracy 0.8868910849094391
Epoch 56, Train loss 0.19387161579321732, Train accuracy 0.9321999289095402, Validation loss 0.35371280908584596, Validation accuracy 0.8868106633424759
Epoch 57, Train loss 0.19165233937515455, Train accuracy 0.9333735795860941, Validation loss 0.35145665854215624, Validation accuracy 0.885960477590561
Epoch 58, Train loss 0.18640469835901802, Train accuracy 0.9352761005813425, Validation loss 0.3578074052929878, Validation accuracy 0.8813419133424759
Epoch 59, Train loss 0.18512875485149297, Train accuracy 0.9354660866612737, Validation loss 0.35465905368328093, Validation accuracy 0.8902113974094391
Validation accuracy increased from 0.89 to 0.89
Epoch 60, Train loss 0.17988522291522135, Train accuracy 0.9379802911796353, Validation loss 0.34728645384311674, Validation accuracy 0.8892807900905609
Epoch 61, Train loss 0.1752983906983652, Train accuracy 0.9402689984576269, Validation loss 0.35082547515630724, Validation accuracy 0.8884765625
Epoch 62, Train loss 0.17958201421424747, Train accuracy 0.93853249265389, Validation loss 0.34734542965888976, Validation accuracy 0.8900620400905609
Epoch 63, Train loss 0.17325109082528137, Train accuracy 0.9398890269750898, Validation loss 0.346051225066185, Validation accuracy 0.8896024823188782
Epoch 64, Train loss 0.1743801860138774, Train accuracy 0.9399680397049948, Validation loss 0.3464134395122528, Validation accuracy 0.8889131426811219
Epoch 65, Train loss 0.17392176474359902, Train accuracy 0.9402539062906395, Validation loss 0.34832870662212373, Validation accuracy 0.8889361202716828
Epoch 66, Train loss 0.1762302117422223, Train accuracy 0.938852095129815, Validation loss 0.3481415182352066, Validation accuracy 0.8906020224094391
Validation accuracy increased from 0.89 to 0.89
Epoch 67, Train loss 0.1747295057655058, Train accuracy 0.9406152343885466, Validation loss 0.34792900308966634, Validation accuracy 0.88984375
Epoch 68, Train loss 0.1733983824537559, Train accuracy 0.939335049553351, Validation loss 0.35022181570529937, Validation accuracy 0.8894761025905609
Epoch 69, Train loss 0.17120363017205487, Train accuracy 0.9424414062364534, Validation loss 0.3511710524559021, Validation accuracy 0.8865464150905609
Epoch 0, Train loss 1.5250189751386642, Train accuracy 0.4373233308168975, Validation loss 1.223452442884445, Validation accuracy 0.5632123172283172
Validation accuracy increased from 0.00 to 0.56
Epoch 1, Train loss 1.0890992178835652, Train accuracy 0.6089257811280814, Validation loss 0.9560080409049988, Validation accuracy 0.6596507340669632
Validation accuracy increased from 0.56 to 0.66
Epoch 2, Train loss 0.9175336252559315, Train accuracy 0.672992720184001, Validation loss 0.9370718032121659, Validation accuracy 0.6794002771377563
Validation accuracy increased from 0.66 to 0.68
Epoch 3, Train loss 0.7979491566392508, Train accuracy 0.7176953124051745, Validation loss 0.7932479500770568, Validation accuracy 0.7299747258424759
Validation accuracy increased from 0.68 to 0.73
Epoch 4, Train loss 0.704338317567652, Train accuracy 0.7508309659632769, Validation loss 0.700363066792488, Validation accuracy 0.7576401650905609
Validation accuracy increased from 0.73 to 0.76
Epoch 5, Train loss 0.6446549294685776, Train accuracy 0.7754563208330761, Validation loss 0.6845490723848343, Validation accuracy 0.7713694840669632
Validation accuracy increased from 0.76 to 0.77
Epoch 6, Train loss 0.5949919484555721, Train accuracy 0.7902130681005392, Validation loss 0.5839941427111626, Validation accuracy 0.8002527564764023
Validation accuracy increased from 0.77 to 0.80
Epoch 7, Train loss 0.5488992697474632, Train accuracy 0.8071626418016173, Validation loss 0.6749805599451065, Validation accuracy 0.7680836409330368
Epoch 8, Train loss 0.5121252746744589, Train accuracy 0.8207741474563425, Validation loss 0.6268795698881149, Validation accuracy 0.7914177387952804
Epoch 9, Train loss 0.48932312767614017, Train accuracy 0.8271946023133668, Validation loss 0.5179160907864571, Validation accuracy 0.8280675560235977
Validation accuracy increased from 0.80 to 0.83
Epoch 10, Train loss 0.46274790641936386, Train accuracy 0.8379678621210835, Validation loss 0.5364211097359657, Validation accuracy 0.8211282163858413
Epoch 11, Train loss 0.4367316353388808, Train accuracy 0.8472860438579862, Validation loss 0.5305675610899925, Validation accuracy 0.8249655336141586
Epoch 12, Train loss 0.4171172266995365, Train accuracy 0.8533726917071776, Validation loss 0.5026642546057701, Validation accuracy 0.8304572612047195
Validation accuracy increased from 0.83 to 0.83
Epoch 13, Train loss 0.3959633277898485, Train accuracy 0.861107066612352, Validation loss 0.5687904238700867, Validation accuracy 0.8118336409330368
Epoch 14, Train loss 0.3828764283521609, Train accuracy 0.8651269528676163, Validation loss 0.45057124048471453, Validation accuracy 0.8465533077716827
Validation accuracy increased from 0.83 to 0.85
Epoch 15, Train loss 0.3636910310861739, Train accuracy 0.8718030892989852, Validation loss 0.4700760394334793, Validation accuracy 0.8424287676811218
Epoch 16, Train loss 0.34495095908641815, Train accuracy 0.8768013136630709, Validation loss 0.5348183006048203, Validation accuracy 0.8339728862047195
Epoch 17, Train loss 0.3345735961232673, Train accuracy 0.8823490765961733, Validation loss 0.47099848985672, Validation accuracy 0.8504365801811218
Validation accuracy increased from 0.85 to 0.85
Epoch 18, Train loss 0.3231056562032212, Train accuracy 0.8851713423024524, Validation loss 0.5074761018157006, Validation accuracy 0.8406479775905609
Epoch 19, Train loss 0.30163088982755487, Train accuracy 0.8934969813986258, Validation loss 0.44045536816120145, Validation accuracy 0.8548253685235977
Validation accuracy increased from 0.85 to 0.85
Epoch 20, Train loss 0.2331948412412947, Train accuracy 0.91826882077889, Validation loss 0.358911469578743, Validation accuracy 0.8838809758424759
Validation accuracy increased from 0.85 to 0.88
Epoch 21, Train loss 0.20944463173774155, Train accuracy 0.9274316406385466, Validation loss 0.3488190442323685, Validation accuracy 0.8885454952716827
Validation accuracy increased from 0.88 to 0.89
Epoch 22, Train loss 0.1997003534554758, Train accuracy 0.9288210225376216, Validation loss 0.3665844812989235, Validation accuracy 0.8888671875
Validation accuracy increased from 0.89 to 0.89
Epoch 23, Train loss 0.18896412227133458, Train accuracy 0.933250177312981, Validation loss 0.3719509825110435, Validation accuracy 0.8874425560235977
Epoch 24, Train loss 0.183769734703343, Train accuracy 0.934462002732537, Validation loss 0.3659969180822372, Validation accuracy 0.892578125
Validation accuracy increased from 0.89 to 0.89
Epoch 25, Train loss 0.17838733554394406, Train accuracy 0.9376376064663584, Validation loss 0.3708431974053383, Validation accuracy 0.8911190271377564
Epoch 26, Train loss 0.16904457527297465, Train accuracy 0.9408433948728171, Validation loss 0.3632658213376999, Validation accuracy 0.8881089150905609
Epoch 27, Train loss 0.16249970863149923, Train accuracy 0.9423339841040698, Validation loss 0.40053874999284744, Validation accuracy 0.8801240801811219
Epoch 28, Train loss 0.15625527010045268, Train accuracy 0.9448499642312527, Validation loss 0.3913696989417076, Validation accuracy 0.8839154422283173
Epoch 29, Train loss 0.15228694372556426, Train accuracy 0.9454314630817283, Validation loss 0.3941489025950432, Validation accuracy 0.8859145224094391
Epoch 30, Train loss 0.14771017665043473, Train accuracy 0.9475337358360941, Validation loss 0.39496547132730486, Validation accuracy 0.8861328125
Epoch 31, Train loss 0.13946114222265102, Train accuracy 0.9497620737688108, Validation loss 0.40545399487018585, Validation accuracy 0.8866383284330368
Epoch 32, Train loss 0.13634043457833203, Train accuracy 0.9512428976595402, Validation loss 0.4429520457983017, Validation accuracy 0.8808823525905609
Epoch 33, Train loss 0.13042210097509352, Train accuracy 0.9537411220371723, Validation loss 0.40061544328927995, Validation accuracy 0.8914292275905609
Epoch 34, Train loss 0.12473053540187803, Train accuracy 0.9554758522320878, Validation loss 0.38881577253341676, Validation accuracy 0.8944623172283173
Validation accuracy increased from 0.89 to 0.89
Epoch 35, Train loss 0.12101044376719404, Train accuracy 0.956928267059001, Validation loss 0.43616104274988177, Validation accuracy 0.8877182900905609
Epoch 36, Train loss 0.11372374882921576, Train accuracy 0.9594131745398045, Validation loss 0.44156306982040405, Validation accuracy 0.8858111202716827
Epoch 37, Train loss 0.11139505460265685, Train accuracy 0.9594078480520032, Validation loss 0.4026687204837799, Validation accuracy 0.8942325383424758
Epoch 38, Train loss 0.10711474189619449, Train accuracy 0.9611097299917177, Validation loss 0.4216271281242371, Validation accuracy 0.8930147051811218
Epoch 39, Train loss 0.10936067107302899, Train accuracy 0.9609446020966227, Validation loss 0.4328591078519821, Validation accuracy 0.8897173702716827
Epoch 40, Train loss 0.07664804101328958, Train accuracy 0.9740740409628912, Validation loss 0.40781512260437014, Validation accuracy 0.8922794133424758
Epoch 41, Train loss 0.06922084484672682, Train accuracy 0.9767533733763478, Validation loss 0.39813492968678477, Validation accuracy 0.8977022051811219
Validation accuracy increased from 0.89 to 0.90
Epoch 42, Train loss 0.06551208295224403, Train accuracy 0.9775301844558932, Validation loss 0.40347380489110946, Validation accuracy 0.901953125
Validation accuracy increased from 0.90 to 0.90
Epoch 43, Train loss 0.06406813619700684, Train accuracy 0.9776065339418974, Validation loss 0.4056297354400158, Validation accuracy 0.8984375
Epoch 44, Train loss 0.05905189908067272, Train accuracy 0.9803524501621723, Validation loss 0.4154690757393837, Validation accuracy 0.8965073525905609
Epoch 45, Train loss 0.058303465992635625, Train accuracy 0.9801429330625318, Validation loss 0.4235202208161354, Validation accuracy 0.8933823525905609
Epoch 46, Train loss 0.05519355367869139, Train accuracy 0.9810555749996142, Validation loss 0.4095281660556793, Validation accuracy 0.8958984375
Epoch 47, Train loss 0.05446773665872487, Train accuracy 0.9814648435197093, Validation loss 0.42163272202014923, Validation accuracy 0.89765625
Epoch 48, Train loss 0.051981482432562516, Train accuracy 0.9822798293422569, Validation loss 0.42533720582723616, Validation accuracy 0.8959214150905609
Epoch 49, Train loss 0.050737548889380625, Train accuracy 0.9830530892041597, Validation loss 0.4300265148282051, Validation accuracy 0.8978745400905609
Epoch 50, Train loss 0.047462207614444196, Train accuracy 0.9835830964148045, Validation loss 0.43291072100400924, Validation accuracy 0.9004136025905609
Epoch 51, Train loss 0.04725774070671336, Train accuracy 0.9840394173833457, Validation loss 0.44247169643640516, Validation accuracy 0.8953814327716827
Epoch 52, Train loss 0.045702068743676966, Train accuracy 0.9844193892045454, Validation loss 0.4528722882270813, Validation accuracy 0.8982421875
Epoch 53, Train loss 0.04474258753047748, Train accuracy 0.9844513491473414, Validation loss 0.456254543364048, Validation accuracy 0.8943818926811218
Epoch 54, Train loss 0.04422689723485911, Train accuracy 0.9846857244318182, Validation loss 0.4426246479153633, Validation accuracy 0.8980698525905609
Epoch 55, Train loss 0.044611053382554514, Train accuracy 0.9843403761359778, Validation loss 0.44035367071628573, Validation accuracy 0.901585477590561
Epoch 56, Train loss 0.04146830907451327, Train accuracy 0.9863032668151639, Validation loss 0.4594019055366516, Validation accuracy 0.8986328125
Epoch 57, Train loss 0.04057364701293409, Train accuracy 0.9861922938038002, Validation loss 0.46026592403650285, Validation accuracy 0.8936236202716827
Epoch 58, Train loss 0.04137513108699667, Train accuracy 0.986125709996982, Validation loss 0.46485940665006636, Validation accuracy 0.8984375
Epoch 59, Train loss 0.03920176671817899, Train accuracy 0.9868643463335254, Validation loss 0.45094316750764846, Validation accuracy 0.8980928301811218
Epoch 60, Train loss 0.032398197868711905, Train accuracy 0.9895561076700687, Validation loss 0.45339196026325224, Validation accuracy 0.8981158077716828
Epoch 61, Train loss 0.029705501317618076, Train accuracy 0.9901899857954546, Validation loss 0.4507669985294342, Validation accuracy 0.8977022051811219
Epoch 62, Train loss 0.029030633508227766, Train accuracy 0.9902539060197093, Validation loss 0.45564155727624894, Validation accuracy 0.8998046875
Epoch 63, Train loss 0.027691967467862098, Train accuracy 0.9909765622155233, Validation loss 0.45092352032661437, Validation accuracy 0.9021714150905609
Validation accuracy increased from 0.90 to 0.90
Epoch 64, Train loss 0.02667988160762682, Train accuracy 0.9911416901106184, Validation loss 0.45649528205394746, Validation accuracy 0.901585477590561
Epoch 65, Train loss 0.027968138331991875, Train accuracy 0.9908211999996142, Validation loss 0.4531939819455147, Validation accuracy 0.9023667275905609
Validation accuracy increased from 0.90 to 0.90
Epoch 66, Train loss 0.028346252368382095, Train accuracy 0.9902503551407293, Validation loss 0.46748643070459367, Validation accuracy 0.90078125
Epoch 67, Train loss 0.02664227234146727, Train accuracy 0.9913094812496142, Validation loss 0.46527269929647447, Validation accuracy 0.899632352590561
Epoch 68, Train loss 0.025779637426074423, Train accuracy 0.9916486150839112, Validation loss 0.4707718387246132, Validation accuracy 0.8982881426811218
Epoch 69, Train loss 0.024439407713626595, Train accuracy 0.9921812855384566, Validation loss 0.4635006383061409, Validation accuracy 0.8994140625
Epoch 0, Train loss 1.4873516850850799, Train accuracy 0.4497869316149842, Validation loss 1.3064136505126953, Validation accuracy 0.5260799646377563
Validation accuracy increased from 0.00 to 0.53
Epoch 1, Train loss 1.080308698117733, Train accuracy 0.6116255325349894, Validation loss 1.2016765475273132, Validation accuracy 0.5820197612047195
Validation accuracy increased from 0.53 to 0.58
Epoch 2, Train loss 0.895154358311133, Train accuracy 0.6819984018802643, Validation loss 0.9713131874799729, Validation accuracy 0.6794577211141586
Validation accuracy increased from 0.58 to 0.68
Epoch 3, Train loss 0.7736089453101158, Train accuracy 0.7282919033684514, Validation loss 0.7955115497112274, Validation accuracy 0.725390625
Validation accuracy increased from 0.68 to 0.73
Epoch 4, Train loss 0.682905087755485, Train accuracy 0.7608842328190804, Validation loss 0.7164440542459488, Validation accuracy 0.7555491715669632
Validation accuracy increased from 0.73 to 0.76
Epoch 5, Train loss 0.6226104394617406, Train accuracy 0.7821715196425264, Validation loss 0.5931895181536675, Validation accuracy 0.7953929215669632
Validation accuracy increased from 0.76 to 0.80
Epoch 6, Train loss 0.5665813041004267, Train accuracy 0.803344282575629, Validation loss 0.6300932317972183, Validation accuracy 0.7820542275905609
Epoch 7, Train loss 0.5289900583977049, Train accuracy 0.8154199218208139, Validation loss 0.5391407653689384, Validation accuracy 0.8114085465669632
Validation accuracy increased from 0.80 to 0.81
Epoch 8, Train loss 0.49897184256802907, Train accuracy 0.8256880326027219, Validation loss 0.5981867879629135, Validation accuracy 0.8055032163858413
Epoch 9, Train loss 0.46990561654621904, Train accuracy 0.8349627131088213, Validation loss 0.5165363296866416, Validation accuracy 0.8247931987047196
Validation accuracy increased from 0.81 to 0.82
Epoch 10, Train loss 0.4428269002925266, Train accuracy 0.8455957028676163, Validation loss 0.4964520335197449, Validation accuracy 0.8335363060235977
Validation accuracy increased from 0.82 to 0.83
Epoch 11, Train loss 0.4203965606337244, Train accuracy 0.8526757809926163, Validation loss 0.5083931118249894, Validation accuracy 0.8265739887952804
Epoch 12, Train loss 0.39282552880997007, Train accuracy 0.8607519529759884, Validation loss 0.5491124197840691, Validation accuracy 0.8192784935235977
Epoch 13, Train loss 0.3864918633956801, Train accuracy 0.8636505681682717, Validation loss 0.4528194278478622, Validation accuracy 0.8467716008424759
Validation accuracy increased from 0.83 to 0.85
Epoch 14, Train loss 0.3676945917646993, Train accuracy 0.8703329190611839, Validation loss 0.4221678987145424, Validation accuracy 0.8642003685235977
Validation accuracy increased from 0.85 to 0.86
Epoch 15, Train loss 0.3454341193322431, Train accuracy 0.879685724323446, Validation loss 0.47890155017375946, Validation accuracy 0.8433823525905609
Epoch 16, Train loss 0.33715945964848454, Train accuracy 0.8805708451704546, Validation loss 0.430968365073204, Validation accuracy 0.8554113060235977
Epoch 17, Train loss 0.31858169431374833, Train accuracy 0.8889559656381607, Validation loss 0.4481478586792946, Validation accuracy 0.8511603862047196
Epoch 18, Train loss 0.3111168196932836, Train accuracy 0.8908789063041861, Validation loss 0.39062876999378204, Validation accuracy 0.8690372258424759
Validation accuracy increased from 0.86 to 0.87
Epoch 19, Train loss 0.29865543239495973, Train accuracy 0.8947238989851691, Validation loss 0.43521029949188234, Validation accuracy 0.8556066185235978
Epoch 20, Train loss 0.22379532845860178, Train accuracy 0.9216042255813425, Validation loss 0.3288430832326412, Validation accuracy 0.8843290448188782
Validation accuracy increased from 0.87 to 0.88
Epoch 21, Train loss 0.1997130143202164, Train accuracy 0.9289506389336153, Validation loss 0.34206981509923934, Validation accuracy 0.8875459551811218
Validation accuracy increased from 0.88 to 0.89
Epoch 22, Train loss 0.19236920177089897, Train accuracy 0.9327903051267971, Validation loss 0.3434415481984615, Validation accuracy 0.8889131426811219
Validation accuracy increased from 0.89 to 0.89
Epoch 23, Train loss 0.18220305209979415, Train accuracy 0.935325816612352, Validation loss 0.3522114783525467, Validation accuracy 0.8838350176811218
Epoch 24, Train loss 0.17553016771985727, Train accuracy 0.938246626406908, Validation loss 0.35155165791511533, Validation accuracy 0.889453125
Validation accuracy increased from 0.89 to 0.89
Epoch 25, Train loss 0.16823386612602256, Train accuracy 0.9402476914904334, Validation loss 0.3612267881631851, Validation accuracy 0.886500459909439
Epoch 26, Train loss 0.16340015820142897, Train accuracy 0.9427494670857083, Validation loss 0.36838819831609726, Validation accuracy 0.8857192099094391
Epoch 27, Train loss 0.16054337425157428, Train accuracy 0.9433034445074472, Validation loss 0.36644446700811384, Validation accuracy 0.8919921875
Validation accuracy increased from 0.89 to 0.89
Epoch 28, Train loss 0.15410134429112077, Train accuracy 0.9450887783684514, Validation loss 0.3719961643218994, Validation accuracy 0.8893612146377563
Epoch 29, Train loss 0.14882377801801672, Train accuracy 0.9477521306411787, Validation loss 0.3593038633465767, Validation accuracy 0.8931640625
Validation accuracy increased from 0.89 to 0.89
Epoch 30, Train loss 0.13896816630255093, Train accuracy 0.950551313771443, Validation loss 0.3756266303360462, Validation accuracy 0.8896714150905609
Epoch 31, Train loss 0.1383813462558795, Train accuracy 0.9506809301674366, Validation loss 0.38747851848602294, Validation accuracy 0.8851792275905609
Epoch 32, Train loss 0.13244214715351435, Train accuracy 0.9528435722670772, Validation loss 0.37323915064334867, Validation accuracy 0.8923138797283172
Epoch 33, Train loss 0.1291407182474028, Train accuracy 0.9534534798427061, Validation loss 0.38414237797260287, Validation accuracy 0.8896943926811218
Epoch 34, Train loss 0.12584556033834815, Train accuracy 0.9542009942233562, Validation loss 0.39161830097436906, Validation accuracy 0.8924862146377563
Epoch 35, Train loss 0.12233385069041768, Train accuracy 0.9550949927758087, Validation loss 0.3945110857486725, Validation accuracy 0.8886488974094391
Epoch 36, Train loss 0.11734433122910559, Train accuracy 0.9579740766097199, Validation loss 0.3870729073882103, Validation accuracy 0.8904296875
Epoch 37, Train loss 0.11587701289152558, Train accuracy 0.9581738280301745, Validation loss 0.40646977722644806, Validation accuracy 0.8848920047283173
Epoch 38, Train loss 0.11079747016033666, Train accuracy 0.959955610673536, Validation loss 0.41001633554697037, Validation accuracy 0.8865693926811218
Epoch 39, Train loss 0.1086807706266303, Train accuracy 0.9615696021779017, Validation loss 0.411254820227623, Validation accuracy 0.8904526650905609
Epoch 40, Train loss 0.0836890285030346, Train accuracy 0.9706818180328066, Validation loss 0.37696858048439025, Validation accuracy 0.8981962323188781
Validation accuracy increased from 0.89 to 0.90
Epoch 41, Train loss 0.06971306235275486, Train accuracy 0.9767311787740751, Validation loss 0.3794881761074066, Validation accuracy 0.901171875
Validation accuracy increased from 0.90 to 0.90
Epoch 42, Train loss 0.06624962361952798, Train accuracy 0.9778533378107981, Validation loss 0.38593053072690964, Validation accuracy 0.8993451297283173
Epoch 43, Train loss 0.06167734632353214, Train accuracy 0.9786940694532611, Validation loss 0.3968822628259659, Validation accuracy 0.9028837323188782
Validation accuracy increased from 0.90 to 0.90
Epoch 44, Train loss 0.06194847470826723, Train accuracy 0.9791850139471617, Validation loss 0.39836631566286085, Validation accuracy 0.9011259198188781
Epoch 45, Train loss 0.062115695687349544, Train accuracy 0.9784810011359778, Validation loss 0.4123719945549965, Validation accuracy 0.8973230689764022
Epoch 46, Train loss 0.060280347666279835, Train accuracy 0.9787730821831659, Validation loss 0.4110273435711861, Validation accuracy 0.9022977948188782
Epoch 47, Train loss 0.05913040782748298, Train accuracy 0.9795756390826269, Validation loss 0.41237398236989975, Validation accuracy 0.8997817099094391
Epoch 48, Train loss 0.05650030788753859, Train accuracy 0.9805326702242548, Validation loss 0.40323990285396577, Validation accuracy 0.9024471521377564
Epoch 49, Train loss 0.05292520467826927, Train accuracy 0.9814080253920772, Validation loss 0.4200636476278305, Validation accuracy 0.9031824439764022
Validation accuracy increased from 0.90 to 0.90
Epoch 50, Train loss 0.05387825643199242, Train accuracy 0.981487038121982, Validation loss 0.41820373982191084, Validation accuracy 0.8991498172283172
Epoch 51, Train loss 0.053692837288095194, Train accuracy 0.9802920808168974, Validation loss 0.4540320888161659, Validation accuracy 0.8941176474094391
Epoch 52, Train loss 0.05119038411860608, Train accuracy 0.982463600621982, Validation loss 0.44335554391145704, Validation accuracy 0.8983685672283173
Epoch 53, Train loss 0.04982002414974638, Train accuracy 0.98242542587898, Validation loss 0.43302796483039857, Validation accuracy 0.9019301474094391
Epoch 54, Train loss 0.050278001009825275, Train accuracy 0.9828693179244344, Validation loss 0.4361957833170891, Validation accuracy 0.8993221521377563
Epoch 55, Train loss 0.04747934439960359, Train accuracy 0.9840678264471617, Validation loss 0.44151237308979036, Validation accuracy 0.8998851090669632
Epoch 56, Train loss 0.04506182294360108, Train accuracy 0.9847745028409091, Validation loss 0.44695619195699693, Validation accuracy 0.8997587323188782
Epoch 57, Train loss 0.044941044978755104, Train accuracy 0.9838396659628912, Validation loss 0.4425496801733971, Validation accuracy 0.9011029422283172
Epoch 58, Train loss 0.04500386470251463, Train accuracy 0.9842391688038002, Validation loss 0.4436082348227501, Validation accuracy 0.9011259198188781
Epoch 59, Train loss 0.043307378840505735, Train accuracy 0.9846795099702749, Validation loss 0.44808153361082076, Validation accuracy 0.9026654422283172
Epoch 60, Train loss 0.038101702330591666, Train accuracy 0.9870898435738954, Validation loss 0.4426087200641632, Validation accuracy 0.9001493573188781
Epoch 61, Train loss 0.034627302734985606, Train accuracy 0.9886337000538002, Validation loss 0.4457537174224854, Validation accuracy 0.9028607547283173
Epoch 62, Train loss 0.03588681017175655, Train accuracy 0.9879962710494344, Validation loss 0.44566982984542847, Validation accuracy 0.9033203125
Validation accuracy increased from 0.90 to 0.90
Epoch 63, Train loss 0.03327322436962277, Train accuracy 0.9887127127837051, Validation loss 0.44805209785699845, Validation accuracy 0.9040326297283172
Validation accuracy increased from 0.90 to 0.90
Epoch 64, Train loss 0.032876676763407886, Train accuracy 0.9893723363903436, Validation loss 0.4461779177188873, Validation accuracy 0.9025160849094391
Epoch 65, Train loss 0.03340485848655755, Train accuracy 0.988646128976887, Validation loss 0.44894624799489974, Validation accuracy 0.9027113974094391
Epoch 66, Train loss 0.033581131931648335, Train accuracy 0.9890616119585254, Validation loss 0.45484837889671326, Validation accuracy 0.9023207724094391
Epoch 67, Train loss 0.030916679454755715, Train accuracy 0.9898002482950687, Validation loss 0.4565906345844269, Validation accuracy 0.9024931073188782
Epoch 68, Train loss 0.030594880994282325, Train accuracy 0.9901997511359778, Validation loss 0.4549835279583931, Validation accuracy 0.9034466922283173
Epoch 69, Train loss 0.02937027613833462, Train accuracy 0.9901997511359778, Validation loss 0.4602338641881943, Validation accuracy 0.9047909021377564
Validation accuracy increased from 0.90 to 0.90
Test loss: 0.40069562681019305 Test accuracy: 0.91416015625  resnet10_Adam_0.001
Test loss: 0.3959468550980091 Test accuracy: 0.92978515625  resnet18_Adam_0.001
Test loss: 0.3972526863217354 Test accuracy: 0.87763671875  resnet12_Adam_0.001
Test loss: 0.5251797050237655 Test accuracy: 0.8892578125  resnet14_4_Adam_0.001
Test loss: 0.5100711170583964 Test accuracy: 0.89365234375  resnet14_5_Adam_0.001
Epoch 0, Train loss 1.878474904054945, Train accuracy 0.31299183229831135, Validation loss 1.6251863956451416, Validation accuracy 0.3996668204665184
Validation accuracy increased from 0.00 to 0.40
Epoch 1, Train loss 1.5543536577712407, Train accuracy 0.43295188197358087, Validation loss 1.464155262708664, Validation accuracy 0.46756663620471955
Validation accuracy increased from 0.40 to 0.47
Epoch 2, Train loss 1.4392681514674968, Train accuracy 0.47769886356863106, Validation loss 1.379636138677597, Validation accuracy 0.505859375
Validation accuracy increased from 0.47 to 0.51
Epoch 3, Train loss 1.3612938577478582, Train accuracy 0.5050790127028119, Validation loss 1.3217259109020234, Validation accuracy 0.5320197612047195
Validation accuracy increased from 0.51 to 0.53
Epoch 4, Train loss 1.2996461804617534, Train accuracy 0.5328879617154598, Validation loss 1.3348344445228577, Validation accuracy 0.5232651650905609
Epoch 5, Train loss 1.249456170607697, Train accuracy 0.5504545454274524, Validation loss 1.1955587208271026, Validation accuracy 0.5706686586141586
Validation accuracy increased from 0.53 to 0.57
Epoch 6, Train loss 1.202770871194926, Train accuracy 0.5682714842259884, Validation loss 1.1714366316795348, Validation accuracy 0.5843635112047195
Validation accuracy increased from 0.57 to 0.58
Epoch 7, Train loss 1.1614791750907898, Train accuracy 0.5873748223212633, Validation loss 1.1246642529964448, Validation accuracy 0.5926930159330368
Validation accuracy increased from 0.58 to 0.59
Epoch 8, Train loss 1.1215618886053562, Train accuracy 0.5986878550188108, Validation loss 1.1113611996173858, Validation accuracy 0.6042509198188781
Validation accuracy increased from 0.59 to 0.60
Epoch 9, Train loss 1.0922014808112925, Train accuracy 0.6132874644615434, Validation loss 1.0624427020549774, Validation accuracy 0.6241727948188782
Validation accuracy increased from 0.60 to 0.62
Epoch 10, Train loss 1.0577880587767472, Train accuracy 0.6245214844291861, Validation loss 1.0476466357707976, Validation accuracy 0.629124540090561
Validation accuracy increased from 0.62 to 0.63
Epoch 11, Train loss 1.0294167053970424, Train accuracy 0.635248579423536, Validation loss 1.034454020857811, Validation accuracy 0.6305376827716828
Validation accuracy increased from 0.63 to 0.63
Epoch 12, Train loss 0.999097004532814, Train accuracy 0.6479252485389059, Validation loss 0.9903148263692856, Validation accuracy 0.6475413590669632
Validation accuracy increased from 0.63 to 0.65
Epoch 13, Train loss 0.9773821651258252, Train accuracy 0.6556383168155496, Validation loss 0.9894242584705353, Validation accuracy 0.6525275737047196
Validation accuracy increased from 0.65 to 0.65
Epoch 14, Train loss 0.9580503173849799, Train accuracy 0.660300958562981, Validation loss 0.9612735509872437, Validation accuracy 0.6604090064764023
Validation accuracy increased from 0.65 to 0.66
Epoch 15, Train loss 0.9377703842791644, Train accuracy 0.669954722916538, Validation loss 0.9450020730495453, Validation accuracy 0.6656135112047196
Validation accuracy increased from 0.66 to 0.67
Epoch 16, Train loss 0.9121002148498188, Train accuracy 0.6776491478085518, Validation loss 1.0303239524364471, Validation accuracy 0.6416819840669632
Epoch 17, Train loss 0.8957309573888779, Train accuracy 0.6850905540314588, Validation loss 0.8889834761619568, Validation accuracy 0.6899126827716827
Validation accuracy increased from 0.67 to 0.69
Epoch 18, Train loss 0.8768043897368691, Train accuracy 0.6908416192639958, Validation loss 0.8704118341207504, Validation accuracy 0.6965303301811219
Validation accuracy increased from 0.69 to 0.70
Epoch 19, Train loss 0.859313132072037, Train accuracy 0.696556285362352, Validation loss 0.8699060648679733, Validation accuracy 0.6941061586141586
Epoch 20, Train loss 0.830410314554518, Train accuracy 0.7083762426945296, Validation loss 0.8203228175640106, Validation accuracy 0.7129365801811218
Validation accuracy increased from 0.70 to 0.71
Epoch 21, Train loss 0.8189485056156461, Train accuracy 0.7131640623238954, Validation loss 0.8301782071590423, Validation accuracy 0.7109145224094391
Epoch 22, Train loss 0.8132981762967326, Train accuracy 0.7176260653544556, Validation loss 0.8297051787376404, Validation accuracy 0.7080997258424759
Epoch 23, Train loss 0.8087865280156786, Train accuracy 0.7149005681276321, Validation loss 0.8051431626081467, Validation accuracy 0.71796875
Validation accuracy increased from 0.71 to 0.72
Epoch 24, Train loss 0.8012093515558676, Train accuracy 0.7199999998238954, Validation loss 0.8110252767801285, Validation accuracy 0.7197035849094391
Validation accuracy increased from 0.72 to 0.72
Epoch 25, Train loss 0.7990707904100418, Train accuracy 0.720814985646443, Validation loss 0.8213895410299301, Validation accuracy 0.7159926474094391
Epoch 26, Train loss 0.7901002514091405, Train accuracy 0.7243030894209038, Validation loss 0.8139781445264817, Validation accuracy 0.7146024823188781
Epoch 27, Train loss 0.7874939536506479, Train accuracy 0.7252405895428224, Validation loss 0.7955238342285156, Validation accuracy 0.71953125
Epoch 28, Train loss 0.7797317366031083, Train accuracy 0.7273144528947093, Validation loss 0.7761047393083572, Validation accuracy 0.7245863974094391
Validation accuracy increased from 0.72 to 0.72
Epoch 29, Train loss 0.7784953875975176, Train accuracy 0.7289817116477273, Validation loss 0.7838987469673157, Validation accuracy 0.7267348349094391
Validation accuracy increased from 0.72 to 0.73
Epoch 30, Train loss 0.7681695331226696, Train accuracy 0.7320232597941702, Validation loss 0.7894995361566544, Validation accuracy 0.7226332724094391
Epoch 31, Train loss 0.7674937353215434, Train accuracy 0.7308975495398045, Validation loss 0.7736601591110229, Validation accuracy 0.7276424646377564
Validation accuracy increased from 0.73 to 0.73
Epoch 32, Train loss 0.7575722932815552, Train accuracy 0.73633167587898, Validation loss 0.7706800132989884, Validation accuracy 0.7291590064764023
Validation accuracy increased from 0.73 to 0.73
Epoch 33, Train loss 0.7542208158834414, Train accuracy 0.7354847301136364, Validation loss 0.7638546139001846, Validation accuracy 0.7320082724094391
Validation accuracy increased from 0.73 to 0.73
Epoch 34, Train loss 0.7497963492165912, Train accuracy 0.7389559657736258, Validation loss 0.7728356033563614, Validation accuracy 0.7288602948188782
Epoch 35, Train loss 0.7451997568661516, Train accuracy 0.7402388138527219, Validation loss 0.7631799787282944, Validation accuracy 0.725
Epoch 36, Train loss 0.7427572272717953, Train accuracy 0.7410830963741649, Validation loss 0.7559689462184906, Validation accuracy 0.7389935672283172
Validation accuracy increased from 0.73 to 0.74
Epoch 37, Train loss 0.7370912825519388, Train accuracy 0.7442835582928224, Validation loss 0.7726655423641204, Validation accuracy 0.7291819840669632
Epoch 38, Train loss 0.7305921932513063, Train accuracy 0.7440909089689905, Validation loss 0.7489045798778534, Validation accuracy 0.7378216922283173
Epoch 39, Train loss 0.7264227430251512, Train accuracy 0.7471342327242548, Validation loss 0.7364551901817322, Validation accuracy 0.7401884198188782
Validation accuracy increased from 0.74 to 0.74
Epoch 40, Train loss 0.715227279134772, Train accuracy 0.7499138848348097, Validation loss 0.7228073507547379, Validation accuracy 0.7491268396377564
Validation accuracy increased from 0.74 to 0.75
Epoch 41, Train loss 0.7141545685854825, Train accuracy 0.7520028406923468, Validation loss 0.72634417116642, Validation accuracy 0.7450482547283173
Epoch 42, Train loss 0.7127661068331111, Train accuracy 0.74975941025398, Validation loss 0.7255334794521332, Validation accuracy 0.7461741715669632
Epoch 43, Train loss 0.7079588469456543, Train accuracy 0.754309303719889, Validation loss 0.724327352643013, Validation accuracy 0.7450252771377563
Epoch 44, Train loss 0.7085655135187235, Train accuracy 0.7544007457115434, Validation loss 0.7210924059152604, Validation accuracy 0.744898897409439
Epoch 45, Train loss 0.7064568969336423, Train accuracy 0.7548703835769133, Validation loss 0.7257812738418579, Validation accuracy 0.7446576297283173
Epoch 46, Train loss 0.7042032578452067, Train accuracy 0.7552965198728171, Validation loss 0.7154673129320145, Validation accuracy 0.7503216922283172
Validation accuracy increased from 0.75 to 0.75
Epoch 47, Train loss 0.7046342190693725, Train accuracy 0.7530220167880709, Validation loss 0.7183214902877808, Validation accuracy 0.7491727948188782
Epoch 48, Train loss 0.7019032134928487, Train accuracy 0.7560271661389958, Validation loss 0.717070871591568, Validation accuracy 0.7499080896377563
Epoch 49, Train loss 0.7001170265403661, Train accuracy 0.754999999972907, Validation loss 0.7135404646396637, Validation accuracy 0.7509535849094391
Validation accuracy increased from 0.75 to 0.75
Epoch 50, Train loss 0.6953121796250343, Train accuracy 0.7587064985524524, Validation loss 0.7147647649049759, Validation accuracy 0.7489774823188782
Epoch 51, Train loss 0.6951196816834536, Train accuracy 0.7566725852137263, Validation loss 0.712788051366806, Validation accuracy 0.7516429215669632
Validation accuracy increased from 0.75 to 0.75
Epoch 52, Train loss 0.6929985965517435, Train accuracy 0.7592036575078964, Validation loss 0.7104261368513107, Validation accuracy 0.7544002771377564
Validation accuracy increased from 0.75 to 0.75
Epoch 53, Train loss 0.6947164345871318, Train accuracy 0.756394708698446, Validation loss 0.7077299207448959, Validation accuracy 0.7526424646377563
Epoch 54, Train loss 0.6945470317520879, Train accuracy 0.7583966617557135, Validation loss 0.7100188851356506, Validation accuracy 0.7518152564764022
Epoch 55, Train loss 0.6932305683466521, Train accuracy 0.7600337358360941, Validation loss 0.7061836510896683, Validation accuracy 0.7522288590669632
Epoch 56, Train loss 0.6916339959610592, Train accuracy 0.7582049004056237, Validation loss 0.7034251153469085, Validation accuracy 0.7545726090669632
Validation accuracy increased from 0.75 to 0.75
Epoch 57, Train loss 0.6870465407317335, Train accuracy 0.7612073861739852, Validation loss 0.7042577594518662, Validation accuracy 0.7544002771377564
Epoch 58, Train loss 0.6869656182825565, Train accuracy 0.7612011717124418, Validation loss 0.7037390947341919, Validation accuracy 0.7536190271377563
Epoch 59, Train loss 0.6880850368602709, Train accuracy 0.7619495737281713, Validation loss 0.7096506059169769, Validation accuracy 0.7524471521377564
Epoch 60, Train loss 0.6802813004363667, Train accuracy 0.7648171162740751, Validation loss 0.6981921643018723, Validation accuracy 0.7549862146377564
Validation accuracy increased from 0.75 to 0.75
Epoch 61, Train loss 0.6800109310583635, Train accuracy 0.7627867541529916, Validation loss 0.6987316459417343, Validation accuracy 0.7547909021377563
Epoch 62, Train loss 0.676706883717667, Train accuracy 0.764286221428351, Validation loss 0.6984956085681915, Validation accuracy 0.7555951297283172
Validation accuracy increased from 0.75 to 0.76
Epoch 63, Train loss 0.6784984902902083, Train accuracy 0.7641450637443499, Validation loss 0.6966812402009964, Validation accuracy 0.7561351090669632
Validation accuracy increased from 0.76 to 0.76
Epoch 64, Train loss 0.6783384301445701, Train accuracy 0.7640829187902537, Validation loss 0.6983389586210251, Validation accuracy 0.7563534021377564
Validation accuracy increased from 0.76 to 0.76
Epoch 65, Train loss 0.6793441704728387, Train accuracy 0.7635795453732664, Validation loss 0.6975640922784805, Validation accuracy 0.7561580896377563
Epoch 66, Train loss 0.6768448315560818, Train accuracy 0.7630379972132769, Validation loss 0.6947343319654464, Validation accuracy 0.7567210465669632
Validation accuracy increased from 0.76 to 0.76
Epoch 67, Train loss 0.6785805530168794, Train accuracy 0.7650985440069978, Validation loss 0.6959556937217712, Validation accuracy 0.7569163590669632
Validation accuracy increased from 0.76 to 0.76
Epoch 68, Train loss 0.6776134637607769, Train accuracy 0.7654527696696195, Validation loss 0.6974114447832107, Validation accuracy 0.7552045047283172
Epoch 69, Train loss 0.6714675961570307, Train accuracy 0.7655708451162685, Validation loss 0.6938947409391403, Validation accuracy 0.7598230689764023
Validation accuracy increased from 0.76 to 0.76
Epoch 0, Train loss 1.7666757939891382, Train accuracy 0.34513139199804177, Validation loss 1.4630043804645538, Validation accuracy 0.45022977888584137
Validation accuracy increased from 0.00 to 0.45
Epoch 1, Train loss 1.3725980113853107, Train accuracy 0.4939595169641755, Validation loss 1.3143989861011505, Validation accuracy 0.5206341922283173
Validation accuracy increased from 0.45 to 0.52
Epoch 2, Train loss 1.2008411691270091, Train accuracy 0.5642942115664482, Validation loss 1.1128689855337144, Validation accuracy 0.6056640625
Validation accuracy increased from 0.52 to 0.61
Epoch 3, Train loss 1.0645869624885647, Train accuracy 0.6183389557356184, Validation loss 1.1021518975496292, Validation accuracy 0.6292394310235977
Validation accuracy increased from 0.61 to 0.63
Epoch 4, Train loss 0.9562736339867115, Train accuracy 0.6597913706844504, Validation loss 0.9747564166784286, Validation accuracy 0.6544806987047196
Validation accuracy increased from 0.63 to 0.65
Epoch 5, Train loss 0.8732468323274092, Train accuracy 0.6901740055869926, Validation loss 0.8246595829725265, Validation accuracy 0.7060776650905609
Validation accuracy increased from 0.65 to 0.71
Epoch 6, Train loss 0.8122480023990978, Train accuracy 0.7131915837526321, Validation loss 0.7965124845504761, Validation accuracy 0.7244140625
Validation accuracy increased from 0.71 to 0.72
Epoch 7, Train loss 0.7493976903232661, Train accuracy 0.7354145950891755, Validation loss 0.746543112397194, Validation accuracy 0.7385914534330368
Validation accuracy increased from 0.72 to 0.74
Epoch 8, Train loss 0.7054105583917011, Train accuracy 0.7516956674781713, Validation loss 0.7688747227191925, Validation accuracy 0.7378102034330368
Epoch 9, Train loss 0.658899858255278, Train accuracy 0.7692862214012579, Validation loss 0.6737828463315964, Validation accuracy 0.7646254599094391
Validation accuracy increased from 0.74 to 0.76
Epoch 10, Train loss 0.6110558265989477, Train accuracy 0.785775923254815, Validation loss 0.6114438086748123, Validation accuracy 0.7927389711141586
Validation accuracy increased from 0.76 to 0.79
Epoch 11, Train loss 0.5781036005778746, Train accuracy 0.7986674359576269, Validation loss 0.632230231165886, Validation accuracy 0.7786879599094391
Epoch 12, Train loss 0.5466946258463643, Train accuracy 0.810818536715074, Validation loss 0.6106232613325119, Validation accuracy 0.7901194840669632
Epoch 13, Train loss 0.5180754978209734, Train accuracy 0.8193190693855286, Validation loss 0.5451201871037483, Validation accuracy 0.8064797788858413
Validation accuracy increased from 0.79 to 0.81
Epoch 14, Train loss 0.4893610595979474, Train accuracy 0.8281640623780814, Validation loss 0.5320397287607193, Validation accuracy 0.8160960465669632
Validation accuracy increased from 0.81 to 0.82
Epoch 15, Train loss 0.4641316162252968, Train accuracy 0.8391503905030814, Validation loss 0.5470825985074044, Validation accuracy 0.8120174646377564
Epoch 16, Train loss 0.4418854696506804, Train accuracy 0.845830078152093, Validation loss 0.5376281529664994, Validation accuracy 0.8191521137952804
Validation accuracy increased from 0.82 to 0.82
Epoch 17, Train loss 0.42376695116135205, Train accuracy 0.8511603335765275, Validation loss 0.587489053606987, Validation accuracy 0.8021714150905609
Epoch 18, Train loss 0.40327727303586225, Train accuracy 0.8593723364174366, Validation loss 0.49961894303560256, Validation accuracy 0.8350068926811218
Validation accuracy increased from 0.82 to 0.84
Epoch 19, Train loss 0.38916146162558685, Train accuracy 0.8653116121210835, Validation loss 0.5187050476670265, Validation accuracy 0.8343864887952804
Epoch 20, Train loss 0.32911797384308145, Train accuracy 0.8870925070209936, Validation loss 0.45819599479436873, Validation accuracy 0.8406594663858413
Validation accuracy increased from 0.84 to 0.84
Epoch 21, Train loss 0.3176393522457643, Train accuracy 0.8905229046940804, Validation loss 0.43786182850599287, Validation accuracy 0.8498966008424759
Validation accuracy increased from 0.84 to 0.85
Epoch 22, Train loss 0.3038691477003423, Train accuracy 0.8965784798968922, Validation loss 0.43778517544269563, Validation accuracy 0.8564912676811218
Validation accuracy increased from 0.85 to 0.86
Epoch 23, Train loss 0.29759672936052084, Train accuracy 0.8965065696022727, Validation loss 0.43998417556285857, Validation accuracy 0.8503331810235977
Epoch 24, Train loss 0.2886596093462272, Train accuracy 0.9023970169099894, Validation loss 0.4383406609296799, Validation accuracy 0.8559283077716827
Epoch 25, Train loss 0.2825740847567266, Train accuracy 0.9030078124593605, Validation loss 0.4376302048563957, Validation accuracy 0.8553883284330368
Epoch 26, Train loss 0.27905236497860064, Train accuracy 0.9042897725647147, Validation loss 0.4371132180094719, Validation accuracy 0.8562959551811218
Epoch 27, Train loss 0.26816444522277877, Train accuracy 0.9085351560603488, Validation loss 0.42907551378011705, Validation accuracy 0.8555147051811218
Epoch 28, Train loss 0.26668452784757724, Train accuracy 0.9088423292745244, Validation loss 0.43237653821706773, Validation accuracy 0.8568589150905609
Validation accuracy increased from 0.86 to 0.86
Epoch 29, Train loss 0.26320095563476736, Train accuracy 0.9102503548968922, Validation loss 0.42396950125694277, Validation accuracy 0.8624770224094391
Validation accuracy increased from 0.86 to 0.86
Epoch 30, Train loss 0.2526014970446175, Train accuracy 0.9132714843885466, Validation loss 0.4384380832314491, Validation accuracy 0.8563648909330368
Epoch 31, Train loss 0.24619000786068765, Train accuracy 0.9164106886495244, Validation loss 0.4401027634739876, Validation accuracy 0.8586856633424759
Epoch 32, Train loss 0.2424912273206494, Train accuracy 0.9173277697779916, Validation loss 0.43552381843328475, Validation accuracy 0.8569278508424759
Epoch 33, Train loss 0.23907101577655834, Train accuracy 0.9180690693584356, Validation loss 0.4193659916520119, Validation accuracy 0.8606158077716828
Epoch 34, Train loss 0.2330275744369084, Train accuracy 0.9203737571158193, Validation loss 0.42527069300413134, Validation accuracy 0.86015625
Epoch 35, Train loss 0.2284838596189564, Train accuracy 0.920457208698446, Validation loss 0.42830723226070405, Validation accuracy 0.8632238060235977
Validation accuracy increased from 0.86 to 0.86
Epoch 36, Train loss 0.21948855666613037, Train accuracy 0.9257191050459038, Validation loss 0.42853213995695116, Validation accuracy 0.8655216008424759
Validation accuracy increased from 0.86 to 0.87
Epoch 37, Train loss 0.22005641633983364, Train accuracy 0.9253009588203647, Validation loss 0.4226325675845146, Validation accuracy 0.8635684758424759
Epoch 38, Train loss 0.20848306039856238, Train accuracy 0.9289595169777219, Validation loss 0.433276341855526, Validation accuracy 0.8623966008424759
Epoch 39, Train loss 0.2109978385269642, Train accuracy 0.9274058948186311, Validation loss 0.42938063442707064, Validation accuracy 0.8595358461141587
Epoch 40, Train loss 0.1865071406672624, Train accuracy 0.9369531250135466, Validation loss 0.40167039483785627, Validation accuracy 0.8705078125
Validation accuracy increased from 0.87 to 0.87
Epoch 41, Train loss 0.18049172333187677, Train accuracy 0.9398029118098996, Validation loss 0.39810800105333327, Validation accuracy 0.8696806073188782
Epoch 42, Train loss 0.1762210908345878, Train accuracy 0.9421972656114534, Validation loss 0.39981342703104017, Validation accuracy 0.8724149823188782
Validation accuracy increased from 0.87 to 0.87
Epoch 43, Train loss 0.17535510451786898, Train accuracy 0.9424218748780814, Validation loss 0.402516607940197, Validation accuracy 0.8705307900905609
Epoch 44, Train loss 0.17541344476525078, Train accuracy 0.9421368962661787, Validation loss 0.40192926675081253, Validation accuracy 0.8708524823188781
Epoch 45, Train loss 0.17224100600420075, Train accuracy 0.9430344460362737, Validation loss 0.40690229684114454, Validation accuracy 0.8662109375
Epoch 46, Train loss 0.16790810125795277, Train accuracy 0.9454882812093605, Validation loss 0.40803955793380736, Validation accuracy 0.8712890625
Epoch 47, Train loss 0.16604909084906633, Train accuracy 0.9458433948457241, Validation loss 0.4058996319770813, Validation accuracy 0.8714613974094391
Epoch 48, Train loss 0.16634691201827742, Train accuracy 0.9445783025161787, Validation loss 0.41177098602056506, Validation accuracy 0.8712660849094391
Epoch 49, Train loss 0.16613636555319483, Train accuracy 0.9446289061822675, Validation loss 0.41088354736566546, Validation accuracy 0.8705307900905609
Epoch 50, Train loss 0.16060441969470543, Train accuracy 0.9473339844156395, Validation loss 0.40860212296247483, Validation accuracy 0.8705537676811218
Epoch 51, Train loss 0.16235586628317833, Train accuracy 0.9450603693046353, Validation loss 0.41007145792245864, Validation accuracy 0.8720243573188782
Epoch 52, Train loss 0.1597625923512334, Train accuracy 0.9471812854436311, Validation loss 0.4057387888431549, Validation accuracy 0.870703125
Epoch 53, Train loss 0.15516241216524082, Train accuracy 0.9496546519750898, Validation loss 0.417287977039814, Validation accuracy 0.8693359375
Epoch 54, Train loss 0.1563631734726104, Train accuracy 0.9483700282871723, Validation loss 0.424737548828125, Validation accuracy 0.8646714150905609
Epoch 55, Train loss 0.1536160585978492, Train accuracy 0.9479900568046353, Validation loss 0.4160501405596733, Validation accuracy 0.8701171875
Epoch 56, Train loss 0.15139130562205205, Train accuracy 0.9496448862959038, Validation loss 0.4136682540178299, Validation accuracy 0.871852022409439
Epoch 57, Train loss 0.1522393035279079, Train accuracy 0.9486843039366332, Validation loss 0.41858299970626833, Validation accuracy 0.8687729775905609
Epoch 58, Train loss 0.15130828723142092, Train accuracy 0.9480637427080761, Validation loss 0.41213715821504593, Validation accuracy 0.8718979775905609
Epoch 59, Train loss 0.1480276161296801, Train accuracy 0.9517658024348996, Validation loss 0.40702807158231735, Validation accuracy 0.8753676474094391
Validation accuracy increased from 0.87 to 0.88
Epoch 60, Train loss 0.13937664341012185, Train accuracy 0.953519176014445, Validation loss 0.4075476661324501, Validation accuracy 0.873828125
Epoch 61, Train loss 0.13574790374629878, Train accuracy 0.956410688771443, Validation loss 0.4064732611179352, Validation accuracy 0.8772977948188782
Validation accuracy increased from 0.88 to 0.88
Epoch 62, Train loss 0.1398522619327361, Train accuracy 0.954828657548536, Validation loss 0.4102528989315033, Validation accuracy 0.8743910849094391
Epoch 63, Train loss 0.1377194043756886, Train accuracy 0.955101207237352, Validation loss 0.40765813887119295, Validation accuracy 0.8724609375
Epoch 64, Train loss 0.13994682423601096, Train accuracy 0.9551935368640856, Validation loss 0.4126773938536644, Validation accuracy 0.8743910849094391
Epoch 65, Train loss 0.13624048292298208, Train accuracy 0.9565624997697093, Validation loss 0.4092083558440208, Validation accuracy 0.8747587323188781
Epoch 66, Train loss 0.13544368646530944, Train accuracy 0.956411576745185, Validation loss 0.4081607609987259, Validation accuracy 0.874781709909439
Epoch 67, Train loss 0.13261058372022075, Train accuracy 0.9573366476053541, Validation loss 0.41303111612796783, Validation accuracy 0.8720703125
Epoch 68, Train loss 0.1329025484790856, Train accuracy 0.9564612924375318, Validation loss 0.4096329554915428, Validation accuracy 0.8741957724094391
Epoch 69, Train loss 0.13523909957571464, Train accuracy 0.9560653408142653, Validation loss 0.4139123871922493, Validation accuracy 0.8733915448188782
Epoch 0, Train loss 2.0774649930271236, Train accuracy 0.23179598711431026, Validation loss 1.8321099698543548, Validation accuracy 0.30855928361415863
Validation accuracy increased from 0.00 to 0.31
Epoch 1, Train loss 1.742444366893985, Train accuracy 0.35904740762304177, Validation loss 1.617808645963669, Validation accuracy 0.40409007370471955
Validation accuracy increased from 0.31 to 0.40
Epoch 2, Train loss 1.5745202573862942, Train accuracy 0.41693980822508986, Validation loss 1.4911972522735595, Validation accuracy 0.44747242629528045
Validation accuracy increased from 0.40 to 0.45
Epoch 3, Train loss 1.4660872708667407, Train accuracy 0.46603160520846193, Validation loss 1.486113029718399, Validation accuracy 0.45280330926179885
Validation accuracy increased from 0.45 to 0.45
Epoch 4, Train loss 1.3783990659497, Train accuracy 0.5000976561145349, Validation loss 1.3474051833152771, Validation accuracy 0.506881894171238
Validation accuracy increased from 0.45 to 0.51
Epoch 5, Train loss 1.3143794218247586, Train accuracy 0.5253196023404598, Validation loss 1.2617074787616729, Validation accuracy 0.5461741715669632
Validation accuracy increased from 0.51 to 0.55
Epoch 6, Train loss 1.2493014335632324, Train accuracy 0.5494007458063689, Validation loss 1.246864026784897, Validation accuracy 0.5462201297283172
Validation accuracy increased from 0.55 to 0.55
Epoch 7, Train loss 1.2022129635919223, Train accuracy 0.5663245736875318, Validation loss 1.1564581990242004, Validation accuracy 0.5800666362047195
Validation accuracy increased from 0.55 to 0.58
Epoch 8, Train loss 1.1537914127111435, Train accuracy 0.584575639190999, Validation loss 1.124605330824852, Validation accuracy 0.5994600176811218
Validation accuracy increased from 0.58 to 0.60
Epoch 9, Train loss 1.113397803157568, Train accuracy 0.5984144176949154, Validation loss 1.144673651456833, Validation accuracy 0.5825597435235977
Epoch 10, Train loss 1.0805581276389686, Train accuracy 0.6118954189799048, Validation loss 1.0953546166419983, Validation accuracy 0.6039751827716827
Validation accuracy increased from 0.60 to 0.60
Epoch 11, Train loss 1.0496558662165294, Train accuracy 0.6221040480516173, Validation loss 1.0184854835271835, Validation accuracy 0.6380859375
Validation accuracy increased from 0.60 to 0.64
Epoch 12, Train loss 1.0161879394542088, Train accuracy 0.6344415836713531, Validation loss 1.0188735723495483, Validation accuracy 0.6342371314764023
Epoch 13, Train loss 0.9874516515569254, Train accuracy 0.6475301845507189, Validation loss 0.9607232719659805, Validation accuracy 0.6505514711141587
Validation accuracy increased from 0.64 to 0.65
Epoch 14, Train loss 0.9632566533982754, Train accuracy 0.6551615765148943, Validation loss 0.9278393387794495, Validation accuracy 0.6670841008424759
Validation accuracy increased from 0.65 to 0.67
Epoch 15, Train loss 0.934610431844538, Train accuracy 0.6675195311280814, Validation loss 0.9473855853080749, Validation accuracy 0.6667624086141586
Epoch 16, Train loss 0.9119861400262876, Train accuracy 0.6744202768260782, Validation loss 0.9594880998134613, Validation accuracy 0.6647863060235977
Epoch 17, Train loss 0.8975594385781072, Train accuracy 0.6789914772591807, Validation loss 0.9234917402267456, Validation accuracy 0.6752297788858413
Validation accuracy increased from 0.67 to 0.68
Epoch 18, Train loss 0.8798049369996245, Train accuracy 0.6878684301945296, Validation loss 0.9272169888019561, Validation accuracy 0.6746783077716827
Epoch 19, Train loss 0.8591266389597546, Train accuracy 0.6953506747430022, Validation loss 0.8849510222673416, Validation accuracy 0.6890625
Validation accuracy increased from 0.68 to 0.69
Epoch 20, Train loss 0.824087359349836, Train accuracy 0.7080450992692601, Validation loss 0.8291282176971435, Validation accuracy 0.7050321698188782
Validation accuracy increased from 0.69 to 0.71
Epoch 21, Train loss 0.8163413608616049, Train accuracy 0.7123144529759884, Validation loss 0.8049413174390793, Validation accuracy 0.7161420047283172
Validation accuracy increased from 0.71 to 0.72
Epoch 22, Train loss 0.8114655671471899, Train accuracy 0.7131338776512579, Validation loss 0.8032221525907517, Validation accuracy 0.7200712323188782
Validation accuracy increased from 0.72 to 0.72
Epoch 23, Train loss 0.8074165802787651, Train accuracy 0.7140775922347199, Validation loss 0.7907379627227783, Validation accuracy 0.7196576297283173
Epoch 24, Train loss 0.7983246042647145, Train accuracy 0.7183913351459936, Validation loss 0.7936685711145401, Validation accuracy 0.7198299646377564
Epoch 25, Train loss 0.7936740554869175, Train accuracy 0.7187091616744344, Validation loss 0.832982724905014, Validation accuracy 0.7087431073188781
Epoch 26, Train loss 0.7906873358244245, Train accuracy 0.7201518108221617, Validation loss 0.7828301161527633, Validation accuracy 0.7286420047283173
Validation accuracy increased from 0.72 to 0.73
Epoch 27, Train loss 0.7836534949866208, Train accuracy 0.7225461646237157, Validation loss 0.7722518891096115, Validation accuracy 0.7270795047283173
Epoch 28, Train loss 0.7791048613461581, Train accuracy 0.724998224187981, Validation loss 0.7734124153852463, Validation accuracy 0.7287913590669632
Validation accuracy increased from 0.73 to 0.73
Epoch 29, Train loss 0.7749036266045137, Train accuracy 0.7280850495127115, Validation loss 0.8159143775701523, Validation accuracy 0.7146943926811218
Epoch 30, Train loss 0.7713378671218049, Train accuracy 0.7274822443723679, Validation loss 0.765973374247551, Validation accuracy 0.7294692099094391
Validation accuracy increased from 0.73 to 0.73
Epoch 31, Train loss 0.7642481662333012, Train accuracy 0.7299396304244344, Validation loss 0.7638739079236985, Validation accuracy 0.7331341922283172
Validation accuracy increased from 0.73 to 0.73
Epoch 32, Train loss 0.7618285830725323, Train accuracy 0.7292613634331659, Validation loss 0.7736462384462357, Validation accuracy 0.728297334909439
Epoch 33, Train loss 0.7572517916560173, Train accuracy 0.7332057881761681, Validation loss 0.7556501775979996, Validation accuracy 0.7315487146377564
Epoch 34, Train loss 0.7547200630334291, Train accuracy 0.733177379112352, Validation loss 0.7526778459548951, Validation accuracy 0.7381204038858413
Validation accuracy increased from 0.73 to 0.74
Epoch 35, Train loss 0.7497096539221026, Train accuracy 0.7374573861333457, Validation loss 0.7546373516321182, Validation accuracy 0.7397058814764023
Validation accuracy increased from 0.74 to 0.74
Epoch 36, Train loss 0.7443053302439776, Train accuracy 0.7372700639746406, Validation loss 0.7481761395931243, Validation accuracy 0.7387293189764023
Epoch 37, Train loss 0.742474018511447, Train accuracy 0.7393945309926163, Validation loss 0.7428821086883545, Validation accuracy 0.7396024823188782
Epoch 38, Train loss 0.7370607985014265, Train accuracy 0.7382768108086153, Validation loss 0.7556609064340591, Validation accuracy 0.7364315271377564
Epoch 39, Train loss 0.7327066426250067, Train accuracy 0.7428036220371723, Validation loss 0.7503684908151627, Validation accuracy 0.7387293189764023
Epoch 40, Train loss 0.7193962999365546, Train accuracy 0.7475008876486258, Validation loss 0.7260041236877441, Validation accuracy 0.7473230689764023
Validation accuracy increased from 0.74 to 0.75
Epoch 41, Train loss 0.716950019990856, Train accuracy 0.7480095878920772, Validation loss 0.718420895934105, Validation accuracy 0.7469784021377563
Epoch 42, Train loss 0.7138750427825884, Train accuracy 0.7491370737552643, Validation loss 0.7235660284757615, Validation accuracy 0.7453469663858414
Epoch 43, Train loss 0.7138384905728427, Train accuracy 0.7494540126486258, Validation loss 0.7231270790100097, Validation accuracy 0.7512522965669632
Validation accuracy increased from 0.75 to 0.75
Epoch 44, Train loss 0.7122099714523012, Train accuracy 0.7514861503785307, Validation loss 0.7193162351846695, Validation accuracy 0.7469554215669632
Epoch 45, Train loss 0.7082128152251244, Train accuracy 0.7516193179921671, Validation loss 0.7169571697711945, Validation accuracy 0.7514476090669632
Validation accuracy increased from 0.75 to 0.75
Epoch 46, Train loss 0.707539594986222, Train accuracy 0.7543226206167177, Validation loss 0.712310054898262, Validation accuracy 0.7516199439764023
Validation accuracy increased from 0.75 to 0.75
Epoch 47, Train loss 0.7052237828346816, Train accuracy 0.754765625027093, Validation loss 0.7194170594215393, Validation accuracy 0.7494944840669632
Epoch 48, Train loss 0.7062706083736636, Train accuracy 0.7511754259467125, Validation loss 0.7088229030370712, Validation accuracy 0.7545266538858414
Validation accuracy increased from 0.75 to 0.75
Epoch 49, Train loss 0.7033037726174701, Train accuracy 0.7523845881223679, Validation loss 0.7133991122245789, Validation accuracy 0.7492991715669632
Epoch 50, Train loss 0.705366978252476, Train accuracy 0.7529447796669874, Validation loss 0.7112774908542633, Validation accuracy 0.7531824439764023
Epoch 51, Train loss 0.7015854099934752, Train accuracy 0.7537642043422569, Validation loss 0.7107759565114975, Validation accuracy 0.7475183814764023
Epoch 52, Train loss 0.6982516040178862, Train accuracy 0.7557288706302643, Validation loss 0.7089456290006637, Validation accuracy 0.7537683814764022
Epoch 53, Train loss 0.696576521477916, Train accuracy 0.7555166902867231, Validation loss 0.7072254419326782, Validation accuracy 0.7566980689764022
Validation accuracy increased from 0.75 to 0.76
Epoch 54, Train loss 0.6975276968018576, Train accuracy 0.7563361149619926, Validation loss 0.7015891671180725, Validation accuracy 0.7578929215669632
Validation accuracy increased from 0.76 to 0.76
Epoch 55, Train loss 0.697221710939299, Train accuracy 0.7542196376757189, Validation loss 0.7062000602483749, Validation accuracy 0.7534007340669632
Epoch 56, Train loss 0.6992276879874143, Train accuracy 0.7558087713339112, Validation loss 0.7022769957780838, Validation accuracy 0.7528147965669632
Epoch 57, Train loss 0.6956925453110174, Train accuracy 0.755488281222907, Validation loss 0.6979894906282424, Validation accuracy 0.7548943012952805
Epoch 58, Train loss 0.69394362853332, Train accuracy 0.75636629963463, Validation loss 0.7023879230022431, Validation accuracy 0.7571116715669632
Epoch 59, Train loss 0.693591480228034, Train accuracy 0.7569504613903436, Validation loss 0.6954731732606888, Validation accuracy 0.7565257340669632
Epoch 60, Train loss 0.6873442149636421, Train accuracy 0.7606134587390856, Validation loss 0.6952776044607163, Validation accuracy 0.7594324439764023
Validation accuracy increased from 0.76 to 0.76
Epoch 61, Train loss 0.6868503605100241, Train accuracy 0.7599440694532611, Validation loss 0.6943035215139389, Validation accuracy 0.7598230689764023
Validation accuracy increased from 0.76 to 0.76
Epoch 62, Train loss 0.6830760345540263, Train accuracy 0.7598890269344504, Validation loss 0.6937044531106948, Validation accuracy 0.7604090064764023
Validation accuracy increased from 0.76 to 0.76
Epoch 63, Train loss 0.685782977803187, Train accuracy 0.7592507102950052, Validation loss 0.6916081786155701, Validation accuracy 0.7600183814764023
Epoch 64, Train loss 0.6844264045357704, Train accuracy 0.7591299716044556, Validation loss 0.6923433750867843, Validation accuracy 0.7580652564764023
Epoch 65, Train loss 0.6852066699754108, Train accuracy 0.7595649856058034, Validation loss 0.6897379487752915, Validation accuracy 0.7621438413858413
Validation accuracy increased from 0.76 to 0.76
Epoch 66, Train loss 0.6816387613388625, Train accuracy 0.7593252838335254, Validation loss 0.6923026382923126, Validation accuracy 0.7584329038858414
Epoch 67, Train loss 0.6798748868432912, Train accuracy 0.7614648436958139, Validation loss 0.6903965473175049, Validation accuracy 0.7604090064764023
Epoch 68, Train loss 0.6803464948792349, Train accuracy 0.7612979401918974, Validation loss 0.68915995657444, Validation accuracy 0.7604090064764023
Epoch 69, Train loss 0.6803762006827376, Train accuracy 0.7628666548566385, Validation loss 0.6899626553058624, Validation accuracy 0.7602136939764023
Epoch 0, Train loss 1.8430284891616215, Train accuracy 0.3050008876757188, Validation loss 1.6399536967277526, Validation accuracy 0.39565716981887816
Validation accuracy increased from 0.00 to 0.40
Epoch 1, Train loss 1.544035435400226, Train accuracy 0.4261079544032162, Validation loss 1.4845795154571533, Validation accuracy 0.45758272111415865
Validation accuracy increased from 0.40 to 0.46
Epoch 2, Train loss 1.3929590108719738, Train accuracy 0.4928888493979519, Validation loss 1.3011043071746826, Validation accuracy 0.5280790448188781
Validation accuracy increased from 0.46 to 0.53
Epoch 3, Train loss 1.28210621598092, Train accuracy 0.537827592343092, Validation loss 1.2226426661014558, Validation accuracy 0.5617072612047196
Validation accuracy increased from 0.53 to 0.56
Epoch 4, Train loss 1.1905448518016122, Train accuracy 0.574575639245185, Validation loss 1.1342050552368164, Validation accuracy 0.5953125
Validation accuracy increased from 0.56 to 0.60
Epoch 5, Train loss 1.1090868857096543, Train accuracy 0.6016370738771829, Validation loss 1.060093852877617, Validation accuracy 0.6286420047283172
Validation accuracy increased from 0.60 to 0.63
Epoch 6, Train loss 1.0389883379367264, Train accuracy 0.6278639913282611, Validation loss 1.0130996972322464, Validation accuracy 0.6433708637952804
Validation accuracy increased from 0.63 to 0.64
Epoch 7, Train loss 0.9844492826272141, Train accuracy 0.6464115767316385, Validation loss 0.9997004836797714, Validation accuracy 0.6436006426811218
Validation accuracy increased from 0.64 to 0.64
Epoch 8, Train loss 0.936827419156378, Train accuracy 0.6655921519479968, Validation loss 0.9288770169019699, Validation accuracy 0.6734719663858414
Validation accuracy increased from 0.64 to 0.67
Epoch 9, Train loss 0.8973672823472456, Train accuracy 0.679818892004815, Validation loss 0.8694242089986801, Validation accuracy 0.6950827211141586
Validation accuracy increased from 0.67 to 0.70
Epoch 10, Train loss 0.8613034598529339, Train accuracy 0.6931613991883668, Validation loss 0.8802307993173599, Validation accuracy 0.6872702211141586
Epoch 11, Train loss 0.8192915879189968, Train accuracy 0.7089355469427325, Validation loss 0.8145575314760208, Validation accuracy 0.7157169133424759
Validation accuracy increased from 0.70 to 0.72
Epoch 12, Train loss 0.7872613190927289, Train accuracy 0.7215305397456343, Validation loss 0.83030846118927, Validation accuracy 0.7054113060235977
Epoch 13, Train loss 0.7559644949029792, Train accuracy 0.734003906222907, Validation loss 0.7298925936222076, Validation accuracy 0.7481158077716827
Validation accuracy increased from 0.72 to 0.75
Epoch 14, Train loss 0.7308682467449795, Train accuracy 0.742473366246982, Validation loss 0.7731865912675857, Validation accuracy 0.7305147051811218
Epoch 15, Train loss 0.7038051397963003, Train accuracy 0.7526118606328964, Validation loss 0.72477126121521, Validation accuracy 0.7447265625
Epoch 16, Train loss 0.6788225021551956, Train accuracy 0.7607492895966227, Validation loss 0.7322679996490479, Validation accuracy 0.7466681987047196
Epoch 17, Train loss 0.6640774258835749, Train accuracy 0.7664142400026321, Validation loss 0.6881310939788818, Validation accuracy 0.766819852590561
Validation accuracy increased from 0.75 to 0.77
Epoch 18, Train loss 0.6368031115694479, Train accuracy 0.7754012783142653, Validation loss 0.6984063297510147, Validation accuracy 0.7608915448188782
Epoch 19, Train loss 0.6155526798895814, Train accuracy 0.78442737900398, Validation loss 0.6341530859470368, Validation accuracy 0.7824793189764023
Validation accuracy increased from 0.77 to 0.78
Epoch 20, Train loss 0.5763163703747771, Train accuracy 0.801883877678351, Validation loss 0.5894019484519959, Validation accuracy 0.7970243573188782
Validation accuracy increased from 0.78 to 0.80
Epoch 21, Train loss 0.5654996867206964, Train accuracy 0.8015216619453647, Validation loss 0.5903559982776642, Validation accuracy 0.8005744487047195
Validation accuracy increased from 0.80 to 0.80
Epoch 22, Train loss 0.5551024263894017, Train accuracy 0.8063467683439905, Validation loss 0.58205526471138, Validation accuracy 0.7996897965669632
Epoch 23, Train loss 0.5473703389818018, Train accuracy 0.8095507811416279, Validation loss 0.5846423298120499, Validation accuracy 0.7961511939764023
Epoch 24, Train loss 0.5442044712941755, Train accuracy 0.8099014559252695, Validation loss 0.563387630879879, Validation accuracy 0.8097196698188782
Validation accuracy increased from 0.80 to 0.81
Epoch 25, Train loss 0.5374480628154494, Train accuracy 0.8121111504733562, Validation loss 0.5684882432222367, Validation accuracy 0.8053998172283172
Epoch 26, Train loss 0.5280997653237798, Train accuracy 0.8150310722941702, Validation loss 0.5756369054317474, Validation accuracy 0.8020335465669632
Epoch 27, Train loss 0.5258660904047164, Train accuracy 0.8140039061280814, Validation loss 0.5703673839569092, Validation accuracy 0.8019071698188782
Epoch 28, Train loss 0.5158529161390933, Train accuracy 0.8196706321429122, Validation loss 0.556606225669384, Validation accuracy 0.8068704038858414
Epoch 29, Train loss 0.5121964255178516, Train accuracy 0.8218936432491649, Validation loss 0.558188396692276, Validation accuracy 0.8093635112047195
Epoch 30, Train loss 0.5058820217170499, Train accuracy 0.8220037286254492, Validation loss 0.5476489558815956, Validation accuracy 0.8135110288858414
Validation accuracy increased from 0.81 to 0.81
Epoch 31, Train loss 0.4994399512017315, Train accuracy 0.8270143819126216, Validation loss 0.5600867375731469, Validation accuracy 0.8098230689764023
Epoch 32, Train loss 0.49624284119768575, Train accuracy 0.8273552910170772, Validation loss 0.5329988420009613, Validation accuracy 0.8166130512952805
Validation accuracy increased from 0.81 to 0.82
Epoch 33, Train loss 0.4930182458324866, Train accuracy 0.8288556462661787, Validation loss 0.5389005586504936, Validation accuracy 0.8153607547283173
Epoch 34, Train loss 0.4847373711791905, Train accuracy 0.8320010653273626, Validation loss 0.551012459397316, Validation accuracy 0.8096966922283173
Epoch 35, Train loss 0.47673126293176954, Train accuracy 0.8315536220642653, Validation loss 0.5300544157624245, Validation accuracy 0.8180721521377563
Validation accuracy increased from 0.82 to 0.82
Epoch 36, Train loss 0.4744000353596427, Train accuracy 0.8351145241070878, Validation loss 0.542115931212902, Validation accuracy 0.8170266538858414
Epoch 37, Train loss 0.4661637236448852, Train accuracy 0.8354279117828066, Validation loss 0.531735460460186, Validation accuracy 0.816015625
Epoch 38, Train loss 0.466769537973133, Train accuracy 0.8379359018396247, Validation loss 0.5391581356525421, Validation accuracy 0.8141888797283172
Epoch 39, Train loss 0.4614898758855733, Train accuracy 0.8387224785983562, Validation loss 0.5368860393762589, Validation accuracy 0.8179227948188782
Epoch 40, Train loss 0.443312183869156, Train accuracy 0.8451997512443499, Validation loss 0.5060213178396225, Validation accuracy 0.8240349262952804
Validation accuracy increased from 0.82 to 0.82
Epoch 41, Train loss 0.4400230051780289, Train accuracy 0.8460049713877115, Validation loss 0.5047350347042083, Validation accuracy 0.8269186586141586
Validation accuracy increased from 0.82 to 0.83
Epoch 42, Train loss 0.4354459641670639, Train accuracy 0.8489373224702749, Validation loss 0.5091126695275306, Validation accuracy 0.8230813413858413
Epoch 43, Train loss 0.43346557207405567, Train accuracy 0.8488840552216227, Validation loss 0.5082181319594383, Validation accuracy 0.8256663590669632
Epoch 44, Train loss 0.43203437683934515, Train accuracy 0.8486967327242548, Validation loss 0.5053184434771538, Validation accuracy 0.8274011939764023
Validation accuracy increased from 0.83 to 0.83
Epoch 45, Train loss 0.42681752653284505, Train accuracy 0.8516876775432717, Validation loss 0.5027760699391365, Validation accuracy 0.8284811586141586
Validation accuracy increased from 0.83 to 0.83
Epoch 46, Train loss 0.4290272690017115, Train accuracy 0.8505042611875318, Validation loss 0.5026638090610505, Validation accuracy 0.8289407163858413
Validation accuracy increased from 0.83 to 0.83
Epoch 47, Train loss 0.4290967414324934, Train accuracy 0.8505832739174366, Validation loss 0.4995186358690262, Validation accuracy 0.8311925560235978
Validation accuracy increased from 0.83 to 0.83
Epoch 48, Train loss 0.42219475690614094, Train accuracy 0.8549591617828066, Validation loss 0.4990072980523109, Validation accuracy 0.8278722435235977
Epoch 49, Train loss 0.41993432576683437, Train accuracy 0.8552343750541861, Validation loss 0.5002100005745888, Validation accuracy 0.8298713237047195
Epoch 50, Train loss 0.4203501524911685, Train accuracy 0.8539923649619926, Validation loss 0.494783316552639, Validation accuracy 0.8335822612047196
Validation accuracy increased from 0.83 to 0.83
Epoch 51, Train loss 0.4207210222428495, Train accuracy 0.8525044389746406, Validation loss 0.49886259734630584, Validation accuracy 0.8293543189764023
Epoch 52, Train loss 0.41709231382066553, Train accuracy 0.8570374643260782, Validation loss 0.5057214200496674, Validation accuracy 0.8267693012952805
Epoch 53, Train loss 0.41186135973442684, Train accuracy 0.857777876271443, Validation loss 0.4950825199484825, Validation accuracy 0.8302849262952805
Epoch 54, Train loss 0.41638333502818237, Train accuracy 0.8544513491744344, Validation loss 0.5007248193025589, Validation accuracy 0.8261833637952805
Epoch 55, Train loss 0.4149667104198174, Train accuracy 0.8546608662740751, Validation loss 0.49157230406999586, Validation accuracy 0.8310431987047195
Epoch 56, Train loss 0.41045593114739115, Train accuracy 0.858177379112352, Validation loss 0.4913358062505722, Validation accuracy 0.8312614887952805
Epoch 57, Train loss 0.40935291654684325, Train accuracy 0.8580202412876216, Validation loss 0.4881711259484291, Validation accuracy 0.8325827211141587
Epoch 58, Train loss 0.40679933384738187, Train accuracy 0.8581321022727273, Validation loss 0.4899589970707893, Validation accuracy 0.8329503685235977
Epoch 59, Train loss 0.4065080876038833, Train accuracy 0.8584241829812527, Validation loss 0.49025776982307434, Validation accuracy 0.8343635112047195
Validation accuracy increased from 0.83 to 0.83
Epoch 60, Train loss 0.3999840300530195, Train accuracy 0.8616779118098996, Validation loss 0.4866181820631027, Validation accuracy 0.8338005512952804
Epoch 61, Train loss 0.3995622428642078, Train accuracy 0.8613441051407293, Validation loss 0.4875617504119873, Validation accuracy 0.8343175560235977
Epoch 62, Train loss 0.39510167813436553, Train accuracy 0.8620285865935412, Validation loss 0.48574224561452867, Validation accuracy 0.8337775737047195
Epoch 63, Train loss 0.39765669693323696, Train accuracy 0.8624644885686311, Validation loss 0.4841019600629807, Validation accuracy 0.8331916362047196
Epoch 64, Train loss 0.3943497631698847, Train accuracy 0.864304864948446, Validation loss 0.4875024646520615, Validation accuracy 0.8331916362047196
Epoch 65, Train loss 0.39598558013412083, Train accuracy 0.8639124645428224, Validation loss 0.4853836506605148, Validation accuracy 0.8337545961141586
Epoch 66, Train loss 0.394319471987811, Train accuracy 0.8632146661931818, Validation loss 0.48625905215740206, Validation accuracy 0.8351217836141587
Validation accuracy increased from 0.83 to 0.84
Epoch 67, Train loss 0.39647374573079025, Train accuracy 0.861946910281073, Validation loss 0.48408240973949435, Validation accuracy 0.8370519310235978
Validation accuracy increased from 0.84 to 0.84
Epoch 68, Train loss 0.39101965429091995, Train accuracy 0.8658176491206343, Validation loss 0.4851826190948486, Validation accuracy 0.8324333637952804
Epoch 69, Train loss 0.39402488652955403, Train accuracy 0.8640935722399842, Validation loss 0.4826324269175529, Validation accuracy 0.8325827211141587
Epoch 0, Train loss 1.9430241977626628, Train accuracy 0.2667223010212183, Validation loss 1.698835128545761, Validation accuracy 0.3646484375
Validation accuracy increased from 0.00 to 0.36
Epoch 1, Train loss 1.5611455677585169, Train accuracy 0.4102530184794556, Validation loss 1.4318069040775299, Validation accuracy 0.4728170961141586
Validation accuracy increased from 0.36 to 0.47
Epoch 2, Train loss 1.4036308858882298, Train accuracy 0.48083007809790695, Validation loss 1.3839698731899261, Validation accuracy 0.5016314342617989
Validation accuracy increased from 0.47 to 0.50
Epoch 3, Train loss 1.2911466332999142, Train accuracy 0.5238787284628912, Validation loss 1.2370255768299103, Validation accuracy 0.5491727948188782
Validation accuracy increased from 0.50 to 0.55
Epoch 4, Train loss 1.2053088173270226, Train accuracy 0.5595658736472781, Validation loss 1.1919332146644592, Validation accuracy 0.5767463237047196
Validation accuracy increased from 0.55 to 0.58
Epoch 5, Train loss 1.1277911520817063, Train accuracy 0.5898952413011681, Validation loss 1.1281170189380645, Validation accuracy 0.5963120400905609
Validation accuracy increased from 0.58 to 0.60
Epoch 6, Train loss 1.0703467828306286, Train accuracy 0.6134321733631871, Validation loss 1.0891211956739426, Validation accuracy 0.607640165090561
Validation accuracy increased from 0.60 to 0.61
Epoch 7, Train loss 1.0172449898990719, Train accuracy 0.6335990767587315, Validation loss 1.0029917925596237, Validation accuracy 0.6438074439764023
Validation accuracy increased from 0.61 to 0.64
Epoch 8, Train loss 0.967531256377697, Train accuracy 0.6526979756626216, Validation loss 0.968687304854393, Validation accuracy 0.6527918189764023
Validation accuracy increased from 0.64 to 0.65
Epoch 9, Train loss 0.9271081086586822, Train accuracy 0.6671768464148045, Validation loss 0.909171661734581, Validation accuracy 0.6734260112047196
Validation accuracy increased from 0.65 to 0.67
Epoch 10, Train loss 0.8929321525449102, Train accuracy 0.6791344105520032, Validation loss 0.9113177567720413, Validation accuracy 0.6820886939764023
Validation accuracy increased from 0.67 to 0.68
Epoch 11, Train loss 0.8600960644808683, Train accuracy 0.6910458095371723, Validation loss 0.8664363980293274, Validation accuracy 0.6908432900905609
Validation accuracy increased from 0.68 to 0.69
Epoch 12, Train loss 0.8256055831231854, Train accuracy 0.705072798173536, Validation loss 0.867965829372406, Validation accuracy 0.6902803301811218
Epoch 13, Train loss 0.7897454300387339, Train accuracy 0.7198375355113636, Validation loss 0.8487834155559539, Validation accuracy 0.7045266538858413
Validation accuracy increased from 0.69 to 0.70
Epoch 14, Train loss 0.7664160897785967, Train accuracy 0.727697975594889, Validation loss 0.8132938057184219, Validation accuracy 0.7153262883424759
Validation accuracy increased from 0.70 to 0.72
Epoch 15, Train loss 0.7397082268514417, Train accuracy 0.7407439628785307, Validation loss 0.7042480796575546, Validation accuracy 0.7447495400905609
Validation accuracy increased from 0.72 to 0.74
Epoch 16, Train loss 0.7136834343387322, Train accuracy 0.7471626417880709, Validation loss 0.6979667991399765, Validation accuracy 0.7579159021377564
Validation accuracy increased from 0.74 to 0.76
Epoch 17, Train loss 0.6910881312056021, Train accuracy 0.7568572441285307, Validation loss 0.7156386613845825, Validation accuracy 0.7420151650905609
Epoch 18, Train loss 0.6719682274216955, Train accuracy 0.7632235437631607, Validation loss 0.7322116166353225, Validation accuracy 0.7489774823188782
Epoch 19, Train loss 0.6516140890731053, Train accuracy 0.7688139202919874, Validation loss 0.6896350979804993, Validation accuracy 0.7571576297283172
Epoch 20, Train loss 0.6106761566955935, Train accuracy 0.784564985809001, Validation loss 0.6045925110578537, Validation accuracy 0.7850643396377563
Validation accuracy increased from 0.76 to 0.79
Epoch 21, Train loss 0.5941750991412185, Train accuracy 0.7913396659899842, Validation loss 0.6034216940402984, Validation accuracy 0.7869140625
Validation accuracy increased from 0.79 to 0.79
Epoch 22, Train loss 0.5916280687193979, Train accuracy 0.7927254970100793, Validation loss 0.6080827444791794, Validation accuracy 0.7842716008424759
Epoch 23, Train loss 0.5860049353743141, Train accuracy 0.7938902696425264, Validation loss 0.596057890355587, Validation accuracy 0.7851332724094391
Epoch 24, Train loss 0.5762757762250575, Train accuracy 0.7987952767447992, Validation loss 0.5827645540237427, Validation accuracy 0.7934397965669632
Validation accuracy increased from 0.79 to 0.79
Epoch 25, Train loss 0.5751371552998369, Train accuracy 0.7976944246752695, Validation loss 0.5884574949741364, Validation accuracy 0.7879480689764022
Epoch 26, Train loss 0.5648166075010191, Train accuracy 0.8011132810603488, Validation loss 0.5949318975210189, Validation accuracy 0.7823988974094391
Epoch 27, Train loss 0.5591562688350677, Train accuracy 0.8029181462797251, Validation loss 0.5755977496504784, Validation accuracy 0.7951746314764023
Validation accuracy increased from 0.79 to 0.80
Epoch 28, Train loss 0.5559036349031058, Train accuracy 0.804429154843092, Validation loss 0.5753305703401566, Validation accuracy 0.7927964150905609
Epoch 29, Train loss 0.5523621218109672, Train accuracy 0.804823330857537, Validation loss 0.5798686653375625, Validation accuracy 0.7960477948188782
Validation accuracy increased from 0.80 to 0.80
Epoch 30, Train loss 0.5431620024821975, Train accuracy 0.8080433237959038, Validation loss 0.5730129987001419, Validation accuracy 0.7950712323188782
Epoch 31, Train loss 0.5382394795729355, Train accuracy 0.8107670454139059, Validation loss 0.5737217023968697, Validation accuracy 0.793727022409439
Epoch 32, Train loss 0.5356629314747724, Train accuracy 0.8120845170183615, Validation loss 0.581881482899189, Validation accuracy 0.8000574439764023
Validation accuracy increased from 0.80 to 0.80
Epoch 33, Train loss 0.5277601070702076, Train accuracy 0.815673828125, Validation loss 0.5633443057537079, Validation accuracy 0.7996897965669632
Epoch 34, Train loss 0.5185736837712202, Train accuracy 0.8188680752434514, Validation loss 0.5597141474485398, Validation accuracy 0.8015510112047195
Validation accuracy increased from 0.80 to 0.80
Epoch 35, Train loss 0.5176909134130586, Train accuracy 0.8196324573999102, Validation loss 0.5567434310913086, Validation accuracy 0.8059627771377563
Validation accuracy increased from 0.80 to 0.81
Epoch 36, Train loss 0.513657081025568, Train accuracy 0.8204687498509884, Validation loss 0.5610475078225136, Validation accuracy 0.7998161762952805
Epoch 37, Train loss 0.5107659397816117, Train accuracy 0.8207528408278119, Validation loss 0.5606348350644111, Validation accuracy 0.8039866715669632
Epoch 38, Train loss 0.5030598406764594, Train accuracy 0.8229101561009884, Validation loss 0.5487122148275375, Validation accuracy 0.8080422788858413
Validation accuracy increased from 0.81 to 0.81
Epoch 39, Train loss 0.4965173762968995, Train accuracy 0.8271777341988954, Validation loss 0.551779043674469, Validation accuracy 0.8073299646377563
Epoch 40, Train loss 0.48359647884287615, Train accuracy 0.831448863514445, Validation loss 0.5363556474447251, Validation accuracy 0.8079963237047195
Epoch 41, Train loss 0.48026785491542384, Train accuracy 0.8332475139336153, Validation loss 0.529758757352829, Validation accuracy 0.8074563413858413
Epoch 42, Train loss 0.4795763733034784, Train accuracy 0.8320321376350793, Validation loss 0.5287329226732254, Validation accuracy 0.8119255512952804
Validation accuracy increased from 0.81 to 0.81
Epoch 43, Train loss 0.4725525987080552, Train accuracy 0.833401988514445, Validation loss 0.5264442592859269, Validation accuracy 0.8144875913858414
Validation accuracy increased from 0.81 to 0.81
Epoch 44, Train loss 0.4756964528086511, Train accuracy 0.8323899145153436, Validation loss 0.5232270613312722, Validation accuracy 0.8119944840669632
Epoch 45, Train loss 0.47370481406423176, Train accuracy 0.8333886716176163, Validation loss 0.5247037649154663, Validation accuracy 0.8152458637952804
Validation accuracy increased from 0.81 to 0.82
Epoch 46, Train loss 0.4735136018557982, Train accuracy 0.8329296874051745, Validation loss 0.5229686796665192, Validation accuracy 0.8097771137952805
Epoch 47, Train loss 0.46689122085544194, Train accuracy 0.8355158025568182, Validation loss 0.5273351311683655, Validation accuracy 0.8112936586141586
Epoch 48, Train loss 0.4681205661459403, Train accuracy 0.836293501271443, Validation loss 0.5265642538666725, Validation accuracy 0.8160041362047196
Validation accuracy increased from 0.82 to 0.82
Epoch 49, Train loss 0.46577874080023984, Train accuracy 0.835805220021443, Validation loss 0.5250702127814293, Validation accuracy 0.8138556987047195
Epoch 50, Train loss 0.4631329375234517, Train accuracy 0.836791548200629, Validation loss 0.5216159254312516, Validation accuracy 0.8132238060235977
Epoch 51, Train loss 0.4653372940692035, Train accuracy 0.8390323153950952, Validation loss 0.5161580204963684, Validation accuracy 0.8159352034330368
Epoch 52, Train loss 0.457313276658004, Train accuracy 0.8401970880275423, Validation loss 0.5185975760221482, Validation accuracy 0.8163947612047195
Validation accuracy increased from 0.82 to 0.82
Epoch 53, Train loss 0.4588015946474942, Train accuracy 0.8384659090502695, Validation loss 0.5223993688821793, Validation accuracy 0.8150275737047196
Epoch 54, Train loss 0.4549462790177627, Train accuracy 0.8413476561280814, Validation loss 0.5197773188352585, Validation accuracy 0.8146139711141587
Epoch 55, Train loss 0.4558647561141036, Train accuracy 0.8411665480922569, Validation loss 0.5166908428072929, Validation accuracy 0.8160041362047196
Epoch 56, Train loss 0.4519375374710018, Train accuracy 0.8417782312767073, Validation loss 0.5162487626075745, Validation accuracy 0.8189797788858414
Validation accuracy increased from 0.82 to 0.82
Epoch 57, Train loss 0.4569436889141798, Train accuracy 0.8381862569261681, Validation loss 0.5161437392234802, Validation accuracy 0.8153952211141586
Epoch 58, Train loss 0.45122437890280376, Train accuracy 0.8408691405572675, Validation loss 0.5186942279338836, Validation accuracy 0.8171989887952804
Epoch 59, Train loss 0.45251130719076504, Train accuracy 0.841087535362352, Validation loss 0.518418662250042, Validation accuracy 0.8156364887952805
Epoch 60, Train loss 0.4464192380282012, Train accuracy 0.8435129614716227, Validation loss 0.5129657000303268, Validation accuracy 0.8170036762952805
Epoch 61, Train loss 0.44073030623522674, Train accuracy 0.8456844812767073, Validation loss 0.5135783210396767, Validation accuracy 0.8167624086141586
Epoch 62, Train loss 0.44459796679968183, Train accuracy 0.8444984020157293, Validation loss 0.5113259285688401, Validation accuracy 0.8193014711141586
Validation accuracy increased from 0.82 to 0.82
Epoch 63, Train loss 0.44334170696410263, Train accuracy 0.8447567471726374, Validation loss 0.512271212041378, Validation accuracy 0.8187385112047195
Epoch 64, Train loss 0.44218803552741354, Train accuracy 0.8460182882845402, Validation loss 0.5109983161091805, Validation accuracy 0.8173713237047195
Epoch 65, Train loss 0.4450489611110904, Train accuracy 0.8464639559388161, Validation loss 0.510281951725483, Validation accuracy 0.8196920961141586
Validation accuracy increased from 0.82 to 0.82
Epoch 66, Train loss 0.43912949396128004, Train accuracy 0.8459321731193499, Validation loss 0.5106319561600685, Validation accuracy 0.8191521137952804
Epoch 67, Train loss 0.4414409708909013, Train accuracy 0.8459454900161787, Validation loss 0.5102414056658745, Validation accuracy 0.8176125913858414
Epoch 68, Train loss 0.442692562260411, Train accuracy 0.845585937527093, Validation loss 0.5096301227807999, Validation accuracy 0.8204733461141587
Validation accuracy increased from 0.82 to 0.82
Epoch 69, Train loss 0.4401668968864463, Train accuracy 0.8451837711036205, Validation loss 0.5080527409911155, Validation accuracy 0.8198874086141587
Test loss: 0.7333463370800019 Test accuracy: 0.74296875  resnet10_SGD_0.001
Test loss: 0.4653273098170757 Test accuracy: 0.859375  resnet18_SGD_0.001
Test loss: 0.7138651728630065 Test accuracy: 0.7439453125  resnet12_SGD_0.001
Test loss: 0.5084092803299427 Test accuracy: 0.82685546875  resnet14_4_SGD_0.001
Test loss: 0.5418245658278465 Test accuracy: 0.81572265625  resnet14_5_SGD_0.001
Epoch 0, Train loss 2.399934497746554, Train accuracy 0.14432350850918077, Validation loss 2.2242557644844054, Validation accuracy 0.17394301444292068
Validation accuracy increased from 0.00 to 0.17
Epoch 1, Train loss 2.1240380108356476, Train accuracy 0.21531960224224764, Validation loss 2.0496028780937197, Validation accuracy 0.2348345585167408
Validation accuracy increased from 0.17 to 0.23
Epoch 2, Train loss 2.000699008052999, Train accuracy 0.2616601562635465, Validation loss 1.9583088517189027, Validation accuracy 0.27373621314764024
Validation accuracy increased from 0.23 to 0.27
Epoch 3, Train loss 1.9248580783605576, Train accuracy 0.2927752130410888, Validation loss 1.8950298190116883, Validation accuracy 0.30623851120471957
Validation accuracy increased from 0.27 to 0.31
Epoch 4, Train loss 1.8774576119401238, Train accuracy 0.31355379962108354, Validation loss 1.8485497176647185, Validation accuracy 0.3242417275905609
Validation accuracy increased from 0.31 to 0.32
Epoch 5, Train loss 1.8358543488112362, Train accuracy 0.33137872865931556, Validation loss 1.8103652894496918, Validation accuracy 0.3365234375
Validation accuracy increased from 0.32 to 0.34
Epoch 6, Train loss 1.8073670728640123, Train accuracy 0.34241566045040434, Validation loss 1.7784188032150268, Validation accuracy 0.3476332724094391
Validation accuracy increased from 0.34 to 0.35
Epoch 7, Train loss 1.7810569866137071, Train accuracy 0.35083274136890064, Validation loss 1.7486609399318696, Validation accuracy 0.36264935731887815
Validation accuracy increased from 0.35 to 0.36
Epoch 8, Train loss 1.7537123513492672, Train accuracy 0.3611070667816834, Validation loss 1.724684375524521, Validation accuracy 0.36653262823820115
Validation accuracy increased from 0.36 to 0.37
Epoch 9, Train loss 1.731004779989069, Train accuracy 0.3694673295725476, Validation loss 1.7002417683601379, Validation accuracy 0.3776424631476402
Validation accuracy increased from 0.37 to 0.38
Epoch 10, Train loss 1.710166223347187, Train accuracy 0.37667879970236257, Validation loss 1.6784747838974, Validation accuracy 0.3873621329665184
Validation accuracy increased from 0.38 to 0.39
Epoch 11, Train loss 1.689468076960607, Train accuracy 0.38488281247290695, Validation loss 1.6566681146621705, Validation accuracy 0.3982996329665184
Validation accuracy increased from 0.39 to 0.40
Epoch 12, Train loss 1.6662198745391585, Train accuracy 0.39357599429786205, Validation loss 1.6381880521774292, Validation accuracy 0.40387178361415865
Validation accuracy increased from 0.40 to 0.40
Epoch 13, Train loss 1.654859143901955, Train accuracy 0.39629261364991014, Validation loss 1.6182737946510315, Validation accuracy 0.41170726120471957
Validation accuracy increased from 0.40 to 0.41
Epoch 14, Train loss 1.634362373839725, Train accuracy 0.40689630670980975, Validation loss 1.604944771528244, Validation accuracy 0.42010569870471953
Validation accuracy increased from 0.41 to 0.42
Epoch 15, Train loss 1.6214450164274736, Train accuracy 0.410160688852722, Validation loss 1.5850923120975495, Validation accuracy 0.42772288620471954
Validation accuracy increased from 0.42 to 0.43
Epoch 16, Train loss 1.6045457341454246, Train accuracy 0.41565340909768234, Validation loss 1.5693626761436463, Validation accuracy 0.43536305129528047
Validation accuracy increased from 0.43 to 0.44
Epoch 17, Train loss 1.5913780067454686, Train accuracy 0.4225301845845851, Validation loss 1.5563213646411895, Validation accuracy 0.44002757370471957
Validation accuracy increased from 0.44 to 0.44
Epoch 18, Train loss 1.574700726704164, Train accuracy 0.42940429682758724, Validation loss 1.5420527040958405, Validation accuracy 0.44391084611415865
Validation accuracy increased from 0.44 to 0.44
Epoch 19, Train loss 1.5629678856242786, Train accuracy 0.43171519887718285, Validation loss 1.5283994197845459, Validation accuracy 0.44996553361415864
Validation accuracy increased from 0.44 to 0.45
Epoch 20, Train loss 1.5572232956236058, Train accuracy 0.4335156249051744, Validation loss 1.523374080657959, Validation accuracy 0.45291819870471955
Validation accuracy increased from 0.45 to 0.45
Epoch 21, Train loss 1.5482673766938122, Train accuracy 0.44086558947508986, Validation loss 1.5192416489124299, Validation accuracy 0.45330882370471953
Validation accuracy increased from 0.45 to 0.45
Epoch 22, Train loss 1.5439742695201526, Train accuracy 0.43903941762718285, Validation loss 1.5165930926799773, Validation accuracy 0.45309053361415863
Epoch 23, Train loss 1.5399657494642518, Train accuracy 0.4412668677554889, Validation loss 1.5115930914878846, Validation accuracy 0.45467601120471957
Validation accuracy increased from 0.45 to 0.45
Epoch 24, Train loss 1.5381051254543392, Train accuracy 0.4420765269209038, Validation loss 1.5072575449943542, Validation accuracy 0.45680147111415864
Validation accuracy increased from 0.45 to 0.46
Epoch 25, Train loss 1.5338060158220204, Train accuracy 0.44152343747290695, Validation loss 1.5046252369880677, Validation accuracy 0.45721507370471953
Validation accuracy increased from 0.46 to 0.46
Epoch 26, Train loss 1.5325420715592124, Train accuracy 0.4434463778002696, Validation loss 1.4997528851032258, Validation accuracy 0.46014476120471953
Validation accuracy increased from 0.46 to 0.46
Epoch 27, Train loss 1.528966248035431, Train accuracy 0.44566938907585363, Validation loss 1.4967933356761933, Validation accuracy 0.46053538620471957
Validation accuracy increased from 0.46 to 0.46
Epoch 28, Train loss 1.5238957222212444, Train accuracy 0.4468421519479968, Validation loss 1.4924722135066986, Validation accuracy 0.46344209611415865
Validation accuracy increased from 0.46 to 0.46
Epoch 29, Train loss 1.5183822262016209, Train accuracy 0.4512970525432717, Validation loss 1.4904742419719696, Validation accuracy 0.4651999086141586
Validation accuracy increased from 0.46 to 0.47
Epoch 30, Train loss 1.5182173265652223, Train accuracy 0.4476819956167178, Validation loss 1.487908512353897, Validation accuracy 0.4639820769429207
Epoch 31, Train loss 1.513028702952645, Train accuracy 0.4483433948321776, Validation loss 1.4835660099983214, Validation accuracy 0.4653722420334816
Validation accuracy increased from 0.47 to 0.47
Epoch 32, Train loss 1.5086907236413523, Train accuracy 0.45219193890013476, Validation loss 1.4806342899799347, Validation accuracy 0.4655675545334816
Validation accuracy increased from 0.47 to 0.47
Epoch 33, Train loss 1.5111927098848603, Train accuracy 0.4519247158684514, Validation loss 1.4768329024314881, Validation accuracy 0.4671300545334816
Validation accuracy increased from 0.47 to 0.47
Epoch 34, Train loss 1.5054349716414104, Train accuracy 0.4538396661254493, Validation loss 1.47257519364357, Validation accuracy 0.4716222420334816
Validation accuracy increased from 0.47 to 0.47
Epoch 35, Train loss 1.5021202997727827, Train accuracy 0.4548837002366781, Validation loss 1.4711873650550842, Validation accuracy 0.4694508269429207
Epoch 36, Train loss 1.495435474271124, Train accuracy 0.45683682506734674, Validation loss 1.4670337080955504, Validation accuracy 0.4729894295334816
Validation accuracy increased from 0.47 to 0.47
Epoch 37, Train loss 1.4915797812017528, Train accuracy 0.46375355107540434, Validation loss 1.4648686528205872, Validation accuracy 0.4725988045334816
Epoch 38, Train loss 1.4932667315006256, Train accuracy 0.45839666185731237, Validation loss 1.4613283932209016, Validation accuracy 0.4749425545334816
Validation accuracy increased from 0.47 to 0.47
Epoch 39, Train loss 1.4879637976939029, Train accuracy 0.4595756391909989, Validation loss 1.4587429583072662, Validation accuracy 0.4778492644429207
Validation accuracy increased from 0.47 to 0.48
Epoch 40, Train loss 1.4887134195728735, Train accuracy 0.46019531244581396, Validation loss 1.4583461046218873, Validation accuracy 0.4747472420334816
Epoch 41, Train loss 1.4824447577649897, Train accuracy 0.46634588051926007, Validation loss 1.454304587841034, Validation accuracy 0.4786305144429207
Validation accuracy increased from 0.48 to 0.48
Epoch 42, Train loss 1.482877184044231, Train accuracy 0.4625656960362738, Validation loss 1.4565260469913484, Validation accuracy 0.47550551444292066
Epoch 43, Train loss 1.481720115650784, Train accuracy 0.4629421164704995, Validation loss 1.453956127166748, Validation accuracy 0.47745863944292066
Epoch 44, Train loss 1.4850320064208724, Train accuracy 0.4625834516164931, Validation loss 1.4540044903755187, Validation accuracy 0.4757008269429207
Epoch 45, Train loss 1.4833362745967777, Train accuracy 0.4620507811619477, Validation loss 1.450681644678116, Validation accuracy 0.4796070769429207
Validation accuracy increased from 0.48 to 0.48
Epoch 46, Train loss 1.4819848347793927, Train accuracy 0.4658824572847648, Validation loss 1.4522379100322724, Validation accuracy 0.47724034935235976
Epoch 47, Train loss 1.4833267459815198, Train accuracy 0.46103959513658826, Validation loss 1.449250727891922, Validation accuracy 0.4799977019429207
Validation accuracy increased from 0.48 to 0.48
Epoch 48, Train loss 1.4789083071730353, Train accuracy 0.4664897016164931, Validation loss 1.4502208650112152, Validation accuracy 0.4762867644429207
Epoch 49, Train loss 1.476035433059389, Train accuracy 0.4669708806005391, Validation loss 1.4483897864818573, Validation accuracy 0.4796300545334816
Epoch 50, Train loss 1.4746953404762528, Train accuracy 0.46729048290713265, Validation loss 1.447937273979187, Validation accuracy 0.4786305144429207
Epoch 51, Train loss 1.476649747653441, Train accuracy 0.46524769169363106, Validation loss 1.4467701375484467, Validation accuracy 0.47938878685235975
Epoch 52, Train loss 1.4731311364607378, Train accuracy 0.4646377839486707, Validation loss 1.4443067848682403, Validation accuracy 0.4796070769429207
Epoch 53, Train loss 1.471020225774158, Train accuracy 0.4667276277799498, Validation loss 1.4437219500541687, Validation accuracy 0.48038832694292066
Validation accuracy increased from 0.48 to 0.48
Epoch 54, Train loss 1.4715830995277925, Train accuracy 0.4651429331438108, Validation loss 1.4441545605659485, Validation accuracy 0.47995174676179886
Epoch 55, Train loss 1.4708892127329654, Train accuracy 0.46805486489426007, Validation loss 1.4436847567558289, Validation accuracy 0.48095128685235977
Validation accuracy increased from 0.48 to 0.48
Epoch 56, Train loss 1.4699078872799873, Train accuracy 0.46537286923690274, Validation loss 1.441080093383789, Validation accuracy 0.4819508269429207
Validation accuracy increased from 0.48 to 0.48
Epoch 57, Train loss 1.4723811264742503, Train accuracy 0.46680752831426536, Validation loss 1.4409981429576875, Validation accuracy 0.48131893426179884
Epoch 58, Train loss 1.4700250882994046, Train accuracy 0.4686647726392204, Validation loss 1.4403997540473938, Validation accuracy 0.47975643426179887
Epoch 59, Train loss 1.4680097299543293, Train accuracy 0.46923473003235733, Validation loss 1.4400769174098969, Validation accuracy 0.4792164519429207
Epoch 60, Train loss 1.465592247518626, Train accuracy 0.4698987924917178, Validation loss 1.4411368310451507, Validation accuracy 0.47875689417123796
Epoch 61, Train loss 1.4666570858521895, Train accuracy 0.4694602272727273, Validation loss 1.4391873061656952, Validation accuracy 0.48034237176179884
Epoch 62, Train loss 1.4657402702353217, Train accuracy 0.4676571376621723, Validation loss 1.438749122619629, Validation accuracy 0.4817325368523598
Epoch 63, Train loss 1.4695353982123462, Train accuracy 0.4666965553029017, Validation loss 1.4365325629711152, Validation accuracy 0.48329503685235975
Validation accuracy increased from 0.48 to 0.48
Epoch 64, Train loss 1.4655493233691563, Train accuracy 0.46972034786912525, Validation loss 1.437369042634964, Validation accuracy 0.4807559743523598
Epoch 65, Train loss 1.4634226316755468, Train accuracy 0.4681693891232664, Validation loss 1.4368545234203338, Validation accuracy 0.48268612176179887
Epoch 66, Train loss 1.4646182033148678, Train accuracy 0.4711709870872172, Validation loss 1.4361497104167937, Validation accuracy 0.4834903493523598
Validation accuracy increased from 0.48 to 0.48
Epoch 67, Train loss 1.4652091176672415, Train accuracy 0.4690482953394001, Validation loss 1.4368389785289764, Validation accuracy 0.48212316185235976
Epoch 68, Train loss 1.4631747671148994, Train accuracy 0.46749378537589853, Validation loss 1.4347476959228516, Validation accuracy 0.48427159935235975
Validation accuracy increased from 0.48 to 0.48
Epoch 69, Train loss 1.4652439992536197, Train accuracy 0.4682191049849445, Validation loss 1.4370896697044373, Validation accuracy 0.47997472435235977
Epoch 0, Train loss 2.2224179099906576, Train accuracy 0.17776367186822675, Validation loss 2.1039102435112, Validation accuracy 0.2164751835167408
Validation accuracy increased from 0.00 to 0.22
Epoch 1, Train loss 2.025305764241652, Train accuracy 0.2552281604571776, Validation loss 1.9385637760162353, Validation accuracy 0.2826056987047195
Validation accuracy increased from 0.22 to 0.28
Epoch 2, Train loss 1.8990848416631871, Train accuracy 0.3052379260347648, Validation loss 1.8308175802230835, Validation accuracy 0.32274816185235977
Validation accuracy increased from 0.28 to 0.32
Epoch 3, Train loss 1.805073202333667, Train accuracy 0.3399396306750449, Validation loss 1.7430379152297975, Validation accuracy 0.3568589150905609
Validation accuracy increased from 0.32 to 0.36
Epoch 4, Train loss 1.7332228510217234, Train accuracy 0.3641370738094503, Validation loss 1.6798771739006042, Validation accuracy 0.3757582724094391
Validation accuracy increased from 0.36 to 0.38
Epoch 5, Train loss 1.6763007986274632, Train accuracy 0.38310458087785676, Validation loss 1.6212425708770752, Validation accuracy 0.4006433829665184
Validation accuracy increased from 0.38 to 0.40
Epoch 6, Train loss 1.6290424378080801, Train accuracy 0.40137340196154336, Validation loss 1.5830370724201202, Validation accuracy 0.41516544073820116
Validation accuracy increased from 0.40 to 0.42
Epoch 7, Train loss 1.590499875897711, Train accuracy 0.4142551491545005, Validation loss 1.541051024198532, Validation accuracy 0.4326746329665184
Validation accuracy increased from 0.42 to 0.43
Epoch 8, Train loss 1.554232169958678, Train accuracy 0.43028231523931026, Validation loss 1.510142707824707, Validation accuracy 0.44940257370471953
Validation accuracy increased from 0.43 to 0.45
Epoch 9, Train loss 1.5235471346161582, Train accuracy 0.44080877117812634, Validation loss 1.4792706489562988, Validation accuracy 0.4645680144429207
Validation accuracy increased from 0.45 to 0.46
Epoch 10, Train loss 1.4940477013587952, Train accuracy 0.4505095879801295, Validation loss 1.4550086915493012, Validation accuracy 0.47350643426179884
Validation accuracy increased from 0.46 to 0.47
Epoch 11, Train loss 1.4662550979039886, Train accuracy 0.4620960581709038, Validation loss 1.4232921659946443, Validation accuracy 0.48004365861415865
Validation accuracy increased from 0.47 to 0.48
Epoch 12, Train loss 1.4415342543612828, Train accuracy 0.4729518820954995, Validation loss 1.3967077672481536, Validation accuracy 0.4913028493523598
Validation accuracy increased from 0.48 to 0.49
Epoch 13, Train loss 1.417153774337335, Train accuracy 0.4815589487552643, Validation loss 1.378859317302704, Validation accuracy 0.49987362176179884
Validation accuracy increased from 0.49 to 0.50
Epoch 14, Train loss 1.3960663357918912, Train accuracy 0.4898393110118129, Validation loss 1.3606631636619568, Validation accuracy 0.5049057900905609
Validation accuracy increased from 0.50 to 0.50
Epoch 15, Train loss 1.3745688619938763, Train accuracy 0.499647549607537, Validation loss 1.331368440389633, Validation accuracy 0.5150390625
Validation accuracy increased from 0.50 to 0.52
Epoch 16, Train loss 1.3556697429581122, Train accuracy 0.5067151988094504, Validation loss 1.3169401347637177, Validation accuracy 0.5193589150905609
Validation accuracy increased from 0.52 to 0.52
Epoch 17, Train loss 1.3329382322051309, Train accuracy 0.5159783380275423, Validation loss 1.2985869348049164, Validation accuracy 0.5262178316712379
Validation accuracy increased from 0.52 to 0.53
Epoch 18, Train loss 1.3152815835042433, Train accuracy 0.5231436433439905, Validation loss 1.2840996265411377, Validation accuracy 0.5343290448188782
Validation accuracy increased from 0.53 to 0.53
Epoch 19, Train loss 1.2988036322322758, Train accuracy 0.5285129614851691, Validation loss 1.2666784346103668, Validation accuracy 0.539820772409439
Validation accuracy increased from 0.53 to 0.54
Epoch 20, Train loss 1.287744400176135, Train accuracy 0.5319318180395798, Validation loss 1.2575874328613281, Validation accuracy 0.544703584909439
Validation accuracy increased from 0.54 to 0.54
Epoch 21, Train loss 1.2793111902746288, Train accuracy 0.5369921873577617, Validation loss 1.252572524547577, Validation accuracy 0.5464384198188782
Validation accuracy increased from 0.54 to 0.55
Epoch 22, Train loss 1.275571693750945, Train accuracy 0.5373330966315486, Validation loss 1.2488478899002076, Validation accuracy 0.547633272409439
Validation accuracy increased from 0.55 to 0.55
Epoch 23, Train loss 1.2732041708447717, Train accuracy 0.5415553977204994, Validation loss 1.241151177883148, Validation accuracy 0.5499540448188782
Validation accuracy increased from 0.55 to 0.55
Epoch 24, Train loss 1.2638026042418047, Train accuracy 0.542740589346398, Validation loss 1.2395715355873107, Validation accuracy 0.5516888797283173
Validation accuracy increased from 0.55 to 0.55
Epoch 25, Train loss 1.260695387016643, Train accuracy 0.5435413708063689, Validation loss 1.2353885412216186, Validation accuracy 0.5509076297283173
Epoch 26, Train loss 1.2556426389650865, Train accuracy 0.5462215908549048, Validation loss 1.2316371083259583, Validation accuracy 0.5524471521377563
Validation accuracy increased from 0.55 to 0.55
Epoch 27, Train loss 1.2517569214105606, Train accuracy 0.5458433949811892, Validation loss 1.2262023985385895, Validation accuracy 0.5589154422283172
Validation accuracy increased from 0.55 to 0.56
Epoch 28, Train loss 1.245013322342526, Train accuracy 0.5496084872971881, Validation loss 1.2214145958423615, Validation accuracy 0.5583524823188781
Epoch 29, Train loss 1.2399534434080124, Train accuracy 0.5487428978085518, Validation loss 1.219669622182846, Validation accuracy 0.5587431073188782
Epoch 30, Train loss 1.2381518611853772, Train accuracy 0.5524227625944398, Validation loss 1.2113137304782868, Validation accuracy 0.5639246314764023
Validation accuracy increased from 0.56 to 0.56
Epoch 31, Train loss 1.2338881438428706, Train accuracy 0.5536017400974577, Validation loss 1.20769904255867, Validation accuracy 0.5647058814764023
Validation accuracy increased from 0.56 to 0.56
Epoch 32, Train loss 1.2288730151273988, Train accuracy 0.5577965199270032, Validation loss 1.2078864336013795, Validation accuracy 0.5657743573188782
Validation accuracy increased from 0.56 to 0.57
Epoch 33, Train loss 1.223919500681487, Train accuracy 0.5578435723754492, Validation loss 1.1996311962604522, Validation accuracy 0.5680261939764023
Validation accuracy increased from 0.57 to 0.57
Epoch 34, Train loss 1.2192901433868841, Train accuracy 0.5586301491341807, Validation loss 1.1943252861499787, Validation accuracy 0.5692210465669632
Validation accuracy increased from 0.57 to 0.57
Epoch 35, Train loss 1.2175801369276913, Train accuracy 0.5606285509738055, Validation loss 1.195802342891693, Validation accuracy 0.5707605689764023
Validation accuracy increased from 0.57 to 0.57
Epoch 36, Train loss 1.2098024372350087, Train accuracy 0.5638494318859144, Validation loss 1.1876322269439696, Validation accuracy 0.5719554215669632
Validation accuracy increased from 0.57 to 0.57
Epoch 37, Train loss 1.2100094746459613, Train accuracy 0.5626651278950952, Validation loss 1.1878260791301727, Validation accuracy 0.5727596521377564
Validation accuracy increased from 0.57 to 0.57
Epoch 38, Train loss 1.203013462099162, Train accuracy 0.5671812854707241, Validation loss 1.1828069150447846, Validation accuracy 0.5754940271377563
Validation accuracy increased from 0.57 to 0.58
Epoch 39, Train loss 1.198905724016103, Train accuracy 0.5674636008387263, Validation loss 1.1783742547035216, Validation accuracy 0.5764246314764023
Validation accuracy increased from 0.58 to 0.58
Epoch 40, Train loss 1.196217077022249, Train accuracy 0.5708052201027219, Validation loss 1.1763272285461426, Validation accuracy 0.5801355689764023
Validation accuracy increased from 0.58 to 0.58
Epoch 41, Train loss 1.1947419663721865, Train accuracy 0.5697434304112737, Validation loss 1.1758248507976532, Validation accuracy 0.5791360288858414
Epoch 42, Train loss 1.192029163918712, Train accuracy 0.5698544034226374, Validation loss 1.1738473415374755, Validation accuracy 0.5769875913858413
Epoch 43, Train loss 1.1909564418548888, Train accuracy 0.5718696733767336, Validation loss 1.1727117419242858, Validation accuracy 0.5816750913858414
Validation accuracy increased from 0.58 to 0.58
Epoch 44, Train loss 1.1888231736692516, Train accuracy 0.5726020952517336, Validation loss 1.1733755588531494, Validation accuracy 0.5789407163858413
Epoch 45, Train loss 1.188833818516948, Train accuracy 0.5712437853217125, Validation loss 1.1713510155677795, Validation accuracy 0.5812614887952805
Epoch 46, Train loss 1.1879216127774932, Train accuracy 0.5722443180328066, Validation loss 1.1706059515476226, Validation accuracy 0.5785730689764023
Epoch 47, Train loss 1.1863313967531377, Train accuracy 0.5715323151512579, Validation loss 1.1687842845916747, Validation accuracy 0.5814568012952804
Epoch 48, Train loss 1.1836895590478724, Train accuracy 0.5754110440611839, Validation loss 1.1671129703521728, Validation accuracy 0.5812614887952805
Epoch 49, Train loss 1.1836844384670258, Train accuracy 0.5722922584549948, Validation loss 1.16414874792099, Validation accuracy 0.5838235288858413
Validation accuracy increased from 0.58 to 0.58
Epoch 50, Train loss 1.1838778460567647, Train accuracy 0.5745072798295454, Validation loss 1.163897955417633, Validation accuracy 0.5818933814764022
Epoch 51, Train loss 1.1807531775398687, Train accuracy 0.574477095156908, Validation loss 1.164537650346756, Validation accuracy 0.5821346521377564
Epoch 52, Train loss 1.1786384717984633, Train accuracy 0.5777201703326269, Validation loss 1.1612945377826691, Validation accuracy 0.5828699439764022
Epoch 53, Train loss 1.179485952312296, Train accuracy 0.575472301041538, Validation loss 1.1619588017463685, Validation accuracy 0.5826516538858414
Epoch 54, Train loss 1.178662893447009, Train accuracy 0.5782484019344504, Validation loss 1.16005637049675, Validation accuracy 0.5834099262952804
Epoch 55, Train loss 1.1768187758597461, Train accuracy 0.5773899145424366, Validation loss 1.1588143825531005, Validation accuracy 0.5859949439764023
Validation accuracy increased from 0.58 to 0.59
Epoch 56, Train loss 1.1763593093915419, Train accuracy 0.5753897370939905, Validation loss 1.1586273610591888, Validation accuracy 0.5840188413858414
Epoch 57, Train loss 1.173417136750438, Train accuracy 0.5790358663282611, Validation loss 1.156997698545456, Validation accuracy 0.5839728862047195
Epoch 58, Train loss 1.1713888963515109, Train accuracy 0.5773180042478171, Validation loss 1.1546685576438904, Validation accuracy 0.5844554215669632
Epoch 59, Train loss 1.1717579154805704, Train accuracy 0.5782022371210835, Validation loss 1.15237700343132, Validation accuracy 0.5859949439764023
Validation accuracy increased from 0.59 to 0.59
Epoch 60, Train loss 1.1708316816525026, Train accuracy 0.5775861150839112, Validation loss 1.154567039012909, Validation accuracy 0.5856272965669632
Epoch 61, Train loss 1.169904987243089, Train accuracy 0.5775594816289165, Validation loss 1.1527906894683837, Validation accuracy 0.5853860288858413
Epoch 62, Train loss 1.1691262302073566, Train accuracy 0.5777574574405496, Validation loss 1.1554956138134003, Validation accuracy 0.5885110288858414
Validation accuracy increased from 0.59 to 0.59
Epoch 63, Train loss 1.170358070595698, Train accuracy 0.5788352272727273, Validation loss 1.154050362110138, Validation accuracy 0.5887063413858413
Validation accuracy increased from 0.59 to 0.59
Epoch 64, Train loss 1.1684301055290482, Train accuracy 0.5789781605655496, Validation loss 1.153713881969452, Validation accuracy 0.5852826297283172
Epoch 65, Train loss 1.1705300814726136, Train accuracy 0.5780317827381871, Validation loss 1.1520207345485687, Validation accuracy 0.5902688413858413
Validation accuracy increased from 0.59 to 0.59
Epoch 66, Train loss 1.1715938475998966, Train accuracy 0.5777805396779017, Validation loss 1.1514026165008544, Validation accuracy 0.5882697612047195
Epoch 67, Train loss 1.167307970198718, Train accuracy 0.5792560367421671, Validation loss 1.1532654464244843, Validation accuracy 0.5873391538858413
Epoch 68, Train loss 1.1658620008013465, Train accuracy 0.5811594460498203, Validation loss 1.1525624334812163, Validation accuracy 0.5879250913858414
Epoch 69, Train loss 1.1659238704226234, Train accuracy 0.5785759941420772, Validation loss 1.1512676894664764, Validation accuracy 0.5883157163858413
Epoch 0, Train loss 2.342492100867358, Train accuracy 0.10962801841510968, Validation loss 2.3025838494300843, Validation accuracy 0.12061121314764023
Validation accuracy increased from 0.00 to 0.12
Epoch 1, Train loss 2.282000946727666, Train accuracy 0.1419229403307492, Validation loss 2.2436312556266786, Validation accuracy 0.15116038620471955
Validation accuracy increased from 0.12 to 0.15
Epoch 2, Train loss 2.2275121212005615, Train accuracy 0.17460671160370111, Validation loss 2.188391613960266, Validation accuracy 0.18214613944292068
Validation accuracy increased from 0.15 to 0.18
Epoch 3, Train loss 2.1751339083368126, Train accuracy 0.20234907664019952, Validation loss 2.1356985092163088, Validation accuracy 0.21369485333561897
Validation accuracy increased from 0.18 to 0.21
Epoch 4, Train loss 2.1263379806822, Train accuracy 0.2279971590773626, Validation loss 2.087152671813965, Validation accuracy 0.2455652579665184
Validation accuracy increased from 0.21 to 0.25
Epoch 5, Train loss 2.0852958126501604, Train accuracy 0.2470285865393552, Validation loss 2.0529995799064635, Validation accuracy 0.2584329038858414
Validation accuracy increased from 0.25 to 0.26
Epoch 6, Train loss 2.050863541662693, Train accuracy 0.259390092370185, Validation loss 2.017532557249069, Validation accuracy 0.2672219663858414
Validation accuracy increased from 0.26 to 0.27
Epoch 7, Train loss 2.0199086185206068, Train accuracy 0.2673739345574921, Validation loss 1.9895507037639617, Validation accuracy 0.2779641538858414
Validation accuracy increased from 0.27 to 0.28
Epoch 8, Train loss 1.9934851710091939, Train accuracy 0.27779208089817653, Validation loss 1.962719577550888, Validation accuracy 0.28885569870471955
Validation accuracy increased from 0.28 to 0.29
Epoch 9, Train loss 1.96945947882804, Train accuracy 0.28605113635686313, Validation loss 1.9426736772060393, Validation accuracy 0.29708180129528045
Validation accuracy increased from 0.29 to 0.30
Epoch 10, Train loss 1.9472131952643394, Train accuracy 0.2921777343885465, Validation loss 1.9193137466907502, Validation accuracy 0.30467601120471954
Validation accuracy increased from 0.30 to 0.30
Epoch 11, Train loss 1.9255633740262552, Train accuracy 0.29886896298690274, Validation loss 1.9014277338981629, Validation accuracy 0.3104894295334816
Validation accuracy increased from 0.30 to 0.31
Epoch 12, Train loss 1.9074018733067946, Train accuracy 0.305776811120185, Validation loss 1.880512636899948, Validation accuracy 0.3146139711141586
Validation accuracy increased from 0.31 to 0.31
Epoch 13, Train loss 1.8882737064903432, Train accuracy 0.31167968752031977, Validation loss 1.8634972989559173, Validation accuracy 0.32313878685235975
Validation accuracy increased from 0.31 to 0.32
Epoch 14, Train loss 1.8704376315528697, Train accuracy 0.3152663352137262, Validation loss 1.8478570878505707, Validation accuracy 0.3270909920334816
Validation accuracy increased from 0.32 to 0.33
Epoch 15, Train loss 1.8549068969759075, Train accuracy 0.3223552912135016, Validation loss 1.8306500732898712, Validation accuracy 0.3291934743523598
Validation accuracy increased from 0.33 to 0.33
Epoch 16, Train loss 1.8404017144983464, Train accuracy 0.32897194593467494, Validation loss 1.8183112680912017, Validation accuracy 0.33424862176179887
Validation accuracy increased from 0.33 to 0.33
Epoch 17, Train loss 1.8255442387678407, Train accuracy 0.33349786935882136, Validation loss 1.8025558352470399, Validation accuracy 0.34125689417123795
Validation accuracy increased from 0.33 to 0.34
Epoch 18, Train loss 1.8124392262913964, Train accuracy 0.33749467320740223, Validation loss 1.7898449718952179, Validation accuracy 0.34516314417123795
Validation accuracy increased from 0.34 to 0.35
Epoch 19, Train loss 1.7998427599668503, Train accuracy 0.3437322442504493, Validation loss 1.7781599283218383, Validation accuracy 0.3509765625
Validation accuracy increased from 0.35 to 0.35
Epoch 20, Train loss 1.79303857751868, Train accuracy 0.34508877840231766, Validation loss 1.776644331216812, Validation accuracy 0.3542738974094391
Validation accuracy increased from 0.35 to 0.35
Epoch 21, Train loss 1.7879208780147813, Train accuracy 0.3490607244047252, Validation loss 1.770607018470764, Validation accuracy 0.355078125
Validation accuracy increased from 0.35 to 0.36
Epoch 22, Train loss 1.7851522835818203, Train accuracy 0.3485440340909091, Validation loss 1.7673268854618072, Validation accuracy 0.3533432900905609
Epoch 23, Train loss 1.7804218232631683, Train accuracy 0.35126598010008986, Validation loss 1.7626051306724548, Validation accuracy 0.3541015625
Epoch 24, Train loss 1.7771311740983615, Train accuracy 0.35297940332781186, Validation loss 1.7612178862094878, Validation accuracy 0.3585707724094391
Validation accuracy increased from 0.36 to 0.36
Epoch 25, Train loss 1.7730869522148913, Train accuracy 0.3565660510212183, Validation loss 1.7549488127231598, Validation accuracy 0.359375
Validation accuracy increased from 0.36 to 0.36
Epoch 26, Train loss 1.7684124593030324, Train accuracy 0.35526544736190274, Validation loss 1.7528089821338653, Validation accuracy 0.3602022066712379
Validation accuracy increased from 0.36 to 0.36
Epoch 27, Train loss 1.7678504125638441, Train accuracy 0.3575994318181818, Validation loss 1.7486235558986665, Validation accuracy 0.36078814417123795
Validation accuracy increased from 0.36 to 0.36
Epoch 28, Train loss 1.7640724873000926, Train accuracy 0.35534446026113903, Validation loss 1.745295810699463, Validation accuracy 0.3627182900905609
Validation accuracy increased from 0.36 to 0.36
Epoch 29, Train loss 1.7599096474322407, Train accuracy 0.35787997157736257, Validation loss 1.7415428757667542, Validation accuracy 0.3631089150905609
Validation accuracy increased from 0.36 to 0.36
Epoch 30, Train loss 1.756947898729281, Train accuracy 0.35922585224563425, Validation loss 1.7382221043109893, Validation accuracy 0.3673598349094391
Validation accuracy increased from 0.36 to 0.37
Epoch 31, Train loss 1.752635541964661, Train accuracy 0.3625683593140407, Validation loss 1.733823549747467, Validation accuracy 0.3683823525905609
Validation accuracy increased from 0.37 to 0.37
Epoch 32, Train loss 1.7486757216128437, Train accuracy 0.3641033380885016, Validation loss 1.7314104735851288, Validation accuracy 0.3703125
Validation accuracy increased from 0.37 to 0.37
Epoch 33, Train loss 1.7476334361867472, Train accuracy 0.3640642755410888, Validation loss 1.7268551945686341, Validation accuracy 0.3718520224094391
Validation accuracy increased from 0.37 to 0.37
Epoch 34, Train loss 1.7434939234094187, Train accuracy 0.3655388849702748, Validation loss 1.726810669898987, Validation accuracy 0.37336856573820115
Validation accuracy increased from 0.37 to 0.37
Epoch 35, Train loss 1.7397548881444065, Train accuracy 0.36839843744581396, Validation loss 1.720624715089798, Validation accuracy 0.37250689417123795
Epoch 36, Train loss 1.7386604059826245, Train accuracy 0.36639115756208246, Validation loss 1.7176666259765625, Validation accuracy 0.3761488974094391
Validation accuracy increased from 0.37 to 0.38
Epoch 37, Train loss 1.7345234521410682, Train accuracy 0.368520951745185, Validation loss 1.716431975364685, Validation accuracy 0.375390625
Epoch 38, Train loss 1.730947850102728, Train accuracy 0.37068004262718285, Validation loss 1.7118088483810425, Validation accuracy 0.3747587323188782
Epoch 39, Train loss 1.7289659238674424, Train accuracy 0.3717746804045005, Validation loss 1.7085906744003296, Validation accuracy 0.3786190256476402
Validation accuracy increased from 0.38 to 0.38
Epoch 40, Train loss 1.726357909088785, Train accuracy 0.3726162996820428, Validation loss 1.7074987709522247, Validation accuracy 0.37705652564764025
Epoch 41, Train loss 1.7257412556897511, Train accuracy 0.37162286923690274, Validation loss 1.7079316437244416, Validation accuracy 0.3801585480570793
Validation accuracy increased from 0.38 to 0.38
Epoch 42, Train loss 1.7237516736442393, Train accuracy 0.3732501774687659, Validation loss 1.7064538776874543, Validation accuracy 0.37922794073820115
Epoch 43, Train loss 1.7224989662116224, Train accuracy 0.37393288348208775, Validation loss 1.706599336862564, Validation accuracy 0.3782054230570793
Epoch 44, Train loss 1.7232514145699414, Train accuracy 0.3722851562567733, Validation loss 1.7029403388500213, Validation accuracy 0.3786649823188782
Epoch 45, Train loss 1.7210588157176971, Train accuracy 0.3740394176407294, Validation loss 1.7035207271575927, Validation accuracy 0.3797909006476402
Epoch 46, Train loss 1.7192789790305225, Train accuracy 0.376847478645769, Validation loss 1.7027235329151154, Validation accuracy 0.38115808814764024
Validation accuracy increased from 0.38 to 0.38
Epoch 47, Train loss 1.718390789898959, Train accuracy 0.37540926835076377, Validation loss 1.7004673898220062, Validation accuracy 0.3815487131476402
Validation accuracy increased from 0.38 to 0.38
Epoch 48, Train loss 1.7174980755556712, Train accuracy 0.37401367182081396, Validation loss 1.7015567064285277, Validation accuracy 0.3817899823188782
Validation accuracy increased from 0.38 to 0.38
Epoch 49, Train loss 1.717980019748211, Train accuracy 0.37564808231863106, Validation loss 1.6986169934272766, Validation accuracy 0.3836741730570793
Validation accuracy increased from 0.38 to 0.38
Epoch 50, Train loss 1.7148837318474597, Train accuracy 0.37614080242135306, Validation loss 1.6983090162277221, Validation accuracy 0.38213465064764024
Epoch 51, Train loss 1.7151660417968577, Train accuracy 0.37604847296395083, Validation loss 1.697103452682495, Validation accuracy 0.3846737131476402
Validation accuracy increased from 0.38 to 0.38
Epoch 52, Train loss 1.7152799117294224, Train accuracy 0.3786115057089112, Validation loss 1.6979341149330138, Validation accuracy 0.3854090079665184
Validation accuracy increased from 0.38 to 0.39
Epoch 53, Train loss 1.7129123922098766, Train accuracy 0.3783709161322225, Validation loss 1.695326316356659, Validation accuracy 0.38313419073820115
Epoch 54, Train loss 1.712117818946188, Train accuracy 0.3784339488907294, Validation loss 1.6961487531661987, Validation accuracy 0.3836511954665184
Epoch 55, Train loss 1.710726267912171, Train accuracy 0.37890269878235733, Validation loss 1.6921617209911346, Validation accuracy 0.3861902579665184
Validation accuracy increased from 0.39 to 0.39
Epoch 56, Train loss 1.70960094305602, Train accuracy 0.3790065695277669, Validation loss 1.6898177206516265, Validation accuracy 0.38511029481887815
Epoch 57, Train loss 1.7101800109852443, Train accuracy 0.37949662638658826, Validation loss 1.6916396856307983, Validation accuracy 0.38584558814764025
Epoch 58, Train loss 1.7098961221900852, Train accuracy 0.37852627834813163, Validation loss 1.6895689010620116, Validation accuracy 0.3855009198188782
Epoch 59, Train loss 1.7073310180143877, Train accuracy 0.380124289711768, Validation loss 1.690064412355423, Validation accuracy 0.38450137823820113
Epoch 60, Train loss 1.707660702819174, Train accuracy 0.3777059658684514, Validation loss 1.6865800082683564, Validation accuracy 0.38821231573820114
Validation accuracy increased from 0.39 to 0.39
Epoch 61, Train loss 1.705811657011509, Train accuracy 0.3795339133251797, Validation loss 1.6886330425739289, Validation accuracy 0.38877527564764025
Validation accuracy increased from 0.39 to 0.39
Epoch 62, Train loss 1.7068445282903584, Train accuracy 0.3798224431547252, Validation loss 1.6888043940067292, Validation accuracy 0.38604090064764024
Epoch 63, Train loss 1.706346519291401, Train accuracy 0.3781587357886813, Validation loss 1.689536440372467, Validation accuracy 0.3856272980570793
Epoch 64, Train loss 1.7057189189574935, Train accuracy 0.3798215553503145, Validation loss 1.6883446156978608, Validation accuracy 0.3873851105570793
Epoch 65, Train loss 1.7061351652849803, Train accuracy 0.3793368251486258, Validation loss 1.6849998116493226, Validation accuracy 0.38899356573820115
Validation accuracy increased from 0.39 to 0.39
Epoch 66, Train loss 1.7056832164525986, Train accuracy 0.3805495383725925, Validation loss 1.685098910331726, Validation accuracy 0.3892118573188782
Validation accuracy increased from 0.39 to 0.39
Epoch 67, Train loss 1.704753157090057, Train accuracy 0.38008345172486524, Validation loss 1.687944757938385, Validation accuracy 0.3889476105570793
Epoch 68, Train loss 1.7039252350276166, Train accuracy 0.38041903400285676, Validation loss 1.6863428831100464, Validation accuracy 0.3879710480570793
Epoch 69, Train loss 1.7054443806409836, Train accuracy 0.3788396661931818, Validation loss 1.6850607454776765, Validation accuracy 0.3883846506476402
Epoch 0, Train loss 2.2636139406399294, Train accuracy 0.146732954477722, Validation loss 2.217013359069824, Validation accuracy 0.17972196713089944
Validation accuracy increased from 0.00 to 0.18
Epoch 1, Train loss 2.149315107952465, Train accuracy 0.22161931815472516, Validation loss 2.0662426233291624, Validation accuracy 0.23625919073820115
Validation accuracy increased from 0.18 to 0.24
Epoch 2, Train loss 2.012694524770433, Train accuracy 0.25255237926136365, Validation loss 1.9629325568675995, Validation accuracy 0.2538832724094391
Validation accuracy increased from 0.24 to 0.25
Epoch 3, Train loss 1.9394898522983899, Train accuracy 0.2766770241274075, Validation loss 1.906498634815216, Validation accuracy 0.27742417305707934
Validation accuracy increased from 0.25 to 0.28
Epoch 4, Train loss 1.890942427922379, Train accuracy 0.29965110089291225, Validation loss 1.8590762436389923, Validation accuracy 0.30076976120471954
Validation accuracy increased from 0.28 to 0.30
Epoch 5, Train loss 1.85352876376022, Train accuracy 0.3152192825959487, Validation loss 1.8205545723438263, Validation accuracy 0.3189797788858414
Validation accuracy increased from 0.30 to 0.32
Epoch 6, Train loss 1.8208073445341804, Train accuracy 0.3273073507642204, Validation loss 1.7871796429157256, Validation accuracy 0.3340762868523598
Validation accuracy increased from 0.32 to 0.33
Epoch 7, Train loss 1.792036309838295, Train accuracy 0.33927379260686313, Validation loss 1.7598767042160035, Validation accuracy 0.3442555144429207
Validation accuracy increased from 0.33 to 0.34
Epoch 8, Train loss 1.766059479930184, Train accuracy 0.3514098010279916, Validation loss 1.7309183597564697, Validation accuracy 0.35390625
Validation accuracy increased from 0.34 to 0.35
Epoch 9, Train loss 1.744432930919257, Train accuracy 0.3570294744250449, Validation loss 1.7097904920578002, Validation accuracy 0.36164981573820115
Validation accuracy increased from 0.35 to 0.36
Epoch 10, Train loss 1.7241236438805407, Train accuracy 0.3654359018599445, Validation loss 1.688970673084259, Validation accuracy 0.37024356573820116
Validation accuracy increased from 0.36 to 0.37
Epoch 11, Train loss 1.7028658058155666, Train accuracy 0.3769256035712632, Validation loss 1.6664133846759797, Validation accuracy 0.38282398879528046
Validation accuracy increased from 0.37 to 0.38
Epoch 12, Train loss 1.6865612830628047, Train accuracy 0.37954367900436575, Validation loss 1.6519478738307953, Validation accuracy 0.39117647111415865
Validation accuracy increased from 0.38 to 0.39
Epoch 13, Train loss 1.6683257946913892, Train accuracy 0.3893013139340011, Validation loss 1.6346239566802978, Validation accuracy 0.4007008269429207
Validation accuracy increased from 0.39 to 0.40
Epoch 14, Train loss 1.6538587259975346, Train accuracy 0.3923117897727273, Validation loss 1.6173472285270691, Validation accuracy 0.4059972420334816
Validation accuracy increased from 0.40 to 0.41
Epoch 15, Train loss 1.6400271193547682, Train accuracy 0.39693093028935517, Validation loss 1.604385393857956, Validation accuracy 0.41161534935235977
Validation accuracy increased from 0.41 to 0.41
Epoch 16, Train loss 1.6233812726356767, Train accuracy 0.4050852271982215, Validation loss 1.5904509544372558, Validation accuracy 0.4151309743523598
Validation accuracy increased from 0.41 to 0.42
Epoch 17, Train loss 1.6097025336189703, Train accuracy 0.41116921163418074, Validation loss 1.5745816349983215, Validation accuracy 0.4181295961141586
Validation accuracy increased from 0.42 to 0.42
Epoch 18, Train loss 1.5925689488649368, Train accuracy 0.41635031947358087, Validation loss 1.5576357245445251, Validation accuracy 0.4239889711141586
Validation accuracy increased from 0.42 to 0.42
Epoch 19, Train loss 1.5823300352150744, Train accuracy 0.42227006381885573, Validation loss 1.54825901389122, Validation accuracy 0.4249655336141586
Validation accuracy increased from 0.42 to 0.42
Epoch 20, Train loss 1.5757466967810283, Train accuracy 0.42295809648931026, Validation loss 1.544646108150482, Validation accuracy 0.4253331795334816
Validation accuracy increased from 0.42 to 0.43
Epoch 21, Train loss 1.5689143911004066, Train accuracy 0.42647816037589853, Validation loss 1.5418266177177429, Validation accuracy 0.42535615861415865
Validation accuracy increased from 0.43 to 0.43
Epoch 22, Train loss 1.5666733316399835, Train accuracy 0.4266956675459038, Validation loss 1.5363795042037964, Validation accuracy 0.42928538620471957
Validation accuracy increased from 0.43 to 0.43
Epoch 23, Train loss 1.558329316702756, Train accuracy 0.4290403053164482, Validation loss 1.530770969390869, Validation accuracy 0.43045726120471955
Validation accuracy increased from 0.43 to 0.43
Epoch 24, Train loss 1.5572249997745862, Train accuracy 0.43180131387304177, Validation loss 1.5247404873371124, Validation accuracy 0.4329733461141586
Validation accuracy increased from 0.43 to 0.43
Epoch 25, Train loss 1.5559943230314688, Train accuracy 0.43039595166390593, Validation loss 1.5240050077438354, Validation accuracy 0.43282398879528045
Epoch 26, Train loss 1.5490749342875048, Train accuracy 0.43568181805312634, Validation loss 1.5216289520263673, Validation accuracy 0.43377757370471953
Validation accuracy increased from 0.43 to 0.43
Epoch 27, Train loss 1.5480723211711103, Train accuracy 0.4345880680802194, Validation loss 1.519826191663742, Validation accuracy 0.4335363045334816
Epoch 28, Train loss 1.5401230237700723, Train accuracy 0.4388281249187209, Validation loss 1.5155739486217499, Validation accuracy 0.4378331795334816
Validation accuracy increased from 0.43 to 0.44
Epoch 29, Train loss 1.5369606512514027, Train accuracy 0.43697975846854126, Validation loss 1.5128255367279053, Validation accuracy 0.43707490861415865
Epoch 30, Train loss 1.5365960550579159, Train accuracy 0.43796253543008457, Validation loss 1.5050992250442505, Validation accuracy 0.4423253670334816
Validation accuracy increased from 0.44 to 0.44
Epoch 31, Train loss 1.531447816301476, Train accuracy 0.44294833087108354, Validation loss 1.503717827796936, Validation accuracy 0.44159007370471953
Epoch 32, Train loss 1.5289905260909686, Train accuracy 0.44182617183436046, Validation loss 1.5014772772789002, Validation accuracy 0.4444967836141586
Validation accuracy increased from 0.44 to 0.44
Epoch 33, Train loss 1.5257244110107422, Train accuracy 0.4409019886092706, Validation loss 1.49797984957695, Validation accuracy 0.4456686586141586
Validation accuracy increased from 0.44 to 0.45
Epoch 34, Train loss 1.5215892358259722, Train accuracy 0.4450257456099445, Validation loss 1.4939268350601196, Validation accuracy 0.44703584611415864
Validation accuracy increased from 0.45 to 0.45
Epoch 35, Train loss 1.5183278742161663, Train accuracy 0.4460600142113187, Validation loss 1.4922362267971039, Validation accuracy 0.44820772111415863
Validation accuracy increased from 0.45 to 0.45
Epoch 36, Train loss 1.513097428462722, Train accuracy 0.4449298649348996, Validation loss 1.4873667299747466, Validation accuracy 0.44801240861415864
Epoch 37, Train loss 1.510889816690575, Train accuracy 0.4477361505004493, Validation loss 1.4861245930194855, Validation accuracy 0.45016084611415863
Validation accuracy increased from 0.45 to 0.45
Epoch 38, Train loss 1.5092426985502243, Train accuracy 0.44803710925308143, Validation loss 1.4818036794662475, Validation accuracy 0.4523092836141586
Validation accuracy increased from 0.45 to 0.45
Epoch 39, Train loss 1.50706238638271, Train accuracy 0.4505291193385016, Validation loss 1.4778906643390655, Validation accuracy 0.4544347420334816
Validation accuracy increased from 0.45 to 0.45
Epoch 40, Train loss 1.5078849596056072, Train accuracy 0.4494513493369926, Validation loss 1.4766356825828553, Validation accuracy 0.4550206795334816
Validation accuracy increased from 0.45 to 0.46
Epoch 41, Train loss 1.5050603652542287, Train accuracy 0.45279651981863106, Validation loss 1.4780431866645813, Validation accuracy 0.4544117644429207
Epoch 42, Train loss 1.5037837407805703, Train accuracy 0.4508114345371723, Validation loss 1.4724812269210816, Validation accuracy 0.4575367644429207
Validation accuracy increased from 0.46 to 0.46
Epoch 43, Train loss 1.5001397661187432, Train accuracy 0.4506498578597199, Validation loss 1.4715928316116333, Validation accuracy 0.45890395194292066
Validation accuracy increased from 0.46 to 0.46
Epoch 44, Train loss 1.4997371584177017, Train accuracy 0.45393199575218285, Validation loss 1.4723187208175659, Validation accuracy 0.45797334611415863
Epoch 45, Train loss 1.499650900336829, Train accuracy 0.45358309657736257, Validation loss 1.4730311691761018, Validation accuracy 0.4558019295334816
Epoch 46, Train loss 1.4958433359861374, Train accuracy 0.45631569590080867, Validation loss 1.473568844795227, Validation accuracy 0.45701976120471954
Epoch 47, Train loss 1.4990376383066177, Train accuracy 0.4539559657939456, Validation loss 1.4663091838359832, Validation accuracy 0.46281020194292066
Validation accuracy increased from 0.46 to 0.46
Epoch 48, Train loss 1.4939979429949413, Train accuracy 0.4544193891977722, Validation loss 1.464186668395996, Validation accuracy 0.4629825368523598
Validation accuracy increased from 0.46 to 0.46
Epoch 49, Train loss 1.4963354488665408, Train accuracy 0.45283203114840115, Validation loss 1.4655312657356263, Validation accuracy 0.4645909920334816
Validation accuracy increased from 0.46 to 0.46
Epoch 50, Train loss 1.4943188842047344, Train accuracy 0.45582475140690804, Validation loss 1.4644495129585267, Validation accuracy 0.4600528493523598
Epoch 51, Train loss 1.4909303669225087, Train accuracy 0.45630681819536467, Validation loss 1.4660437643527984, Validation accuracy 0.46181066185235975
Epoch 52, Train loss 1.4944284070621838, Train accuracy 0.4562056108631871, Validation loss 1.4634743273258208, Validation accuracy 0.4624195769429207
Epoch 53, Train loss 1.4878116392276504, Train accuracy 0.45998934656381607, Validation loss 1.46239932179451, Validation accuracy 0.4635914519429207
Epoch 54, Train loss 1.4911108260804957, Train accuracy 0.45418945310468023, Validation loss 1.4628901958465577, Validation accuracy 0.4629825368523598
Epoch 55, Train loss 1.4897058152339675, Train accuracy 0.45575550418685784, Validation loss 1.4615049719810487, Validation accuracy 0.4626378670334816
Epoch 56, Train loss 1.4855056845329024, Train accuracy 0.4555131391706792, Validation loss 1.4612471282482147, Validation accuracy 0.4602481618523598
Epoch 57, Train loss 1.48628499426625, Train accuracy 0.4576917612417178, Validation loss 1.4584165871143342, Validation accuracy 0.4649586394429207
Validation accuracy increased from 0.46 to 0.46
Epoch 58, Train loss 1.4825341281565754, Train accuracy 0.45994406938552856, Validation loss 1.4591634631156922, Validation accuracy 0.4635914519429207
Epoch 59, Train loss 1.4850448403846135, Train accuracy 0.4573268820954995, Validation loss 1.4561991930007934, Validation accuracy 0.4633961394429207
Epoch 60, Train loss 1.483881268988956, Train accuracy 0.4590740412135016, Validation loss 1.459889155626297, Validation accuracy 0.4602711394429207
Epoch 61, Train loss 1.4847509955818003, Train accuracy 0.4594921874390407, Validation loss 1.4589557647705078, Validation accuracy 0.46476332694292066
Epoch 62, Train loss 1.4835946160283955, Train accuracy 0.45954456671395083, Validation loss 1.4570948481559753, Validation accuracy 0.4645680144429207
Epoch 63, Train loss 1.4825436093590476, Train accuracy 0.46065607243640855, Validation loss 1.4569808661937713, Validation accuracy 0.4643727019429207
Epoch 64, Train loss 1.4839536425742237, Train accuracy 0.4575079899619926, Validation loss 1.4572983860969544, Validation accuracy 0.46476332694292066
Epoch 65, Train loss 1.4825947386297313, Train accuracy 0.4584845524619926, Validation loss 1.4587814927101135, Validation accuracy 0.4618566170334816
Epoch 66, Train loss 1.4827345243909142, Train accuracy 0.45947088064117864, Validation loss 1.4557628631591797, Validation accuracy 0.4647863045334816
Epoch 67, Train loss 1.4812611456621776, Train accuracy 0.45955255678431556, Validation loss 1.454345965385437, Validation accuracy 0.4639820769429207
Epoch 68, Train loss 1.482634874907407, Train accuracy 0.45845614339817653, Validation loss 1.4557157039642334, Validation accuracy 0.4641773894429207
Epoch 69, Train loss 1.4826357527212664, Train accuracy 0.45877308229153807, Validation loss 1.453993821144104, Validation accuracy 0.4661305144429207
Validation accuracy increased from 0.46 to 0.47
Epoch 0, Train loss 2.2453943341970444, Train accuracy 0.1492134232751348, Validation loss 2.181503248214722, Validation accuracy 0.17977941185235977
Validation accuracy increased from 0.00 to 0.18
Epoch 1, Train loss 2.119605625217611, Train accuracy 0.20991654829545456, Validation loss 2.070301651954651, Validation accuracy 0.2181640625
Validation accuracy increased from 0.18 to 0.22
Epoch 2, Train loss 2.0288948951797052, Train accuracy 0.24676846594295718, Validation loss 1.98735613822937, Validation accuracy 0.2536649823188782
Validation accuracy increased from 0.22 to 0.25
Epoch 3, Train loss 1.965301145206798, Train accuracy 0.2749946732920679, Validation loss 1.9279245138168335, Validation accuracy 0.27644761055707934
Validation accuracy increased from 0.25 to 0.28
Epoch 4, Train loss 1.9115432568571784, Train accuracy 0.2948126775974577, Validation loss 1.8739593505859375, Validation accuracy 0.29840303361415865
Validation accuracy increased from 0.28 to 0.30
Epoch 5, Train loss 1.8653664548288693, Train accuracy 0.3079110439866781, Validation loss 1.8297117710113526, Validation accuracy 0.3136144295334816
Validation accuracy increased from 0.30 to 0.31
Epoch 6, Train loss 1.8306002820079976, Train accuracy 0.3206622868098996, Validation loss 1.796409547328949, Validation accuracy 0.3272403493523598
Validation accuracy increased from 0.31 to 0.33
Epoch 7, Train loss 1.801799281754277, Train accuracy 0.3328488990664482, Validation loss 1.763099879026413, Validation accuracy 0.3399356618523598
Validation accuracy increased from 0.33 to 0.34
Epoch 8, Train loss 1.7797371250661937, Train accuracy 0.34180486507036467, Validation loss 1.7414969146251678, Validation accuracy 0.3564223349094391
Validation accuracy increased from 0.34 to 0.36
Epoch 9, Train loss 1.7595741254362194, Train accuracy 0.34653941762040963, Validation loss 1.720646721124649, Validation accuracy 0.3613511025905609
Validation accuracy increased from 0.36 to 0.36
Epoch 10, Train loss 1.7403295216235248, Train accuracy 0.3545907314189456, Validation loss 1.70163654088974, Validation accuracy 0.3696461394429207
Validation accuracy increased from 0.36 to 0.37
Epoch 11, Train loss 1.7247923294251615, Train accuracy 0.35876065340231766, Validation loss 1.6843756139278412, Validation accuracy 0.37504595667123797
Validation accuracy increased from 0.37 to 0.38
Epoch 12, Train loss 1.7111064398830587, Train accuracy 0.3663316760212183, Validation loss 1.6681557416915893, Validation accuracy 0.3798828125
Validation accuracy increased from 0.38 to 0.38
Epoch 13, Train loss 1.6952987455508925, Train accuracy 0.3698348721319979, Validation loss 1.6531366109848022, Validation accuracy 0.3856732532382011
Validation accuracy increased from 0.38 to 0.39
Epoch 14, Train loss 1.6800767860629342, Train accuracy 0.3796519886024974, Validation loss 1.6336384832859039, Validation accuracy 0.39365808814764025
Validation accuracy increased from 0.39 to 0.39
Epoch 15, Train loss 1.6657642220908946, Train accuracy 0.3851100851527669, Validation loss 1.6194940567016602, Validation accuracy 0.3952205881476402
Validation accuracy increased from 0.39 to 0.40
Epoch 16, Train loss 1.655384642834013, Train accuracy 0.385753728618676, Validation loss 1.6079046368598937, Validation accuracy 0.4021829038858414
Validation accuracy increased from 0.40 to 0.40
Epoch 17, Train loss 1.6471735401587053, Train accuracy 0.3891823508522727, Validation loss 1.5951472401618958, Validation accuracy 0.4049402579665184
Validation accuracy increased from 0.40 to 0.40
Epoch 18, Train loss 1.6323954903266646, Train accuracy 0.39655628546395083, Validation loss 1.5816618859767915, Validation accuracy 0.4084788605570793
Validation accuracy increased from 0.40 to 0.41
Epoch 19, Train loss 1.6218084212053905, Train accuracy 0.39889293316413055, Validation loss 1.5748779952526093, Validation accuracy 0.4088694855570793
Validation accuracy increased from 0.41 to 0.41
Epoch 20, Train loss 1.6135130680420182, Train accuracy 0.4042879971252246, Validation loss 1.5677414059638977, Validation accuracy 0.4157054230570793
Validation accuracy increased from 0.41 to 0.42
Epoch 21, Train loss 1.6099781502376904, Train accuracy 0.4056809304112738, Validation loss 1.564489448070526, Validation accuracy 0.4152918204665184
Epoch 22, Train loss 1.6079308546402238, Train accuracy 0.4039479758251797, Validation loss 1.5602277874946595, Validation accuracy 0.4211741730570793
Validation accuracy increased from 0.42 to 0.42
Epoch 23, Train loss 1.6032845628532497, Train accuracy 0.40706409801813687, Validation loss 1.5571737170219422, Validation accuracy 0.4190027579665184
Epoch 24, Train loss 1.6005778095938943, Train accuracy 0.4091574928977273, Validation loss 1.5546731531620026, Validation accuracy 0.4197840079665184
Epoch 25, Train loss 1.5977651422674006, Train accuracy 0.40967773425985465, Validation loss 1.5521391928195953, Validation accuracy 0.4225183829665184
Validation accuracy increased from 0.42 to 0.42
Epoch 26, Train loss 1.5939513058824972, Train accuracy 0.4102121803232215, Validation loss 1.5475804328918457, Validation accuracy 0.4272288605570793
Validation accuracy increased from 0.42 to 0.43
Epoch 27, Train loss 1.5921451158144257, Train accuracy 0.41253817470913584, Validation loss 1.5448847532272338, Validation accuracy 0.4252757355570793
Epoch 28, Train loss 1.5875328128988093, Train accuracy 0.4109268466180021, Validation loss 1.5399692595005035, Validation accuracy 0.4299632355570793
Validation accuracy increased from 0.43 to 0.43
Epoch 29, Train loss 1.5850922776894136, Train accuracy 0.41452059657736257, Validation loss 1.5371788084506988, Validation accuracy 0.4309168204665184
Validation accuracy increased from 0.43 to 0.43
Epoch 30, Train loss 1.5825480195609005, Train accuracy 0.41504705257036467, Validation loss 1.5346124470233917, Validation accuracy 0.4303538605570793
Epoch 31, Train loss 1.5778846977786585, Train accuracy 0.4160111859779466, Validation loss 1.5300204932689667, Validation accuracy 0.4313534006476402
Validation accuracy increased from 0.43 to 0.43
Epoch 32, Train loss 1.574884097007188, Train accuracy 0.41885830953039904, Validation loss 1.5259724318981172, Validation accuracy 0.43389246314764024
Validation accuracy increased from 0.43 to 0.43
Epoch 33, Train loss 1.573264359750531, Train accuracy 0.41863370026377117, Validation loss 1.5244183123111725, Validation accuracy 0.4352136954665184
Validation accuracy increased from 0.43 to 0.44
Epoch 34, Train loss 1.5689489712769336, Train accuracy 0.4201899856667627, Validation loss 1.52160142660141, Validation accuracy 0.4335018381476402
Epoch 35, Train loss 1.5655344826253978, Train accuracy 0.42162908376617864, Validation loss 1.5196048378944398, Validation accuracy 0.4348460480570793
Epoch 36, Train loss 1.5638349117203192, Train accuracy 0.42230823856185784, Validation loss 1.5156545877456664, Validation accuracy 0.4377757355570793
Validation accuracy increased from 0.44 to 0.44
Epoch 37, Train loss 1.560468615456061, Train accuracy 0.4242471590299498, Validation loss 1.5135001063346862, Validation accuracy 0.44148667305707934
Validation accuracy increased from 0.44 to 0.44
Epoch 38, Train loss 1.5586685172536157, Train accuracy 0.42405894872817124, Validation loss 1.510447758436203, Validation accuracy 0.44044117629528046
Epoch 39, Train loss 1.5528151582587848, Train accuracy 0.42700994319536467, Validation loss 1.5064469873905182, Validation accuracy 0.44280790388584135
Validation accuracy increased from 0.44 to 0.44
Epoch 40, Train loss 1.5546134188771248, Train accuracy 0.42520685358480975, Validation loss 1.5070424735546113, Validation accuracy 0.4404871329665184
Epoch 41, Train loss 1.553428696637804, Train accuracy 0.42583362927491014, Validation loss 1.5045729875564575, Validation accuracy 0.4410500913858414
Epoch 42, Train loss 1.5522451475262642, Train accuracy 0.4260387073524974, Validation loss 1.5036435008049012, Validation accuracy 0.4426355704665184
Epoch 43, Train loss 1.5492138815197078, Train accuracy 0.42724875699390064, Validation loss 1.502136492729187, Validation accuracy 0.4412683829665184
Epoch 44, Train loss 1.5483086671341548, Train accuracy 0.4269398081709038, Validation loss 1.5006880521774293, Validation accuracy 0.44534696638584137
Validation accuracy increased from 0.44 to 0.45
Epoch 45, Train loss 1.5481696047566154, Train accuracy 0.4298703834753145, Validation loss 1.5003404915332794, Validation accuracy 0.44844898879528045
Validation accuracy increased from 0.45 to 0.45
Epoch 46, Train loss 1.5480415299534798, Train accuracy 0.42724609375, Validation loss 1.4986304342746735, Validation accuracy 0.4461282163858414
Epoch 47, Train loss 1.5482252070849591, Train accuracy 0.42940696024081926, Validation loss 1.4991210043430327, Validation accuracy 0.44539292305707934
Epoch 48, Train loss 1.5446403223005207, Train accuracy 0.43144975128498947, Validation loss 1.4988887667655946, Validation accuracy 0.44651884138584136
Epoch 49, Train loss 1.5461128530177204, Train accuracy 0.429825994270769, Validation loss 1.495758867263794, Validation accuracy 0.4478860288858414
Epoch 50, Train loss 1.5415128286589275, Train accuracy 0.43193093026903545, Validation loss 1.495541226863861, Validation accuracy 0.45020680129528046
Validation accuracy increased from 0.45 to 0.45
Epoch 51, Train loss 1.5384437861767681, Train accuracy 0.43226917612959037, Validation loss 1.49486186504364, Validation accuracy 0.4498161762952805
Epoch 52, Train loss 1.5431389876387336, Train accuracy 0.43370028398931026, Validation loss 1.4924192547798156, Validation accuracy 0.45059742629528043
Validation accuracy increased from 0.45 to 0.45
Epoch 53, Train loss 1.5419346317648888, Train accuracy 0.4308052201840011, Validation loss 1.4941251277923584, Validation accuracy 0.45022977888584137
Epoch 54, Train loss 1.5400631644509055, Train accuracy 0.4306028053503145, Validation loss 1.4932640194892883, Validation accuracy 0.45062040388584135
Validation accuracy increased from 0.45 to 0.45
Epoch 55, Train loss 1.5391682237386703, Train accuracy 0.42955610782585363, Validation loss 1.4910657405853271, Validation accuracy 0.45311351120471954
Validation accuracy increased from 0.45 to 0.45
Epoch 56, Train loss 1.5369310947981747, Train accuracy 0.4340997868302194, Validation loss 1.490626472234726, Validation accuracy 0.4525275737047195
Epoch 57, Train loss 1.5369061963124708, Train accuracy 0.43551047586581926, Validation loss 1.4894443035125733, Validation accuracy 0.4527688413858414
Epoch 58, Train loss 1.534604243256829, Train accuracy 0.4365571732209487, Validation loss 1.4884546220302581, Validation accuracy 0.45330882370471953
Validation accuracy increased from 0.45 to 0.45
Epoch 59, Train loss 1.5361079993573101, Train accuracy 0.43238991465080867, Validation loss 1.4876920580863953, Validation accuracy 0.45565257370471957
Validation accuracy increased from 0.45 to 0.46
Epoch 60, Train loss 1.5337115119804035, Train accuracy 0.43166193179786205, Validation loss 1.487045681476593, Validation accuracy 0.4564338237047195
Validation accuracy increased from 0.46 to 0.46
Epoch 61, Train loss 1.5345524502071468, Train accuracy 0.4354687499051744, Validation loss 1.4874207973480225, Validation accuracy 0.45606617629528046
Epoch 62, Train loss 1.5331675681200894, Train accuracy 0.43610795451836154, Validation loss 1.4878623962402344, Validation accuracy 0.45352711379528043
Epoch 63, Train loss 1.5336354781280865, Train accuracy 0.4332066760821776, Validation loss 1.487346851825714, Validation accuracy 0.45584788620471955
Epoch 64, Train loss 1.5360494256019592, Train accuracy 0.433842329477722, Validation loss 1.4854873895645142, Validation accuracy 0.45430836379528045
Epoch 65, Train loss 1.5334618464112282, Train accuracy 0.4350204190069979, Validation loss 1.4871488749980926, Validation accuracy 0.45489430129528047
Epoch 66, Train loss 1.5304126834327525, Train accuracy 0.435065696015954, Validation loss 1.4844233691692352, Validation accuracy 0.45352711379528043
Epoch 67, Train loss 1.5304402817379346, Train accuracy 0.4375177555802194, Validation loss 1.4858862459659576, Validation accuracy 0.45489430129528047
Epoch 68, Train loss 1.5331363075158813, Train accuracy 0.43517400561408565, Validation loss 1.485367661714554, Validation accuracy 0.4564338237047195
Validation accuracy increased from 0.46 to 0.46
Epoch 69, Train loss 1.529086023569107, Train accuracy 0.43512695299630816, Validation loss 1.4855854630470275, Validation accuracy 0.45645680129528043
Validation accuracy increased from 0.46 to 0.46
Test loss: 1.4470745593309402 Test accuracy: 0.4671875  resnet10_AdaDelta_0.001
Test loss: 1.1730322271585465 Test accuracy: 0.57451171875  resnet18_AdaDelta_0.001
Test loss: 1.6761162757873536 Test accuracy: 0.37978515625  resnet12_AdaDelta_0.001
Test loss: 1.4589302599430085 Test accuracy: 0.46337890625  resnet14_4_AdaDelta_0.001
Test loss: 1.5046366631984711 Test accuracy: 0.440234375  resnet14_5_AdaDelta_0.001