commitment loss too large and how to choose codebook dim

[Walleeeda]

trafficstars

hi, i am training VQ-VAE-1 on my own dataset, the result was fine, but the commitment loss become very large suddenly at epoch 115 while the picture reconstructed become meaningful from a mess . And in some other training tasks it got small. The codebook dim is 256256. Besides I wonder if there is any trick to choose a appropriate dims for the codebook? When I change the codebook dim from 128256 to 256*256 the picture become less blurry. The picture is totally mess before 115 epoch, should I increase the learning rate in the former epochs? very thanks

The loss during training process in below: ` D:\anaconda3\envs\zzq\python.exe I:/zouzhiqiang/paperCode/GradedPorousDesign-main/VQ_VAE_Microstructure-norm-thickness.py Torch version: 2.0.0 Number of training batches: 221 batch size= 8 total: 1768 Number of test batches: 25 batch size= 8 total: 200 TOTAL images (account for full batches): 1968 Final resolution of encoder (must be start resolution of decoder): 16 Final resolution of decoder: 512

Total parameters: 28937059 trainable parameters: 28937059

Start training VQ-VAE... 100%|██████████| 221/221 [02:32<00:00, 1.45it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 1 step: 221 recon_loss: 5.187987327575684 commit_loss: 0.19815604388713837 total_loss: 5.386143207550049 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_0.pt 100%|██████████| 221/221 [02:26<00:00, 1.51it/s] epoch: 2 step: 221 recon_loss: 5.1184515953063965 commit_loss: 0.08173958957195282 total_loss: 5.200191020965576 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_1.pt 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] epoch: 3 step: 221 recon_loss: 5.018422603607178 commit_loss: 0.09580842405557632 total_loss: 5.114231109619141 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_2.pt 100%|██████████| 221/221 [02:25<00:00, 1.51it/s] epoch: 4 step: 221 recon_loss: 5.025679111480713 commit_loss: 0.04174623265862465 total_loss: 5.06742525100708 Smaller loss found Saved checkpoint: ./VQ_VAE_results//model-epoch_3.pt 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 5 step: 221 recon_loss: 5.0415568351745605 commit_loss: 1.3747451305389404 total_loss: 6.416301727294922 100%|██████████| 221/221 [02:26<00:00, 1.51it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 6 step: 221 recon_loss: 4.96785306930542 commit_loss: 0.02538653463125229 total_loss: 4.993239402770996 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_5.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] epoch: 7 step: 221 recon_loss: 4.9734039306640625 commit_loss: 0.07220243662595749 total_loss: 5.0456061363220215 Smaller loss found Saved checkpoint: ./VQ_VAE_results//model-epoch_6.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 8 step: 221 recon_loss: 4.976195335388184 commit_loss: 0.05087792128324509 total_loss: 5.027073383331299 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] epoch: 9 step: 221 recon_loss: 4.946740627288818 commit_loss: 0.03639496490359306 total_loss: 4.98313570022583 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_8.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 10 step: 221 recon_loss: 4.946041107177734 commit_loss: 0.023159511387348175 total_loss: 4.969200611114502 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_9.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 11 step: 221 recon_loss: 4.9399027824401855 commit_loss: 0.023019971325993538 total_loss: 4.9629225730896 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_10.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 12 step: 221 recon_loss: 4.935513973236084 commit_loss: 0.024096887558698654 total_loss: 4.959610939025879 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 13 step: 221 recon_loss: 4.9678168296813965 commit_loss: 0.053205590695142746 total_loss: 5.021022319793701 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_12.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 14 step: 221 recon_loss: 4.95276403427124 commit_loss: 0.018411345779895782 total_loss: 4.971175193786621 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 15 step: 221 recon_loss: 4.915274620056152 commit_loss: 0.026097722351551056 total_loss: 4.941372394561768 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 16 step: 221 recon_loss: 4.94404411315918 commit_loss: 0.0791289359331131 total_loss: 5.023172855377197 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_15.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 17 step: 221 recon_loss: 4.923158168792725 commit_loss: 0.025404470041394234 total_loss: 4.9485626220703125 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 18 step: 221 recon_loss: 4.956504821777344 commit_loss: 0.11633662134408951 total_loss: 5.072841644287109 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 19 step: 221 recon_loss: 4.9071149826049805 commit_loss: 0.02657916024327278 total_loss: 4.933694362640381 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 20 step: 221 recon_loss: 4.8910088539123535 commit_loss: 0.013448474928736687 total_loss: 4.904457092285156 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 21 step: 221 recon_loss: 4.995411396026611 commit_loss: 0.16012528538703918 total_loss: 5.155536651611328 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_20.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 22 step: 221 recon_loss: 4.94743537902832 commit_loss: 0.0274781733751297 total_loss: 4.974913597106934 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 23 step: 221 recon_loss: 4.961064338684082 commit_loss: 0.025651926174759865 total_loss: 4.986716270446777 100%|██████████| 221/221 [02:26<00:00, 1.51it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 24 step: 221 recon_loss: 4.912993431091309 commit_loss: 0.01694468967616558 total_loss: 4.929938316345215 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] epoch: 25 step: 221 recon_loss: 4.895869731903076 commit_loss: 0.012498009949922562 total_loss: 4.90836763381958 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_24.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 26 step: 221 recon_loss: 4.887053489685059 commit_loss: 0.025183551013469696 total_loss: 4.912237167358398 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_25.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 27 step: 221 recon_loss: 4.87717866897583 commit_loss: 0.025793373584747314 total_loss: 4.902972221374512 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 28 step: 221 recon_loss: 4.902442932128906 commit_loss: 0.01960173435509205 total_loss: 4.92204475402832 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 29 step: 221 recon_loss: 4.875180721282959 commit_loss: 0.018883749842643738 total_loss: 4.894064426422119 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 30 step: 221 recon_loss: 4.876138687133789 commit_loss: 0.03347122669219971 total_loss: 4.909609794616699 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 31 step: 221 recon_loss: 4.966177940368652 commit_loss: 0.023661812767386436 total_loss: 4.989839553833008 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_30.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 32 step: 221 recon_loss: 4.92429780960083 commit_loss: 0.18525873124599457 total_loss: 5.109556674957275 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 33 step: 221 recon_loss: 4.921785354614258 commit_loss: 0.20936451852321625 total_loss: 5.131149768829346 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 34 step: 221 recon_loss: 4.920873165130615 commit_loss: 0.14564679563045502 total_loss: 5.066519737243652 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 35 step: 221 recon_loss: 4.964882850646973 commit_loss: 0.22637178003787994 total_loss: 5.191254615783691 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 36 step: 221 recon_loss: 4.879281997680664 commit_loss: 0.22448918223381042 total_loss: 5.103771209716797 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_35.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 37 step: 221 recon_loss: 4.88424825668335 commit_loss: 0.1569792926311493 total_loss: 5.041227340698242 Smaller loss found Saved checkpoint: ./VQ_VAE_results//model-epoch_36.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 38 step: 221 recon_loss: 4.987987518310547 commit_loss: 0.11706960946321487 total_loss: 5.105057239532471 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 39 step: 221 recon_loss: 4.885180473327637 commit_loss: 0.13237319886684418 total_loss: 5.017553806304932 Smaller loss found Saved checkpoint: ./VQ_VAE_results//model-epoch_38.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] epoch: 40 step: 221 recon_loss: 4.8865251541137695 commit_loss: 0.07046405971050262 total_loss: 4.956989288330078 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_39.pt 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 41 step: 221 recon_loss: 4.900767803192139 commit_loss: 0.07949944585561752 total_loss: 4.98026704788208 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_40.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 42 step: 221 recon_loss: 4.9081339836120605 commit_loss: 0.0958617553114891 total_loss: 5.003995895385742 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] epoch: 43 step: 221 recon_loss: 4.870381832122803 commit_loss: 0.057546887546777725 total_loss: 4.927928924560547 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_42.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 44 step: 221 recon_loss: 4.907473087310791 commit_loss: 0.04880385100841522 total_loss: 4.956276893615723 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_43.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 45 step: 221 recon_loss: 4.872288227081299 commit_loss: 0.04280387610197067 total_loss: 4.9150919914245605 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 46 step: 221 recon_loss: 4.874960899353027 commit_loss: 0.059063754975795746 total_loss: 4.934024810791016 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_45.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 47 step: 221 recon_loss: 4.881483554840088 commit_loss: 0.0456763356924057 total_loss: 4.927159786224365 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 48 step: 221 recon_loss: 4.867276191711426 commit_loss: 0.054074641317129135 total_loss: 4.921350955963135 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 49 step: 221 recon_loss: 4.8815765380859375 commit_loss: 0.041284188628196716 total_loss: 4.922860622406006 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 50 step: 221 recon_loss: 4.863083839416504 commit_loss: 0.02895408682525158 total_loss: 4.892037868499756 Smaller loss found 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_49.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 51 step: 221 recon_loss: 4.856932640075684 commit_loss: 0.03541937470436096 total_loss: 4.892352104187012 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_50.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 52 step: 221 recon_loss: 4.853273868560791 commit_loss: 0.03226723149418831 total_loss: 4.885540962219238 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 53 step: 221 recon_loss: 4.87321662902832 commit_loss: 0.05268438160419464 total_loss: 4.925900936126709 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 54 step: 221 recon_loss: 4.863171100616455 commit_loss: 0.07307574898004532 total_loss: 4.936246871948242 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 55 step: 221 recon_loss: 4.846048355102539 commit_loss: 0.059801872819662094 total_loss: 4.905850410461426 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 56 step: 221 recon_loss: 4.8844828605651855 commit_loss: 0.07605692744255066 total_loss: 4.960539817810059 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_55.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 57 step: 221 recon_loss: 4.849491119384766 commit_loss: 0.08448302745819092 total_loss: 4.933974266052246 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 58 step: 221 recon_loss: 4.8788042068481445 commit_loss: 0.12204521894454956 total_loss: 5.00084924697876 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 59 step: 221 recon_loss: 4.838230609893799 commit_loss: 0.11098623275756836 total_loss: 4.949216842651367 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 60 step: 221 recon_loss: 4.827396869659424 commit_loss: 0.13924959301948547 total_loss: 4.966646671295166 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 61 step: 221 recon_loss: 4.869073390960693 commit_loss: 0.1915062665939331 total_loss: 5.060579776763916 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_60.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 62 step: 221 recon_loss: 4.830260276794434 commit_loss: 0.15846849977970123 total_loss: 4.988729000091553 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 63 step: 221 recon_loss: 4.830801486968994 commit_loss: 0.16914692521095276 total_loss: 4.999948501586914 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 64 step: 221 recon_loss: 4.803060054779053 commit_loss: 0.1816207766532898 total_loss: 4.984680652618408 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 65 step: 221 recon_loss: 4.826513290405273 commit_loss: 0.19738711416721344 total_loss: 5.023900508880615 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 66 step: 221 recon_loss: 4.824405670166016 commit_loss: 0.17764446139335632 total_loss: 5.002049922943115 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_65.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 67 step: 221 recon_loss: 4.7913007736206055 commit_loss: 0.1950397789478302 total_loss: 4.986340522766113 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 68 step: 221 recon_loss: 4.813645839691162 commit_loss: 0.2529490888118744 total_loss: 5.066595077514648 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] epoch: 69 step: 221 recon_loss: 4.793996810913086 commit_loss: 0.20060396194458008 total_loss: 4.994600772857666 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 70 step: 221 recon_loss: 4.798242092132568 commit_loss: 0.2482927441596985 total_loss: 5.046535015106201 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 71 step: 221 recon_loss: 4.7786970138549805 commit_loss: 0.21441665291786194 total_loss: 4.9931135177612305 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_70.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 72 step: 221 recon_loss: 4.789189338684082 commit_loss: 0.20285332202911377 total_loss: 4.992042541503906 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 73 step: 221 recon_loss: 4.799232482910156 commit_loss: 0.21293027698993683 total_loss: 5.012162685394287 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 74 step: 221 recon_loss: 4.783778190612793 commit_loss: 0.20490899682044983 total_loss: 4.988687038421631 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 75 step: 221 recon_loss: 4.832439422607422 commit_loss: 0.30354276299476624 total_loss: 5.135982036590576 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 76 step: 221 recon_loss: 4.7929606437683105 commit_loss: 0.284775972366333 total_loss: 5.077736854553223 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_75.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 77 step: 221 recon_loss: 4.801915168762207 commit_loss: 0.2590583562850952 total_loss: 5.060973644256592 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 78 step: 221 recon_loss: 4.7790069580078125 commit_loss: 0.24178585410118103 total_loss: 5.0207929611206055 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 79 step: 221 recon_loss: 4.774430274963379 commit_loss: 0.26389890909194946 total_loss: 5.038329124450684 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 80 step: 221 recon_loss: 4.77255392074585 commit_loss: 0.2741394639015198 total_loss: 5.046693325042725 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 81 step: 221 recon_loss: 4.853328227996826 commit_loss: 0.2901367247104645 total_loss: 5.143465042114258 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_80.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 82 step: 221 recon_loss: 4.779003143310547 commit_loss: 0.29858705401420593 total_loss: 5.077589988708496 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 83 step: 221 recon_loss: 4.783629417419434 commit_loss: 0.3183470666408539 total_loss: 5.10197639465332 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 84 step: 221 recon_loss: 4.762874603271484 commit_loss: 0.28196167945861816 total_loss: 5.044836044311523 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 85 step: 221 recon_loss: 4.7769083976745605 commit_loss: 0.2746046483516693 total_loss: 5.051513195037842 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 86 step: 221 recon_loss: 4.750156879425049 commit_loss: 0.2958540916442871 total_loss: 5.046010971069336 0%| | 0/25 [00:00<?, ?it/s]Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_85.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 87 step: 221 recon_loss: 4.7615461349487305 commit_loss: 0.2670494318008423 total_loss: 5.028595447540283 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 88 step: 221 recon_loss: 4.751869201660156 commit_loss: 0.26589882373809814 total_loss: 5.017767906188965 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 89 step: 221 recon_loss: 4.787233352661133 commit_loss: 0.26651501655578613 total_loss: 5.05374813079834 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 90 step: 221 recon_loss: 4.754038333892822 commit_loss: 0.34885480999946594 total_loss: 5.102893352508545 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 91 step: 221 recon_loss: 4.750657558441162 commit_loss: 0.36122897267341614 total_loss: 5.111886501312256 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_90.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 92 step: 221 recon_loss: 4.746706962585449 commit_loss: 0.42772385478019714 total_loss: 5.174430847167969 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 93 step: 221 recon_loss: 4.729928493499756 commit_loss: 0.4378007650375366 total_loss: 5.167729377746582 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 94 step: 221 recon_loss: 4.7276930809021 commit_loss: 0.41707009077072144 total_loss: 5.144762992858887 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 95 step: 221 recon_loss: 4.730693817138672 commit_loss: 0.45901158452033997 total_loss: 5.1897053718566895 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 96 step: 221 recon_loss: 4.717524528503418 commit_loss: 0.5443251132965088 total_loss: 5.261849403381348 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_95.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 97 step: 221 recon_loss: 4.69777774810791 commit_loss: 0.5519477725028992 total_loss: 5.249725341796875 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 98 step: 221 recon_loss: 4.679534912109375 commit_loss: 0.6231390237808228 total_loss: 5.302673816680908 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 99 step: 221 recon_loss: 4.721165657043457 commit_loss: 0.7299699783325195 total_loss: 5.451135635375977 100%|██████████| 221/221 [02:23<00:00, 1.54it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 100 step: 221 recon_loss: 4.687502861022949 commit_loss: 0.8391394019126892 total_loss: 5.526642322540283 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 101 step: 221 recon_loss: 4.658416271209717 commit_loss: 0.9799220561981201 total_loss: 5.638338088989258 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_100.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 102 step: 221 recon_loss: 4.688488006591797 commit_loss: 1.0106512308120728 total_loss: 5.69913911819458 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 103 step: 221 recon_loss: 4.625061988830566 commit_loss: 1.1532886028289795 total_loss: 5.778350830078125 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 104 step: 221 recon_loss: 4.583119869232178 commit_loss: 1.4548999071121216 total_loss: 6.03801965713501 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 105 step: 221 recon_loss: 4.59157657623291 commit_loss: 1.5365447998046875 total_loss: 6.128121376037598 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 106 step: 221 recon_loss: 4.785717964172363 commit_loss: 1.9599900245666504 total_loss: 6.745707988739014 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_105.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 107 step: 221 recon_loss: 4.497317314147949 commit_loss: 2.3471262454986572 total_loss: 6.844443321228027 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 108 step: 221 recon_loss: 4.474706172943115 commit_loss: 2.5333914756774902 total_loss: 7.0080976486206055 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 109 step: 221 recon_loss: 4.497117519378662 commit_loss: 2.9619712829589844 total_loss: 7.4590888023376465 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 110 step: 221 recon_loss: 4.31696081161499 commit_loss: 3.6043317317962646 total_loss: 7.921292304992676 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 111 step: 221 recon_loss: 4.272067070007324 commit_loss: 4.054202556610107 total_loss: 8.326269149780273 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_110.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 112 step: 221 recon_loss: 4.275753021240234 commit_loss: 5.162024021148682 total_loss: 9.437776565551758 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 113 step: 221 recon_loss: 4.136531352996826 commit_loss: 5.41433048248291 total_loss: 9.550861358642578 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 114 step: 221 recon_loss: 4.258704662322998 commit_loss: 6.762807846069336 total_loss: 11.021512985229492 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 115 step: 221 recon_loss: 4.077442646026611 commit_loss: 7.520236015319824 total_loss: 11.597679138183594 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 116 step: 221 recon_loss: 4.013914108276367 commit_loss: 9.561237335205078 total_loss: 13.575151443481445 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_115.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 117 step: 221 recon_loss: 3.8755881786346436 commit_loss: 9.723660469055176 total_loss: 13.599248886108398 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 118 step: 221 recon_loss: 3.7691152095794678 commit_loss: 11.943510055541992 total_loss: 15.712625503540039 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 119 step: 221 recon_loss: 3.9769725799560547 commit_loss: 13.94616413116455 total_loss: 17.923137664794922 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 120 step: 221 recon_loss: 3.7078142166137695 commit_loss: 13.728854179382324 total_loss: 17.436668395996094 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 121 step: 221 recon_loss: 3.7297539710998535 commit_loss: 15.663614273071289 total_loss: 19.393367767333984 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_120.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 122 step: 221 recon_loss: 3.586313009262085 commit_loss: 17.721111297607422 total_loss: 21.307424545288086 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 123 step: 221 recon_loss: 3.5521726608276367 commit_loss: 20.111955642700195 total_loss: 23.664127349853516 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 124 step: 221 recon_loss: 3.4997501373291016 commit_loss: 20.36367416381836 total_loss: 23.86342430114746 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 125 step: 221 recon_loss: 3.2465455532073975 commit_loss: 23.686702728271484 total_loss: 26.93324851989746 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 126 step: 221 recon_loss: 3.5522055625915527 commit_loss: 24.97933578491211 total_loss: 28.53154182434082 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_125.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 127 step: 221 recon_loss: 3.1210856437683105 commit_loss: 27.579586029052734 total_loss: 30.700672149658203 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 128 step: 221 recon_loss: 3.0874037742614746 commit_loss: 29.830299377441406 total_loss: 32.917701721191406 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 129 step: 221 recon_loss: 3.1211724281311035 commit_loss: 30.70562744140625 total_loss: 33.82680130004883 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 130 step: 221 recon_loss: 2.9090495109558105 commit_loss: 32.01857376098633 total_loss: 34.9276237487793 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 131 step: 221 recon_loss: 2.8789031505584717 commit_loss: 34.13490676879883 total_loss: 37.01380920410156 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_130.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 132 step: 221 recon_loss: 2.850858211517334 commit_loss: 34.04518127441406 total_loss: 36.89603805541992 100%|██████████| 221/221 [02:30<00:00, 1.47it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 133 step: 221 recon_loss: 2.8312015533447266 commit_loss: 35.25221633911133 total_loss: 38.08341979980469 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 134 step: 221 recon_loss: 2.84084415435791 commit_loss: 40.56953048706055 total_loss: 43.41037368774414 100%|██████████| 221/221 [02:47<00:00, 1.32it/s] epoch: 135 step: 221 recon_loss: 2.7902774810791016 commit_loss: 41.06283187866211 total_loss: 43.853111267089844 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 136 step: 221 recon_loss: 2.6535348892211914 commit_loss: 44.3950309753418 total_loss: 47.04856491088867 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_135.pt 100%|██████████| 221/221 [02:36<00:00, 1.42it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 137 step: 221 recon_loss: 2.572244167327881 commit_loss: 41.02729415893555 total_loss: 43.59953689575195 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 138 step: 221 recon_loss: 2.3391470909118652 commit_loss: 42.82553482055664 total_loss: 45.16468048095703 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 139 step: 221 recon_loss: 2.4288439750671387 commit_loss: 46.59297561645508 total_loss: 49.021820068359375 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 140 step: 221 recon_loss: 2.185394287109375 commit_loss: 43.538997650146484 total_loss: 45.72439193725586 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 141 step: 221 recon_loss: 2.8193411827087402 commit_loss: 43.841758728027344 total_loss: 46.66109848022461 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_140.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 142 step: 221 recon_loss: 2.428642749786377 commit_loss: 40.95062255859375 total_loss: 43.37926483154297 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 143 step: 221 recon_loss: 2.4456119537353516 commit_loss: 43.44562530517578 total_loss: 45.8912353515625 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 144 step: 221 recon_loss: 2.511671543121338 commit_loss: 48.24710464477539 total_loss: 50.7587776184082 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 145 step: 221 recon_loss: 2.2123348712921143 commit_loss: 49.44682312011719 total_loss: 51.659156799316406 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 146 step: 221 recon_loss: 2.0873324871063232 commit_loss: 55.043556213378906 total_loss: 57.130889892578125 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_145.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 147 step: 221 recon_loss: 1.9684947729110718 commit_loss: 53.45372009277344 total_loss: 55.42221450805664 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 148 step: 221 recon_loss: 2.213376045227051 commit_loss: 54.940223693847656 total_loss: 57.15359878540039 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 149 step: 221 recon_loss: 1.9505680799484253 commit_loss: 53.15651321411133 total_loss: 55.10708236694336 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 150 step: 221 recon_loss: 1.8061927556991577 commit_loss: 59.84959411621094 total_loss: 61.65578842163086 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 151 step: 221 recon_loss: 1.9975547790527344 commit_loss: 55.37153625488281 total_loss: 57.36909103393555 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_150.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 152 step: 221 recon_loss: 1.7726311683654785 commit_loss: 54.80509948730469 total_loss: 56.57773208618164 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 153 step: 221 recon_loss: 1.7786521911621094 commit_loss: 52.39933395385742 total_loss: 54.17798614501953 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 154 step: 221 recon_loss: 1.8632925748825073 commit_loss: 51.60411071777344 total_loss: 53.467403411865234 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 155 step: 221 recon_loss: 1.7720270156860352 commit_loss: 53.508705139160156 total_loss: 55.280731201171875 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 156 step: 221 recon_loss: 1.7493550777435303 commit_loss: 51.32942199707031 total_loss: 53.07877731323242 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_155.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 157 step: 221 recon_loss: 1.5264842510223389 commit_loss: 50.67729187011719 total_loss: 52.20377731323242 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 158 step: 221 recon_loss: 1.6624720096588135 commit_loss: 52.664894104003906 total_loss: 54.32736587524414 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 159 step: 221 recon_loss: 1.6559503078460693 commit_loss: 49.72383499145508 total_loss: 51.379783630371094 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 160 step: 221 recon_loss: 1.5565364360809326 commit_loss: 48.410404205322266 total_loss: 49.966941833496094 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 161 step: 221 recon_loss: 1.588579535484314 commit_loss: 49.347564697265625 total_loss: 50.9361457824707 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_160.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 162 step: 221 recon_loss: 1.587254285812378 commit_loss: 45.666656494140625 total_loss: 47.253910064697266 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 163 step: 221 recon_loss: 1.3762092590332031 commit_loss: 50.86032485961914 total_loss: 52.236534118652344 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 164 step: 221 recon_loss: 1.4520316123962402 commit_loss: 50.700714111328125 total_loss: 52.15274429321289 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 165 step: 221 recon_loss: 1.366031527519226 commit_loss: 51.334434509277344 total_loss: 52.70046615600586 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 166 step: 221 recon_loss: 1.6521849632263184 commit_loss: 58.79313659667969 total_loss: 60.44532012939453 Number of batches produced: 1 0%| | 0/25 [00:05<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_165.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 167 step: 221 recon_loss: 1.8336591720581055 commit_loss: 56.49067306518555 total_loss: 58.32433319091797 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 168 step: 221 recon_loss: 1.3500536680221558 commit_loss: 52.66802215576172 total_loss: 54.01807403564453 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 169 step: 221 recon_loss: 1.3609206676483154 commit_loss: 50.05817413330078 total_loss: 51.41909408569336 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 170 step: 221 recon_loss: 1.359631896018982 commit_loss: 51.589942932128906 total_loss: 52.9495735168457 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 171 step: 221 recon_loss: 1.2657182216644287 commit_loss: 49.578277587890625 total_loss: 50.843994140625 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_170.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 172 step: 221 recon_loss: 1.6554521322250366 commit_loss: 54.384132385253906 total_loss: 56.03958511352539 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 173 step: 221 recon_loss: 1.2503632307052612 commit_loss: 53.148468017578125 total_loss: 54.39883041381836 100%|██████████| 221/221 [02:22<00:00, 1.55it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 174 step: 221 recon_loss: 1.3306386470794678 commit_loss: 53.34906005859375 total_loss: 54.6796989440918 100%|██████████| 221/221 [02:29<00:00, 1.48it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 175 step: 221 recon_loss: 1.2789583206176758 commit_loss: 46.16119384765625 total_loss: 47.44015121459961 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 176 step: 221 recon_loss: 1.5118262767791748 commit_loss: 49.27967071533203 total_loss: 50.79149627685547 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_175.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 177 step: 221 recon_loss: 1.6237983703613281 commit_loss: 48.079246520996094 total_loss: 49.70304489135742 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 178 step: 221 recon_loss: 1.1464626789093018 commit_loss: 46.25599670410156 total_loss: 47.40245819091797 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] epoch: 179 step: 221 recon_loss: 1.1376138925552368 commit_loss: 44.492034912109375 total_loss: 45.6296501159668 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 180 step: 221 recon_loss: 1.155386209487915 commit_loss: 42.717140197753906 total_loss: 43.872528076171875 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 181 step: 221 recon_loss: 1.1269793510437012 commit_loss: 42.57330322265625 total_loss: 43.70028305053711 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_180.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 182 step: 221 recon_loss: 1.2241175174713135 commit_loss: 51.67871856689453 total_loss: 52.902835845947266 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 183 step: 221 recon_loss: 1.2667896747589111 commit_loss: 54.57368469238281 total_loss: 55.84047317504883 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 184 step: 221 recon_loss: 1.100372552871704 commit_loss: 46.69953155517578 total_loss: 47.799903869628906 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 185 step: 221 recon_loss: 1.4650638103485107 commit_loss: 50.615116119384766 total_loss: 52.08018112182617 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 186 step: 221 recon_loss: 1.2092127799987793 commit_loss: 52.90454864501953 total_loss: 54.11376190185547 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_185.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 187 step: 221 recon_loss: 1.2275094985961914 commit_loss: 54.62236022949219 total_loss: 55.84986877441406 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 188 step: 221 recon_loss: 1.0251444578170776 commit_loss: 50.866363525390625 total_loss: 51.89150619506836 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 189 step: 221 recon_loss: 0.9900667071342468 commit_loss: 51.990150451660156 total_loss: 52.98021697998047 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 190 step: 221 recon_loss: 1.0001553297042847 commit_loss: 51.34892272949219 total_loss: 52.34907913208008 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 191 step: 221 recon_loss: 1.0482842922210693 commit_loss: 52.458187103271484 total_loss: 53.5064697265625 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_190.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 192 step: 221 recon_loss: 1.2043102979660034 commit_loss: 54.66578674316406 total_loss: 55.87009811401367 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 193 step: 221 recon_loss: 1.0569796562194824 commit_loss: 50.899932861328125 total_loss: 51.956912994384766 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 194 step: 221 recon_loss: 1.0702142715454102 commit_loss: 50.00929260253906 total_loss: 51.079505920410156 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 195 step: 221 recon_loss: 1.1090844869613647 commit_loss: 46.54139709472656 total_loss: 47.650482177734375 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 196 step: 221 recon_loss: 1.029755711555481 commit_loss: 52.517799377441406 total_loss: 53.54755401611328 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_195.pt 100%|██████████| 221/221 [02:27<00:00, 1.50it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 197 step: 221 recon_loss: 1.0135157108306885 commit_loss: 52.056884765625 total_loss: 53.07040023803711 100%|██████████| 221/221 [02:26<00:00, 1.51it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 198 step: 221 recon_loss: 1.1560354232788086 commit_loss: 46.59235382080078 total_loss: 47.748390197753906 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 199 step: 221 recon_loss: 1.0539891719818115 commit_loss: 50.527618408203125 total_loss: 51.581607818603516 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 200 step: 221 recon_loss: 1.085806965827942 commit_loss: 53.25920867919922 total_loss: 54.34501647949219 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] epoch: 201 step: 221 recon_loss: 0.9743901491165161 commit_loss: 56.05211639404297 total_loss: 57.02650833129883 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_200.pt 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 202 step: 221 recon_loss: 1.0753591060638428 commit_loss: 54.691768646240234 total_loss: 55.767127990722656 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 203 step: 221 recon_loss: 0.9188400506973267 commit_loss: 47.44488525390625 total_loss: 48.36372375488281 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 204 step: 221 recon_loss: 0.9337667226791382 commit_loss: 44.29165267944336 total_loss: 45.22541809082031 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 205 step: 221 recon_loss: 1.5409209728240967 commit_loss: 43.064002990722656 total_loss: 44.604923248291016 100%|██████████| 221/221 [02:19<00:00, 1.58it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 206 step: 221 recon_loss: 1.074371099472046 commit_loss: 50.437255859375 total_loss: 51.511627197265625 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_205.pt 100%|██████████| 221/221 [02:20<00:00, 1.58it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 207 step: 221 recon_loss: 1.0231822729110718 commit_loss: 47.8260498046875 total_loss: 48.8492317199707 100%|██████████| 221/221 [02:34<00:00, 1.43it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 208 step: 221 recon_loss: 0.9520225524902344 commit_loss: 42.31984329223633 total_loss: 43.27186584472656 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 209 step: 221 recon_loss: 0.9839930534362793 commit_loss: 38.342594146728516 total_loss: 39.32658767700195 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 210 step: 221 recon_loss: 1.1835922002792358 commit_loss: 43.984737396240234 total_loss: 45.168331146240234 100%|██████████| 221/221 [02:27<00:00, 1.50it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 211 step: 221 recon_loss: 0.8750216960906982 commit_loss: 44.27196502685547 total_loss: 45.14698791503906 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_210.pt 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 212 step: 221 recon_loss: 0.7887487411499023 commit_loss: 40.644527435302734 total_loss: 41.43327713012695 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 213 step: 221 recon_loss: 0.8612763285636902 commit_loss: 37.5689697265625 total_loss: 38.43024444580078 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 214 step: 221 recon_loss: 0.7194222211837769 commit_loss: 36.63418960571289 total_loss: 37.35361099243164 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 215 step: 221 recon_loss: 0.7186018228530884 commit_loss: 35.97868347167969 total_loss: 36.69728469848633 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 216 step: 221 recon_loss: 0.8442683219909668 commit_loss: 36.13011932373047 total_loss: 36.974388122558594 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_215.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 217 step: 221 recon_loss: 0.8059079051017761 commit_loss: 32.70220184326172 total_loss: 33.50811004638672 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 218 step: 221 recon_loss: 0.7831591367721558 commit_loss: 36.55278015136719 total_loss: 37.3359375 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 219 step: 221 recon_loss: 1.2106273174285889 commit_loss: 40.01156234741211 total_loss: 41.222190856933594 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 220 step: 221 recon_loss: 0.794655978679657 commit_loss: 34.052162170410156 total_loss: 34.84681701660156 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 221 step: 221 recon_loss: 0.7851588129997253 commit_loss: 31.19085121154785 total_loss: 31.976009368896484 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_220.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 222 step: 221 recon_loss: 0.8664145469665527 commit_loss: 32.50929641723633 total_loss: 33.375709533691406 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 223 step: 221 recon_loss: 0.8350212574005127 commit_loss: 34.599639892578125 total_loss: 35.434661865234375 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 224 step: 221 recon_loss: 0.7278189063072205 commit_loss: 32.089717864990234 total_loss: 32.817535400390625 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 225 step: 221 recon_loss: 1.1492365598678589 commit_loss: 29.32823944091797 total_loss: 30.477476119995117 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 226 step: 221 recon_loss: 0.7471196055412292 commit_loss: 29.732820510864258 total_loss: 30.47994041442871 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_225.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] epoch: 227 step: 221 recon_loss: 0.6993266940116882 commit_loss: 28.09672737121582 total_loss: 28.79605484008789 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 228 step: 221 recon_loss: 0.7656018733978271 commit_loss: 29.442554473876953 total_loss: 30.20815658569336 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 229 step: 221 recon_loss: 0.794885516166687 commit_loss: 28.850034713745117 total_loss: 29.644920349121094 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 230 step: 221 recon_loss: 0.7530979514122009 commit_loss: 27.4321231842041 total_loss: 28.18522071838379 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 231 step: 221 recon_loss: 0.7369588613510132 commit_loss: 26.548477172851562 total_loss: 27.285436630249023 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_230.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] epoch: 232 step: 221 recon_loss: 0.6937469244003296 commit_loss: 24.430564880371094 total_loss: 25.124311447143555 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 233 step: 221 recon_loss: 0.7439588904380798 commit_loss: 22.30066680908203 total_loss: 23.044626235961914 100%|██████████| 221/221 [02:25<00:00, 1.52it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 234 step: 221 recon_loss: 0.7598573565483093 commit_loss: 21.500812530517578 total_loss: 22.260669708251953 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] epoch: 235 step: 221 recon_loss: 0.6593058109283447 commit_loss: 21.34103012084961 total_loss: 22.000335693359375 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 236 step: 221 recon_loss: 0.7050111293792725 commit_loss: 28.510860443115234 total_loss: 29.215871810913086 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_235.pt 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 237 step: 221 recon_loss: 0.582314133644104 commit_loss: 26.320636749267578 total_loss: 26.902950286865234 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 238 step: 221 recon_loss: 0.8238841891288757 commit_loss: 22.543439865112305 total_loss: 23.367324829101562 100%|██████████| 221/221 [02:21<00:00, 1.56it/s] epoch: 239 step: 221 recon_loss: 0.6518595218658447 commit_loss: 22.611940383911133 total_loss: 23.2637996673584 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 240 step: 221 recon_loss: 0.5864635705947876 commit_loss: 23.606956481933594 total_loss: 24.19342041015625 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 241 step: 221 recon_loss: 0.621148943901062 commit_loss: 23.28528594970703 total_loss: 23.906435012817383 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] Saved checkpoint: ./VQ_VAE_results//model-epoch_240.pt 100%|██████████| 221/221 [02:21<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 242 step: 221 recon_loss: 0.5987226963043213 commit_loss: 24.684743881225586 total_loss: 25.283466339111328 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 243 step: 221 recon_loss: 0.5738091468811035 commit_loss: 20.942386627197266 total_loss: 21.51619529724121 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 244 step: 221 recon_loss: 0.5820895433425903 commit_loss: 18.9312686920166 total_loss: 19.51335906982422 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 245 step: 221 recon_loss: 0.6244820356369019 commit_loss: 19.664411544799805 total_loss: 20.28889274597168 100%|██████████| 221/221 [02:20<00:00, 1.57it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 246 step: 221 recon_loss: 0.5959687232971191 commit_loss: 20.664560317993164 total_loss: 21.260528564453125 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_245.pt 100%|██████████| 221/221 [02:43<00:00, 1.35it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 247 step: 221 recon_loss: 0.7851685285568237 commit_loss: 28.703964233398438 total_loss: 29.489131927490234 100%|██████████| 221/221 [02:36<00:00, 1.41it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 248 step: 221 recon_loss: 0.56072598695755 commit_loss: 24.392894744873047 total_loss: 24.95362091064453 100%|██████████| 221/221 [02:38<00:00, 1.40it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 249 step: 221 recon_loss: 0.5223097801208496 commit_loss: 18.87862777709961 total_loss: 19.400938034057617 100%|██████████| 221/221 [02:37<00:00, 1.40it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 250 step: 221 recon_loss: 0.7561354637145996 commit_loss: 18.16187286376953 total_loss: 18.91800880432129 100%|██████████| 221/221 [02:36<00:00, 1.41it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 251 step: 221 recon_loss: 0.6326600313186646 commit_loss: 16.76565170288086 total_loss: 17.398311614990234 Number of batches produced: 1 0%| | 0/25 [00:05<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_250.pt 100%|██████████| 221/221 [02:36<00:00, 1.41it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 252 step: 221 recon_loss: 0.6668918132781982 commit_loss: 15.437212944030762 total_loss: 16.10410499572754 100%|██████████| 221/221 [02:37<00:00, 1.41it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 253 step: 221 recon_loss: 0.5775245428085327 commit_loss: 18.15323829650879 total_loss: 18.730762481689453 100%|██████████| 221/221 [02:42<00:00, 1.36it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 254 step: 221 recon_loss: 0.4916980266571045 commit_loss: 14.936182022094727 total_loss: 15.42788028717041 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 255 step: 221 recon_loss: 1.6549937725067139 commit_loss: 15.780750274658203 total_loss: 17.43574333190918 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] 0%| | 0/25 [00:00<?, ?it/s]epoch: 256 step: 221 recon_loss: 0.6323659420013428 commit_loss: 26.041549682617188 total_loss: 26.67391586303711 Number of batches produced: 1 0%| | 0/25 [00:04<?, ?it/s] 0%| | 0/221 [00:00<?, ?it/s]Saved checkpoint: ./VQ_VAE_results//model-epoch_255.pt 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 257 step: 221 recon_loss: 0.4772830009460449 commit_loss: 22.78434944152832 total_loss: 23.261632919311523 100%|██████████| 221/221 [02:35<00:00, 1.42it/s] 0%| | 0/221 [00:00<?, ?it/s]epoch: 258 step: 221 recon_loss: 0.5150290727615356 commit_loss: 18.481592178344727 total_loss: 18.99662208557129 `