fancier and more flexible (self adapting to loss_dict) console logging. Fixing multi-gpu loss reduce

2026-09-09 11:16:00 +08:00 · 2020-04-23 14:14:09 +02:00
parent 668a695763
commit 0e7ecca33f
5 changed files with 179 additions and 78 deletions
@@ -103,6 +103,7 @@

    // TENSORBOARD and LOGGING
    "print_step": 25,       // Number of steps to log traning on console.
+    "print_eval": false,     // If True, it prints loss values in evalulation. 
    "save_step": 10000,      // Number of training steps expected to save traninpg stats and checkpoints.
    "checkpoint": true,     // If true, it saves checkpoints per "save_step"
    "tb_model_param_stats": false,     // true, plots param stats per layer on tensorboard. Might be memory consuming, but good for debugging.