oneflow
oneflow copied to clipboard
Stack in graph building
graph building stack here
I20221201 10:32:37.597100 2644176 straighten_nodes.cpp:493] Straightening order:
I20221201 10:32:37.597177 2644176 straighten_nodes.cpp:494] 3
I20221201 10:32:37.597187 2644176 straighten_nodes.cpp:494] 0
I20221201 10:32:37.816900 2644176 time_util.h:97] [count log]{"loc":"[GraphCompile]GraphBase_0 BuildTaskGraph","mem_rss":"9391.000000 MB","mem_vm":"35491.000000 MB","time_cost":"2 seconds"}
I20221201 10:32:38.914080 2644176 time_util.h:97] [count log]{"loc":"[GraphCompile]GraphBase_0 AddTaskToPlan","mem_rss":"9550.000000 MB","mem_vm":"40100.000000 MB","time_cost":"1 seconds"}
I20221201 10:32:39.074615 2644176 memory_share_strategy.cpp:429] Current memory size: 5157847552, lower bound : 5050683904
I20221201 10:32:39.074734 2644176 memory_share_strategy.cpp:431] max iteration step: 2
训练的机器上用 gdb 没有看到有效的 stack。需要放到开发机上,加日志看看。
Moved into https://github.com/Oneflow-Inc/oneflow/issues/9508