oneflow icon indicating copy to clipboard operation
oneflow copied to clipboard

Stack in graph building

Open CPFLAME opened this issue 3 years ago • 1 comments

graph building stack here

I20221201 10:32:37.597100 2644176 straighten_nodes.cpp:493] Straightening order: 
I20221201 10:32:37.597177 2644176 straighten_nodes.cpp:494] 3
I20221201 10:32:37.597187 2644176 straighten_nodes.cpp:494] 0
I20221201 10:32:37.816900 2644176 time_util.h:97] [count log]{"loc":"[GraphCompile]GraphBase_0 BuildTaskGraph","mem_rss":"9391.000000 MB","mem_vm":"35491.000000 MB","time_cost":"2 seconds"}
I20221201 10:32:38.914080 2644176 time_util.h:97] [count log]{"loc":"[GraphCompile]GraphBase_0 AddTaskToPlan","mem_rss":"9550.000000 MB","mem_vm":"40100.000000 MB","time_cost":"1 seconds"}
I20221201 10:32:39.074615 2644176 memory_share_strategy.cpp:429] Current memory size: 5157847552, lower bound : 5050683904
I20221201 10:32:39.074734 2644176 memory_share_strategy.cpp:431] max iteration step: 2

CPFLAME avatar Dec 01 '22 10:12 CPFLAME

训练的机器上用 gdb 没有看到有效的 stack。需要放到开发机上,加日志看看。

strint avatar Dec 01 '22 11:12 strint

Moved into https://github.com/Oneflow-Inc/oneflow/issues/9508

strint avatar Dec 03 '22 01:12 strint