GraphScope
GraphScope copied to clipboard
Published
20 hours ago •
alibaba
alibaba
[BUG] Failed to compile app grape while running build-in graph algorithms on Linux
Describe the bug Similar to issue #1753, GraphScope failed to compile app grape while running build-in graph algorithms.
To Reproduce
import graphscope
graphscope.set_option(show_log=True)
test_edges_path = "/tmp/test.csv"
sess = graphscope.get_default_session()
# using string type to force GraphScope compiling c++ libs.
g = sess.g(oid_type="string")
g = g.add_edges(test_edges_path)
context = graphscope.wcc(g)
context.to_dataframe(selector={'id': 'v.id', 'wcc': 'r'}, vertex_range={'begin': 1, 'end': 10}).sort_values(by='id', ascending=False)
- test.csv (simply 2 edges) src,dst 1,2 1,3
Expected behavior Output the result of wcc. All the nodes are in the same component.
id wcc
2 3 1
1 2 1
0 1 1
Screenshots
I0627 18:02:30.000000 58314 /work/analytical_engine/core/grape_instance.cc:1064] Registering Graph, graph type: ARROW_PROPERTY, Type sigature: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae, lib path: /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/precompiled/builtin/7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae/lib7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae.so
I0627 18:02:30.000000 58314 /work/analytical_engine/core/grape_instance.cc:127] Loading graph, graph name: graph_a37JncCH, graph type: ArrowFragment, type sig: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae
Loading empty graph: 0%| | 0/10 [00:00<?, ?it/s]
Loading empty graph: 100%|██████████| 10/10 [00:00<00:00, 764.20it/s]
>>> g = g.add_edges(test_edges_path)
2022-06-27 18:02:31,925 [WARNING][graph:498]: Deducing vertex labels _
Loading edge labeled _: 0%| | 0/10 [00:00<?, ?it/s]
Loading edge labeled _: 100%|██████████| 10/10 [00:00<00:00, 171.26it/s]
>>> context = graphscope.wcc(g)
2022-06-27 18:02:36,911 [INFO][utils:408]: Codegened graph frame type: gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t>
2022-06-27 18:02:36,912 [INFO][utils:426]: enable java sdk OFF
2022-06-27 18:02:36,912 [INFO][utils:451]: Building graph library ...
E0627 18:02:36.913291650 58550 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/client/ds/object_meta.h:33:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/client/client_base.h:27,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/client/client.h:30,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/arrow.vineyard.h:33,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/arrow.h:29,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:36,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:20:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/uuid.h: In function auto vineyard::static_if(T):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/uuid.h:81:67: error: parameter declared auto
return static_if(std::integral_constant<bool, B>{}, t, [](auto&&...) {});
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/property_graph_utils.h:40:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:43,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:20:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/error.h: In lambda function:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/error.h:191:33: error: parameter packs not expanded with ...:
auto&& r = f_wrapper(f, args...);
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/error.h:191:33: note: args
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/error.h:191:37: error: expansion pattern args contains no argument packs
auto&& r = f_wrapper(f, args...);
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:46:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:20:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/thread_group.h: In member function vineyard::ThreadGroup::tid_t vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/thread_group.h:54:42: error: expansion pattern auto&& contains no argument packs
auto&&... _args) -> return_t {
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/thread_group.h: In lambda function:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/utils/thread_group.h:58:47: error: _args was not declared in this scope
v = std::move(_f(std::forward<ARGS_T>(_args)...));
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:34:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:31,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:36,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/trait_utils.h: In function auto gs::static_if(T):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/trait_utils.h:42:67: error: parameter declared auto
return static_if(std::integral_constant<bool, B>{}, t, [](auto&&...) {});
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:31:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:36,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h: In function std::shared_ptr<vineyard::TensorBuilder<DATA_T> > gs::column_to_vy_tensor_builder_impl(vineyard::Client&, const std::shared_ptr<gs::IColumn>&, const std::vector<typename FRAG_T::vertex_t>&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:405:7: error: make_unique is not a member of std
std::make_unique<vineyard::TensorBuilder<DATA_T>>(client, shape);
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:405:54: error: expected primary-expression before > token
std::make_unique<vineyard::TensorBuilder<DATA_T>>(client, shape);
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h: In member function boost::leaf::result<void> gs::TransformUtils<FRAG_T, typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type>::SerializeVertexLabelId(const std::vector<typename FRAG_T::vertex_t>&, grape::InArchive&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:829:21: error: parameter declared auto
[&](auto& frag, auto& v, auto& label_id) {
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:829:33: error: parameter declared auto
[&](auto& frag, auto& v, auto& label_id) {
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:829:42: error: parameter declared auto
[&](auto& frag, auto& v, auto& label_id) {
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h: In lambda function:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:830:24: error: frag was not declared in this scope
label_id = frag.vertex_label(v);
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:36:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::LabeledVertexPropertyContextWrapper<FRAG_T>::ToNdArray(const grape::CommSpec&, const gs::LabeledSelector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:210:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:210:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:210:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::LabeledVertexPropertyContextWrapper<FRAG_T>::ToDataframe(const grape::CommSpec&, const std::vector<std::pair<std::basic_string<char>, gs::LabeledSelector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:294:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:294:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:294:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:37:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToNdArray(const grape::CommSpec&, const gs::Selector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:208:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:208:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:208:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToDataframe(const grape::CommSpec&, const std::vector<std::pair<std::basic_string<char>, gs::Selector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:283:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:283:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:283:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::LabeledVertexDataContextWrapper<FRAG_T, DATA_T>::ToNdArray(const grape::CommSpec&, const gs::LabeledSelector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:655:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:655:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:655:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::LabeledVertexDataContextWrapper<FRAG_T, DATA_T>::ToDataframe(const grape::CommSpec&, const std::vector<std::pair<std::basic_string<char>, gs::LabeledSelector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:720:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:720:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:720:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:38:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::VertexPropertyContextWrapper<FRAG_T>::ToNdArray(const grape::CommSpec&, const gs::Selector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:172:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:172:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:172:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::VertexPropertyContextWrapper<FRAG_T>::ToDataframe(const grape::CommSpec&, const std::vector<std::pair<std::basic_string<char>, gs::Selector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:242:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:242:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_property_context.h:242:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:25:0:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::FragmentWrapper<vineyard::ArrowFragment<OID_T, VID_T> >::ToNdArray(const grape::CommSpec&, const gs::LabeledSelector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:515:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:515:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:515:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h: In member function boost::leaf::result<std::unique_ptr<grape::InArchive> > gs::FragmentWrapper<vineyard::ArrowFragment<OID_T, VID_T> >::ToDataframe(const grape::CommSpec&, const std::vector<std::pair<std::basic_string<char>, gs::LabeledSelector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&):
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:579:16: error: make_unique is not a member of std
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:579:49: error: expected primary-expression before > token
auto arc = std::make_unique<grape::InArchive>();
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/object/fragment_wrapper.h:579:51: error: expected primary-expression before ) token
auto arc = std::make_unique<grape::InArchive>();
^
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/dynamic_fragment.h:31:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:23:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/csr_edgecut_fragment_base.h: In instantiation of grape::CSREdgecutFragmentBase<OID_T, VID_T, VDATA_T, EDATA_T, TRAITS_T>::CSREdgecutFragmentBase() [with OID_T = gs::dynamic::Value; VID_T = long unsigned int; VDATA_T = gs::dynamic::Value; EDATA_T = gs::dynamic::Value; TRAITS_T = gs::DynamicFragmentTraits]:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/dynamic_fragment.h:114:77: required from here
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/csr_edgecut_fragment_base.h:42:28: error: no matching function for call to grape::FragmentBase<gs::dynamic::Value, long unsigned int, gs::dynamic::Value, gs::dynamic::Value, gs::DynamicFragmentTraits>::FragmentBase()
CSREdgecutFragmentBase() {}
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/csr_edgecut_fragment_base.h:42:28: note: candidates are:
In file included from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:32:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:20:
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:60:12: note: grape::FragmentBase<OID_T, VID_T, VDATA_T, EDATA_T, TRAITS_T>::FragmentBase(std::shared_ptr<typename TRAITS_T::vertex_map_t>) [with OID_T = gs::dynamic::Value; VID_T = long unsigned int; VDATA_T = gs::dynamic::Value; EDATA_T = gs::dynamic::Value; TRAITS_T = gs::DynamicFragmentTraits; typename TRAITS_T::vertex_map_t = grape::GlobalVertexMap<gs::dynamic::Value, long unsigned int>]
explicit FragmentBase(std::shared_ptr<vertex_map_t> vm_ptr)
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:60:12: note: candidate expects 1 argument, 0 provided
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:52:7: note: grape::FragmentBase<gs::dynamic::Value, long unsigned int, gs::dynamic::Value, gs::dynamic::Value, gs::DynamicFragmentTraits>::FragmentBase(const grape::FragmentBase<gs::dynamic::Value, long unsigned int, gs::dynamic::Value, gs::dynamic::Value, gs::DynamicFragmentTraits>&)
class FragmentBase {
^
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:52:7: note: candidate expects 1 argument, 0 provided
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:52:7: note: grape::FragmentBase<gs::dynamic::Value, long unsigned int, gs::dynamic::Value, gs::dynamic::Value, gs::DynamicFragmentTraits>::FragmentBase(grape::FragmentBase<gs::dynamic::Value, long unsigned int, gs::dynamic::Value, gs::dynamic::Value, gs::DynamicFragmentTraits>&&)
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/grape/fragment/fragment_base.h:52:7: note: candidate expects 1 argument, 0 provided
In file included from /usr/include/c++/4.8.2/memory:79:0,
from /tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:16:
/usr/include/c++/4.8.2/functional: In instantiation of struct std::_Bind_simple<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186, long unsigned int, long unsigned int)> >()>:
/usr/include/c++/4.8.2/future:1284:55: required from void std::__future_base::_Task_state<_Fn, _Alloc, _Res(_Args ...)>::_M_run(_Args ...) [with _Fn = std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186, long unsigned int, long unsigned int)>; _Alloc = std::allocator<int>; _Res = vineyard::Status; _Args = {}]
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:239:1: required from here
/usr/include/c++/4.8.2/functional:1697:61: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186, long unsigned int, long unsigned int)> >()>
typedef typename result_of<_Callable(_Args...)>::type result_type;
^
/usr/include/c++/4.8.2/functional:1727:9: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherVTables(vineyard::Client&, const std::vector<long unsigned int>&, int, int)::__lambda186, long unsigned int, long unsigned int)> >()>
_M_invoke(_Index_tuple<_Indices...>)
^
/usr/include/c++/4.8.2/functional: In instantiation of struct std::_Bind_simple<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185, long unsigned int, long unsigned int)> >()>:
/usr/include/c++/4.8.2/future:1284:55: required from void std::__future_base::_Task_state<_Fn, _Alloc, _Res(_Args ...)>::_M_run(_Args ...) [with _Fn = std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185, long unsigned int, long unsigned int)>; _Alloc = std::allocator<int>; _Res = vineyard::Status; _Args = {}]
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:239:1: required from here
/usr/include/c++/4.8.2/functional:1697:61: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185, long unsigned int, long unsigned int)> >()>
typedef typename result_of<_Callable(_Args...)>::type result_type;
^
/usr/include/c++/4.8.2/functional:1727:9: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185&; ARGS_T = {long unsigned int&, const long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::GatherETables(vineyard::Client&, const std::vector<std::vector<long unsigned int>, std::allocator<std::vector<long unsigned int> > >&, int, int)::__lambda185, long unsigned int, long unsigned int)> >()>
_M_invoke(_Index_tuple<_Indices...>)
^
/usr/include/c++/4.8.2/functional: In instantiation of struct std::_Bind_simple<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184&; ARGS_T = {int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184, int)> >()>:
/usr/include/c++/4.8.2/future:1284:55: required from void std::__future_base::_Task_state<_Fn, _Alloc, _Res(_Args ...)>::_M_run(_Args ...) [with _Fn = std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184&; ARGS_T = {int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184, int)>; _Alloc = std::allocator<int>; _Res = vineyard::Status; _Args = {}]
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:239:1: required from here
/usr/include/c++/4.8.2/functional:1697:61: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184&; ARGS_T = {int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184, int)> >()>
typedef typename result_of<_Callable(_Args...)>::type result_type;
^
/usr/include/c++/4.8.2/functional:1727:9: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184&; ARGS_T = {int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadTableFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::shared_ptr<arrow::Table>&, int, int)::__lambda184, int)> >()>
_M_invoke(_Index_tuple<_Indices...>)
^
/usr/include/c++/4.8.2/functional: In instantiation of struct std::_Bind_simple<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183&; ARGS_T = {long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183, long unsigned int)> >()>:
/usr/include/c++/4.8.2/future:1284:55: required from void std::__future_base::_Task_state<_Fn, _Alloc, _Res(_Args ...)>::_M_run(_Args ...) [with _Fn = std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183&; ARGS_T = {long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183, long unsigned int)>; _Alloc = std::allocator<int>; _Res = vineyard::Status; _Args = {}]
/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc:239:1: required from here
/usr/include/c++/4.8.2/functional:1697:61: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183&; ARGS_T = {long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183, long unsigned int)> >()>
typedef typename result_of<_Callable(_Args...)>::type result_type;
^
/usr/include/c++/4.8.2/functional:1727:9: error: no type named type in class std::result_of<std::reference_wrapper<std::_Bind<vineyard::ThreadGroup::AddTask(F_T&&, ARGS_T&& ...) [with F_T = vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183&; ARGS_T = {long unsigned int&}; vineyard::ThreadGroup::tid_t = unsigned int]::__lambda77(unsigned int, vineyard::ReadRecordBatchesFromVineyardStream(vineyard::Client&, std::shared_ptr<vineyard::ParallelStream>&, std::vector<std::shared_ptr<arrow::RecordBatch> >&, int, int)::__lambda183, long unsigned int)> >()>
_M_invoke(_Index_tuple<_Indices...>)
^
At global scope:
cc1plus: warning: unrecognized command line option "-Wno-redundant-move" [enabled by default]
cc1plus: warning: unrecognized command line option "-Wno-stringop-overflow" [enabled by default]
cc1plus: warning: unrecognized command line option "-Wno-unused-lambda-capture" [enabled by default]
cc1plus: warning: unrecognized command line option "-Wno-undef-prefix" [enabled by default]
cc1plus: warning: unrecognized command line option "-Wno-class-memaccess" [enabled by default]
make[2]: *** [CMakeFiles/e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9.dir/tmp/myvenv/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/project_frame.cc.o] Error 1
make[1]: *** [CMakeFiles/e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9.dir/all] Error 2
make: *** [all] Error 2
E0627 18:02:54.853312427 58550 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
2022-06-27 18:02:54,863 [ERROR][rpc:188]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during preprocessing, The traceback is: Traceback (most recent call last):
File "/tmp/myvenv/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 618, in _RunStep
head, bodies = self.run_on_analytical_engine(
File "/tmp/myvenv/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 417, in run_on_analytical_engine
op = self._maybe_register_graph(op, self._session_id)
File "/tmp/myvenv/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 701, in _maybe_register_graph
compiled_path = self._compile_lib_and_distribute(
File "/tmp/myvenv/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 1250, in _compile_lib_and_distribute
app_lib_path, java_jar_path, java_ffi_path, app_type = compile_func(
File "/tmp/myvenv/lib/python3.8/site-packages/gscoordinator/utils.py", line 481, in compile_graph_frame
raise CompilationError(
graphscope.framework.errors.CompilationError: Failed to compile graph gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t> on platform system: Linux
machine: x86_64
platform: Linux-3.10.0-1160.59.1.el7.x86_64-x86_64-with-glibc2.2.5
uname: uname_result(system='Linux', release='3.10.0-1160.59.1.el7.x86_64', version='#1 SMP Wed Feb 23 16:47:03 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #1 SMP Wed Feb 23 16:47:03 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44)\nCopyright (C) 2015 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.11
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/framework/app.py", line 73, in wrapper
graph = graph._project_to_simple()
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/framework/graph.py", line 886, in _project_to_simple
return self._session._wrapper(
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/client/session.py", line 936, in _wrapper
return self.run(dag_node)
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/client/session.py", line 964, in run
response = self._grpc_client.run(fetch_handler.targets)
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/client/rpc.py", line 102, in run
return self._run_step_impl(runstep_requests)
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/client/utils.py", line 155, in with_grpc_catch
return fn(*args, **kwargs)
File "/tmp/myvenv/current/lib64/python3.8/site-packages/graphscope/client/rpc.py", line 194, in _run_step_impl
raise pickle.loads(response.full_exception)
graphscope.framework.errors.CompilationError: Failed to compile graph gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t> on platform system: Linux
machine: x86_64
platform: Linux-3.10.0-1160.59.1.el7.x86_64-x86_64-with-glibc2.2.5
uname: uname_result(system='Linux', release='3.10.0-1160.59.1.el7.x86_64', version='#1 SMP Wed Feb 23 16:47:03 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #1 SMP Wed Feb 23 16:47:03 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44)\nCopyright (C) 2015 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.11
>>>
Environment (please complete the following information):
- GraphScope version: [v0.12.0]
- OS: [Linox]
- Version [Linux-3.10.0-1160.59.1.el7.x86_64-x86_64-with-glibc2.2.5]
@parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
@parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
Thanks Lidong! Could you let us know what are the GCC version in your setup? We also can reproduce that to see if the problem resolved.
@parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
Thanks Lidong! Could you let us know what are the GCC version in your setup? We also can reproduce that to see if the problem resolved.
gcc 7.1+
Hey lidong, thanks for the inspection. However, we get some other compiling error even using GCC 11.2.0. I will share it later in the comment.
2022-07-06 14:59:38,718 [INFO][session:1479]: Creating default session ...
2022-07-06 14:59:38,719 [INFO][session:682]: Initializing graphscope session with parameters: {'addr': None, 'mode': 'eager', 'cluster_type': 'hosts', 'num_workers': 1, 'preemptive': True, 'k8s_namespace': None, 'k8s_service_type': 'NodePort', 'k8s_gs_image': 'registry.cn-hongkong.aliyuncs.com/graphscope/graphscope:0.14.0', 'k8s_etcd_image': 'quay.io/coreos/etcd:v3.4.13', 'k8s_image_pull_policy': 'IfNotPresent', 'k8s_image_pull_secrets': [], 'k8s_coordinator_cpu': 1.5, 'k8s_coordinator_mem': '2Gi', 'etcd_addrs': None, 'k8s_etcd_num_pods': 1, 'k8s_etcd_cpu': 1.0, 'k8s_etcd_mem': '512Mi', 'k8s_vineyard_daemonset': 'none', 'k8s_vineyard_cpu': 0.2, 'k8s_vineyard_mem': '512Mi', 'vineyard_shared_mem': '4Gi', 'k8s_engine_cpu': 0.2, 'k8s_engine_mem': '1Gi', 'k8s_mars_worker_cpu': 0.2, 'k8s_mars_worker_mem': '4Mi', 'k8s_mars_scheduler_cpu': 0.2, 'k8s_mars_scheduler_mem': '2Mi', 'with_mars': False, 'reconnect': False, 'k8s_volumes': {}, 'k8s_waiting_for_delete': False, 'timeout_seconds': 600, 'dangling_timeout_seconds': 600, 'mount_dataset': None, 'k8s_dataset_image': 'registry.cn-hongkong.aliyuncs.com/graphscope/dataset:0.14.0', 'hosts': ['localhost'], 'port': None, 'vineyard_socket': '', 'k8s_client_config': {}}
2022-07-06 14:59:38,723 [INFO][cluster:119]: Initializing coordinator with command: /home/ubuntu/venvs/graphscope_test/bin/python3.8 -m gscoordinator --num_workers 1 --hosts localhost --log_level INFO --timeout_seconds 600 --port 45846 --cluster_type hosts --instance_id mbxgob --vineyard_shared_mem 4Gi
2022-07-06 14:59:38,732 [INFO][cluster:183]: Coordinator service started successful, connecting to service...
2022-07-06 14:59:39,698 [INFO][launcher:364]: Launch etcd with command: /home/ubuntu/venvs/graphscope_test/bin/etcd --data-dir /tmp/gs/mbxgob --listen-peer-urls http://0.0.0.0:2380 --listen-client-urls http://0.0.0.0:61039 --advertise-client-urls http://127.0.0.1:61039 --initial-cluster default=http://127.0.0.1:2380 --initial-advertise-peer-urls http://127.0.0.1:2380
2022-07-06 14:59:39,703 [INFO][launcher:380]: Server is initializing etcd.
2022-07-06 14:59:40,716 [INFO][launcher:392]: Etcd is ready, endpoint is localhost:61039
2022-07-06 14:59:40,722 [INFO][launcher:466]: Launch vineyardd with command: /home/ubuntu/venvs/graphscope_test/bin/python3.8 -m vineyard --socket /tmp/vineyard.sock.1657119580.716646 --rpc_socket_port 9600 --size 4Gi -etcd_endpoint http://127.0.0.1:61039 -etcd_prefix vineyard.gsa.1657119580.716646
2022-07-06 14:59:40,727 [INFO][launcher:482]: Server is initializing vineyardd.
2022-07-06 14:59:41,729 [INFO][launcher:501]: Vineyardd is ready, ipc socket is /tmp/vineyard.sock.1657119580.716646
2022-07-06 14:59:41,747 [INFO][launcher:541]: Launch analytical engine with command: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/bin/grape_engine --host 0.0.0.0 --port 51021 --vineyard_shared_mem 4Gi -v 1 --vineyard_socket /tmp/vineyard.sock.1657119580.716646
2022-07-06 14:59:41,752 [INFO][launcher:557]: Server is initializing analytical engine.
I0706 14:59:41.000000 34021 /work/analytical_engine/core/grape_instance.cc:86] Workers of grape-engine initialized.
I0706 14:59:41.000000 34030 /work/analytical_engine/core/server/analytical_server.cc:43] Analytical server is listening on 0.0.0.0:51021
2022-07-06 14:59:42,769 [INFO][launcher:574]: Analytical engine is ready, endpoint is localhost:51021
2022-07-06 14:59:42,783 [INFO][launcher:424]: Server is initializing zetcd.
2022-07-06 14:59:42,794 [INFO][launcher:435]: ZEtcd is ready, endpoint is localhost:2181
2022-07-06 14:59:42,801 [INFO][coordinator:197]: Java initial class path set to: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/grape-runtime-0.1-shaded.jar
2022-07-06 14:59:42,811 [INFO][coordinator:1742]: Coordinator server listen at 0.0.0.0:45846
2022-07-06 14:59:48,789 [INFO][rpc:69]: GraphScope coordinator service connected.
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:1178] Registering Graph, graph type: ARROW_PROPERTY, Type sigature: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae, lib path: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/precompiled/builtin/7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae/lib7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae.so
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:143] Loading graph, graph name: graph_a37JncCH, graph type: ArrowFragment, type sig: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae
Loading empty graph: 0%| | 0/10 [00:00<?, ?it/s]
Loading empty graph: 100%|██████████| 10/10 [00:00<00:00, 391.63it/s]
2022-07-06 14:59:54,124 [WARNING][graph:505]: Deducing vertex labels _
Loading edge labeled _: 0%| | 0/10 [00:00<?, ?it/s]
Loading edge labeled _: 100%|██████████| 10/10 [00:00<00:00, 232.84it/s]
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:196] Unloading Graph graph_a37JncCH
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:1178] Registering Graph, graph type: ARROW_PROJECTED, Type sigature: e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9, lib path: /tmp/gs/builtin/e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9/libe1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9.so
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:246] Projecting graph graph_ryDsbzay to simple graph: graph_projected_y4cBWDxS, type sig: e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9
2022-07-06 14:59:54,238 [INFO][utils:191]: Codegened graph type: gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t>, Graph header: core/fragment/arrow_projected_fragment.h
2022-07-06 14:59:54,263 [INFO][utils:253]: Codegened application type: cpp_pie, app header: wcc/wcc_auto.h, app_class: grape::WCCAuto<_GRAPH_TYPE>, vd_type: None, md_type: None, pregel_combine: None, java_jar_path: None, java_app_class: None
2022-07-06 14:59:54,263 [INFO][utils:267]: Codegened graph type: gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t>, Graph header: core/fragment/arrow_projected_fragment.h
2022-07-06 14:59:54,264 [INFO][utils:357]: Building app ...
CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/arrow/Findre2Alt.cmake:25 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.
Could not find a package configuration file provided by "re2" with any of
the following names:
re2Config.cmake
re2-config.cmake
Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/cmake/data/share/cmake-3.22/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/arrow/ArrowConfig.cmake:97 (find_dependency)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:213 (include)
CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/arrow/Findc-aresAlt.cmake:25 (find_package):
By not providing "Findc-ares.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "c-ares", but
CMake did not find one.
Could not find a package configuration file provided by "c-ares" with any
of the following names:
c-aresConfig.cmake
c-ares-config.cmake
Add the installation prefix of "c-ares" to CMAKE_PREFIX_PATH or set
"c-ares_DIR" to a directory containing one of the above files. If "c-ares"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/cmake/data/share/cmake-3.22/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/arrow/ArrowConfig.cmake:97 (find_dependency)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:213 (include)
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/assert.hpp:35,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept_check.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/concepts.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size_type.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size.hpp:21,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/functions.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range_core.hpp:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range.hpp:13,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/as_literal.hpp:22,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/trim.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp: In instantiation of ‘static void boost::concepts::constraint<Model>::failed() [with Model = boost::algorithm::FinderConcept<boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>, __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > >]’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/find_format.hpp:99:13: required from ‘void boost::algorithm::find_format(SequenceT&, FinderT, FormatterT) [with SequenceT = std::basic_string<char>; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/replace.hpp:179:44: required from ‘void boost::algorithm::replace_first(SequenceT&, const Range1T&, const Range2T&) [with SequenceT = std::basic_string<char>; Range1T = std::basic_string<char>; Range2T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/functions.h:40:27: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp:47:52: warning: ‘this’ pointer is null [-Wnonnull]
47 | static void failed() { ((Model*)0)->constraints(); }
| ~~~~~~~~~~~~~~~~~~~~~~~~^~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/iter_find.hpp:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/split.hpp:16,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:23,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/concept.hpp:40:18: note: in a call to non-static member function ‘void boost::algorithm::FinderConcept<FinderT, IteratorT>::constraints() [with FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; IteratorT = __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >]’
40 | void constraints()
| ^~~~~~~~~~~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/assert.hpp:35,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept_check.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/concepts.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size_type.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size.hpp:21,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/functions.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range_core.hpp:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range.hpp:13,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/as_literal.hpp:22,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/trim.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp: In instantiation of ‘static void boost::concepts::constraint<Model>::failed() [with Model = boost::algorithm::FormatterConcept<boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >, boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>, __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > >]’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/find_format.hpp:104:13: required from ‘void boost::algorithm::find_format(SequenceT&, FinderT, FormatterT) [with SequenceT = std::basic_string<char>; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/replace.hpp:179:44: required from ‘void boost::algorithm::replace_first(SequenceT&, const Range1T&, const Range2T&) [with SequenceT = std::basic_string<char>; Range1T = std::basic_string<char>; Range2T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/functions.h:40:27: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp:47:52: warning: ‘this’ pointer is null [-Wnonnull]
47 | static void failed() { ((Model*)0)->constraints(); }
| ~~~~~~~~~~~~~~~~~~~~~~~~^~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/iter_find.hpp:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/split.hpp:16,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:23,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/concept.hpp:65:18: note: in a call to non-static member function ‘void boost::algorithm::FormatterConcept<FormatterT, FinderT, IteratorT>::constraints() [with FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; IteratorT = __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >]’
65 | void constraints()
| ^~~~~~~~~~~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/dataframe.vineyard.h:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/dataframe.h:32,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/tensor_dataframe_builder.h:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:33,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/ctx_wrapper_builder.h:31,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:34:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h: In instantiation of ‘class vineyard::TensorBaseBuilder<nonstd::sv_lite::basic_string_view<char> >’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:53:7: required from ‘class vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:352:26: required from ‘typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<long unsigned int> >::type gs::build_vy_tensor(vineyard::Client&, size_t, FUNC_T&&, int64_t) [with FUNC_T = gs::TransformUtils<gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>, void>::VertexDataToVYTensor(vineyard::Client&, const std::vector<grape::Vertex<long unsigned int>, std::allocator<grape::Vertex<long unsigned int> > >&)::<lambda(size_t)>&; typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<long unsigned int> >::type = boost::leaf::result<long unsigned int>; typename std::result_of<FUNC_T(long unsigned int)>::type = nonstd::sv_lite::basic_string_view<char>; size_t = long unsigned int; int64_t = long int]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:877:27: required from ‘boost::leaf::result<long unsigned int> gs::TransformUtils<FRAG_T, typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type>::VertexDataToVYTensor(vineyard::Client&, const std::vector<typename FRAG_T::vertex_t>&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type = void; typename FRAG_T::vertex_t = grape::Vertex<long unsigned int>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:393:7: required from ‘boost::leaf::result<long unsigned int> gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToVineyardTensor(const grape::CommSpec&, vineyard::Client&, const gs::Selector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; DATA_T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:370:34: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:190:11: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
190 | using ArrowTensorT =
| ^~~~~~~~~~~~
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h: In instantiation of ‘class vineyard::Tensor<nonstd::sv_lite::basic_string_view<char> >’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:62:36: required from ‘vineyard::TensorBuilder<T>::TensorBuilder(vineyard::Client&, const std::vector<long int>&) [with T = nonstd::sv_lite::basic_string_view<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:80:36: required from ‘vineyard::TensorBuilder<T>::TensorBuilder(vineyard::Client&, const std::vector<long int>&, const std::vector<long int>&) [with T = nonstd::sv_lite::basic_string_view<char>]’
/usr/include/c++/11/ext/new_allocator.h:162:4: required from ‘void __gnu_cxx::new_allocator<_Tp>::construct(_Up*, _Args&& ...) [with _Up = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >]’
/usr/include/c++/11/bits/alloc_traits.h:516:17: required from ‘static void std::allocator_traits<std::allocator<_Tp1> >::construct(std::allocator_traits<std::allocator<_Tp1> >::allocator_type&, _Up*, _Args&& ...) [with _Up = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; std::allocator_traits<std::allocator<_Tp1> >::allocator_type = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >]’
/usr/include/c++/11/bits/shared_ptr_base.h:519:39: required from ‘std::_Sp_counted_ptr_inplace<_Tp, _Alloc, _Lp>::_Sp_counted_ptr_inplace(_Alloc, _Args&& ...) [with _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Alloc = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >; __gnu_cxx::_Lock_policy _Lp = __gnu_cxx::_S_atomic]’
/usr/include/c++/11/bits/shared_ptr_base.h:650:16: [ skipping 3 instantiation contexts, use -ftemplate-backtrace-limit=0 to disable ]
/usr/include/c++/11/bits/shared_ptr.h:862:14: required from ‘std::shared_ptr<_Tp> std::allocate_shared(const _Alloc&, _Args&& ...) [with _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Alloc = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}]’
/usr/include/c++/11/bits/shared_ptr.h:878:39: required from ‘std::shared_ptr<_Tp> std::make_shared(_Args&& ...) [with _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:309:54: required from ‘typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > >::type gs::build_vy_tensor_builder(vineyard::Client&, size_t, FUNC_T&&, int64_t) [with FUNC_T = gs::TransformUtils<gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>, void>::VertexDataToVYTensorBuilder(vineyard::Client&, const std::vector<grape::Vertex<long unsigned int>, std::allocator<grape::Vertex<long unsigned int> > >&)::<lambda(size_t)>&; typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > >::type = boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> >; typename std::result_of<FUNC_T(long unsigned int)>::type = nonstd::sv_lite::basic_string_view<char>; size_t = long unsigned int; int64_t = long int]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:869:35: required from ‘boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > gs::TransformUtils<FRAG_T, typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type>::VertexDataToVYTensorBuilder(vineyard::Client&, const std::vector<typename FRAG_T::vertex_t>&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type = void; typename FRAG_T::vertex_t = grape::Vertex<long unsigned int>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:454:9: required from ‘boost::leaf::result<long unsigned int> gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToVineyardDataframe(const grape::CommSpec&, vineyard::Client&, const std::vector<std::pair<std::basic_string<char>, gs::Selector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; DATA_T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:423:34: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:92:7: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
92 | using ArrowTensorT =
| ^~~~~~~~~~~~
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:162:75: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
162 | __attribute__((annotate("shared"))) const std::shared_ptr<ArrowTensorT> ArrowTensor() {
| ^~~~~~~~~~~
cc1plus: note: unrecognized command-line option ‘-Wno-unused-lambda-capture’ may have been intended to silence earlier diagnostics
cc1plus: note: unrecognized command-line option ‘-Wno-undef-prefix’ may have been intended to silence earlier diagnostics
make[2]: *** [CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/build.make:76: CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/all] Error 2
make: *** [Makefile:91: all] Error 2
2022-07-06 15:00:11,661 [ERROR][rpc:187]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during preprocessing, The traceback is: Traceback (most recent call last):
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 623, in _RunStep
head, bodies = self.run_on_analytical_engine(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 403, in run_on_analytical_engine
op, app_sig, app_lib_path = self._maybe_compile_app(op)
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 683, in _maybe_compile_app
compiled_path = self._compile_lib_and_distribute(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 1411, in _compile_lib_and_distribute
app_lib_path, java_jar_path, java_ffi_path, app_type = compile_func(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/utils.py", line 387, in compile_app
raise CompilationError(
graphscope.framework.errors.CompilationError: Failed to compile app grape::WCCAuto<_GRAPH_TYPE> on platform system: Linux
machine: x86_64
platform: Linux-5.15.0-1013-aws-x86_64-with-glibc2.35
uname: uname_result(system='Linux', node='ip-172-31-0-126', release='5.15.0-1013-aws', version='#17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0\nCopyright (C) 2021 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.13
---------------------------------------------------------------------------
CompilationError Traceback (most recent call last)
Input In [1], in <cell line: 11>()
8 g = sess.g(oid_type="string")
9 g = g.add_edges(test_edges_path)
---> 11 context = graphscope.wcc(g)
12 context.to_dataframe(selector={'id': 'v.id', 'wcc': 'r'}, vertex_range={'begin': 1, 'end': 10}).sort_values(by='id', ascending=False)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:76, in project_to_simple.<locals>.wrapper(*args, **kwargs)
74 else:
75 projected = graph
---> 76 return func(projected, *args[1:], **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:139, in not_compatible_for.<locals>._not_compatible_for.<locals>.wrapper(*args, **kwargs)
135 raise InvalidArgumentError(
136 "Not compatible for %s type" % " ".join(graph_types)
137 )
138 else:
--> 139 return not_compatible_for_func(*args, **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/analytical/app/wcc.py:52, in wcc(graph)
27 @project_to_simple
28 @not_compatible_for("arrow_property", "dynamic_property")
29 def wcc(graph):
30 """Evaluate weakly connected components on the `graph`.
31
32 Args:
(...)
50 >>> sess.close()
51 """
---> 52 return AppAssets(algo="wcc", context="vertex_data")(graph)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:313, in AppAssets.__call__(self, graph, *args, **kwargs)
311 def __call__(self, graph, *args, **kwargs):
312 """Instantiate an App and do queries over it."""
--> 313 app_ = graph.session._wrapper(AppDAGNode(graph, self))
314 return app_(*args, **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:949, in Session._wrapper(self, dag_node)
947 def _wrapper(self, dag_node):
948 if self.eager():
--> 949 return self.run(dag_node)
950 return dag_node
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:971, in Session.run(self, fetches, debug)
952 def run(self, fetches, debug=False):
953 """Run operations of `fetches`.
954 Args:
955 fetch: :class:`Operation`
(...)
969 Different values for different output types of :class:`Operation`
970 """
--> 971 return self.run_fetches(fetches, debug)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:981, in Session.run_fetches(self, fetches, debug)
979 fetch_handler = _FetchHandler(self.dag, fetches)
980 try:
--> 981 response = self._grpc_client.run(fetch_handler.targets)
982 except FatalError:
983 self.close()
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/rpc.py:101, in GRPCClient.run(self, dag_def)
97 def run(self, dag_def):
98 runstep_requests = self._grpc_utils.generate_runstep_requests(
99 self._session_id, dag_def
100 )
--> 101 return self._run_step_impl(runstep_requests)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/utils.py:155, in handle_grpc_error.<locals>.with_grpc_catch(*args, **kwargs)
153 while True:
154 try:
--> 155 return fn(*args, **kwargs)
156 except grpc.RpcError as exc:
157 code = exc.code()
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/rpc.py:193, in GRPCClient._run_step_impl(self, runstep_requests)
187 logger.error(
188 "Runstep failed with code: %s, message: %s",
189 error_codes_pb2.Code.Name(response.code),
190 response.error_msg,
191 )
192 if response.full_exception:
--> 193 raise pickle.loads(response.full_exception)
194 return response
CompilationError: Failed to compile app grape::WCCAuto<_GRAPH_TYPE> on platform system: Linux
machine: x86_64
platform: Linux-5.15.0-1013-aws-x86_64-with-glibc2.35
uname: uname_result(system='Linux', node='ip-172-31-0-126', release='5.15.0-1013-aws', version='#17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0\nCopyright (C) 2021 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.13
@parkerzf Can you contact us through DingTalk, WeChat account(graphscope) or Slack for taking a closer look at this problem, Thanks.
Should be the same issue posted in https://github.com/alibaba/GraphScope/issues/1753
Has been fixed in the vineyard side in https://github.com/v6d-io/v6d/pull/806 and will be included in the next release.
Has this problem been resolved? The issue I encountered is same to this one graphscope 0.26.0 ubuntu20.04 python 3.8.13
