mars icon indicating copy to clipboard operation
mars copied to clipboard

[BUG] ray private attribute and access DeprecationWarning

Open chaokunyang opened this issue 3 years ago • 0 comments

Describe the bug Mars access some private attribute pof ray which needs to be removed.

To Reproduce To help us reproducing this bug, please provide information below:

  1. Your Python version 3.7.9
  2. The version of Mars you use master
  3. Versions of crucial packages, such as numpy, scipy and pandas: ray2.0.0.rc1
  4. Full stack of the error.
(RayMainPool pid=89850) 2022-08-10 11:42:48,632 WARNING __init__.py:192 -- DeprecationWarning: `ray.serialization.SerializationContext` is a private attribute and access will be removed in a future Ray version.
(RayMainPool pid=89850)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 890, in _bootstrap
(RayMainPool pid=89850)     self._bootstrap_inner()
(RayMainPool pid=89850)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 932, in _bootstrap_inner
(RayMainPool pid=89850)     self.run()
(RayMainPool pid=89850)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 870, in run
(RayMainPool pid=89850)     self._target(*self._args, **self._kwargs)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 395, in process_message
(RayMainPool pid=89850)     processor.result = await self._run_coro(
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 343, in _run_coro
(RayMainPool pid=89850)     return await coro
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 917, in create_actor
(RayMainPool pid=89850)     result = await super().create_actor(message)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 525, in create_actor
(RayMainPool pid=89850)     await self._run_coro(message.message_id, actor.__post_create__())
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 343, in _run_coro
(RayMainPool pid=89850)     return await coro
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/services/cluster/locator.py", line 43, in __post_create__
(RayMainPool pid=89850)     self._backend = await backend_cls.create(
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/deploy/oscar/ray.py", line 84, in create
(RayMainPool pid=89850)     ref = await mo.create_actor(
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/api.py", line 27, in create_actor
(RayMainPool pid=89850)     return await ctx.create_actor(actor_cls, *args, uid=uid, address=address, **kwargs)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/context.py", line 110, in create_actor
(RayMainPool pid=89850)     future = await self._call(address, create_actor_message, wait=False)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/context.py", line 67, in _call
(RayMainPool pid=89850)     return await self._caller.call(
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 108, in call
(RayMainPool pid=89850)     client = await self.get_client(router, dest_address)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 42, in get_client
(RayMainPool pid=89850)     client = await router.get_client(dest_address, from_who=self)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/router.py", line 119, in get_client
(RayMainPool pid=89850)     client = await client_type.connect(address, local_address=local_address, **kw)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 544, in connect
(RayMainPool pid=89850)     client_channel = RayClientChannel(dest_address)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 270, in __init__
(RayMainPool pid=89850)     self._peer_actor: "ray.actor.ActorHandle" = ray.get_actor(dest_address)
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/utils.py", line 363, in __getattr__
(RayMainPool pid=89850)     on_load_func()
(RayMainPool pid=89850)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 114, in _init_ray_metrics
(RayMainPool pid=89850)     _ray_serialize = ray.serialization.SerializationContext.serialize
(RayMainPool pid=89850)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/site-packages/ray/__init__.py", line 196, in __getattr__
(RayMainPool pid=89850)     traceback.print_stack()
(RaySubPool pid=89849) 2022-08-10 11:42:48,875  WARNING __init__.py:192 -- DeprecationWarning: `ray.serialization.SerializationContext` is a private attribute and access will be removed in a future Ray version.
(RaySubPool pid=89849)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 890, in _bootstrap
(RaySubPool pid=89849)     self._bootstrap_inner()
(RaySubPool pid=89849)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 932, in _bootstrap_inner
(RaySubPool pid=89849)     self.run()
(RaySubPool pid=89849)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 870, in run
(RaySubPool pid=89849)     self._target(*self._args, **self._kwargs)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 395, in process_message
(RaySubPool pid=89849)     processor.result = await self._run_coro(
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 343, in _run_coro
(RaySubPool pid=89849)     return await coro
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 802, in actor_ref
(RaySubPool pid=89849)     result = await self.call(self._main_address, main_message)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 402, in call
(RaySubPool pid=89849)     return await self._caller.call(self._router, dest_address, message)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 108, in call
(RaySubPool pid=89849)     client = await self.get_client(router, dest_address)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 42, in get_client
(RaySubPool pid=89849)     client = await router.get_client(dest_address, from_who=self)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/router.py", line 119, in get_client
(RaySubPool pid=89849)     client = await client_type.connect(address, local_address=local_address, **kw)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 544, in connect
(RaySubPool pid=89849)     client_channel = RayClientChannel(dest_address)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 270, in __init__
(RaySubPool pid=89849)     self._peer_actor: "ray.actor.ActorHandle" = ray.get_actor(dest_address)
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/utils.py", line 363, in __getattr__
(RaySubPool pid=89849)     on_load_func()
(RaySubPool pid=89849)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 114, in _init_ray_metrics
(RaySubPool pid=89849)     _ray_serialize = ray.serialization.SerializationContext.serialize
(RaySubPool pid=89849)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/site-packages/ray/__init__.py", line 196, in __getattr__
(RaySubPool pid=89849)     traceback.print_stack()
(RaySubPool pid=89848) 2022-08-10 11:42:48,865  WARNING __init__.py:192 -- DeprecationWarning: `ray.serialization.SerializationContext` is a private attribute and access will be removed in a future Ray version.
(RaySubPool pid=89848)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 890, in _bootstrap
(RaySubPool pid=89848)     self._bootstrap_inner()
(RaySubPool pid=89848)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 932, in _bootstrap_inner
(RaySubPool pid=89848)     self.run()
(RaySubPool pid=89848)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/threading.py", line 870, in run
(RaySubPool pid=89848)     self._target(*self._args, **self._kwargs)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 395, in process_message
(RaySubPool pid=89848)     processor.result = await self._run_coro(
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 343, in _run_coro
(RaySubPool pid=89848)     return await coro
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 802, in actor_ref
(RaySubPool pid=89848)     result = await self.call(self._main_address, main_message)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/pool.py", line 402, in call
(RaySubPool pid=89848)     return await self._caller.call(self._router, dest_address, message)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 108, in call
(RaySubPool pid=89848)     client = await self.get_client(router, dest_address)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/core.py", line 42, in get_client
(RaySubPool pid=89848)     client = await router.get_client(dest_address, from_who=self)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/router.py", line 119, in get_client
(RaySubPool pid=89848)     client = await client_type.connect(address, local_address=local_address, **kw)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 544, in connect
(RaySubPool pid=89848)     client_channel = RayClientChannel(dest_address)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 270, in __init__
(RaySubPool pid=89848)     self._peer_actor: "ray.actor.ActorHandle" = ray.get_actor(dest_address)
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/utils.py", line 363, in __getattr__
(RaySubPool pid=89848)     on_load_func()
(RaySubPool pid=89848)   File "/Users/chaokunyang/Desktop/chaokun/python/mars/mars/oscar/backends/ray/communication.py", line 114, in _init_ray_metrics
(RaySubPool pid=89848)     _ray_serialize = ray.serialization.SerializationContext.serialize
(RaySubPool pid=89848)   File "/Users/chaokunyang/anaconda3/envs/mars3.8/lib/python3.8/site-packages/ray/__init__.py", line 196, in __getattr__
(RaySubPool pid=89848)     traceback.print_stack()

  1. Minimized code to reproduce the error.

Expected behavior A clear and concise description of what you expected to happen.

Additional context Add any other context about the problem here.

chaokunyang avatar Aug 10 '22 03:08 chaokunyang