kglab icon indicating copy to clipboard operation
kglab copied to clipboard

Integrate with Ray for a distributed store

Open ceteri opened this issue 5 years ago • 2 comments

Integrate with Ray to support for a distributed store

Depends on: #38 #39

  • leverage use of Ray actors, remote objects, parallel iterators, etc. to implement sharding for distributing store
  • coordinate with @jake-aft, @torito1984

ceteri avatar Dec 19 '20 22:12 ceteri

Will start having a look, now we are in lockdown 3.

On Sat, 19 Dec 2020, 22:22 Paco Nathan, [email protected] wrote:

Integrate with Ray https://ray.io/ to support for a distributed store

Depends on: #38 https://github.com/DerwenAI/kglab/issues/38 #39 https://github.com/DerwenAI/kglab/issues/39

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/DerwenAI/kglab/issues/40, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA7A2SN4FL3ND4HVXAKWHS3SVURQVANCNFSM4VCTHH5Q .

torito1984 avatar Dec 20 '20 09:12 torito1984

@torito1984 I hope all's going well -- be safe. We're also escalating lockdown ("stay-at-home" orders) in N Cal.

ceteri avatar Dec 20 '20 18:12 ceteri

Bokay, well, this (RDFlib distributed store using Ray on K8s) has been done on another project for a project in industry. Working out details of releasing that as open source.

ceteri avatar Aug 31 '22 23:08 ceteri