kglab icon indicating copy to clipboard operation
kglab copied to clipboard

Shape Prediction: integrate ShapeFactory with RLlib to evolve shapes

Open ceteri opened this issue 5 years ago • 0 comments

To implement shape prediction, integrate ShapeFactory with RLlib to evolve shapes.

To do list:

  1. ShapeFactory: leaderboard with non-dominated columns * leaderboard_actor based on https://docs.ray.io/en/master/actors.html

  2. Simplex1: create probabilistic generators from dyad census * gamma dist to generate indexed links (depth) * predicate co-occurrence (approx. triad census) to generate indexed links (breadth)

  3. EvoShape: represent nodes of internal evolved shape * randomize order of node list for potential EvoShape targets * walk node list to determine if action blocked * action method addNodeDepth() using subj gamma dist * action method addNodeBreadth() using ∪(pred co-occur ∩ subj gamma dist) * action method submit() * explore possible use of node2vec to guide addNodeBreadth() ?

  4. gym-evoshape: subclass Gym environment * RL observation: action blocked, dist, rank_metric * threshold for MIN_INSTANCES => done * RL action space: EvoShape methods, where allowed * RL reward structure: (neg) steps, (pos) rank_metric * visualize subgraph

  5. calculate random baseline of GymKG to generate graph shapes (shape prediction)

  6. adapt for RLlib training with PPO

ceteri avatar Dec 19 '20 20:12 ceteri