FATE icon indicating copy to clipboard operation
FATE copied to clipboard

Two parties with three dataset cannot fetch the result from FeldmanVerifiableSum.

Open from-alice-to-bob opened this issue 1 year ago • 0 comments

Describe the bug Hi,

My task involves two parties with three dataset, could be understood as: host: bank_li guest: insurance_li, trust_li

All of these dataset are under the same format as: thd,asset 1,100 2,45.5 ...

The first column thd is the ID and the second column asset is a float column for the later calculation. Here is a task to calculate the sum of asset for each user appears in both host and guest side. Before do the intersection, we should do the union for guest to get a dataset for all users in guest with their sum of asset. E.g.

provided:

insurance_li thd,asset 1,100 4,150 7,200

trust_li thd,asset 1,50 3,45 5,71 7,90

we should get a result as the union of guest as: thd,asset 1,150 3,45 4,150 5,71 7,290

and then calculate the sum for the intersection between bank_li and this union data. E.g.

provided:

bank_li thd,asset 1,1000 2,1200 3,800

we should get a result as: thd,asset 1,1150 3,845

However, when I tried to implement this pipeline, I cannot get the 'data output' from FATEBoard on the guest side.

Can anyone help me to have a look? Thank you so much!

To Reproduce My job_dsl.json and job_conf.json are shown below: job_dsl.json:

{ "components": { "feldman_verifiable_sum_0": { "module": "FeldmanVerifiableSum", "input": { "data": { "data": [ "intersect_0.data" ] } }, "output": { "data": [ "result" ] } }, "reader_2": { "output": { "data": [ "data" ] }, "provider": "fate_flow", "module": "Reader" }, "intersect_0": { "output": { "cache": [ "cache" ], "data": [ "data" ] }, "input": { "data": { "data": [ "union_0.data" ] } }, "provider": "fate", "module": "Intersection" }, "reader_1": { "output": { "data": [ "data" ] }, "provider": "fate_flow", "module": "Reader" }, "union_0": { "output": { "data": [ "data" ] }, "input": { "data": { "data": [ "reader_1.data", "reader_2.data" ] } }, "provider": "fate", "module": "UnionColumn" } } }

job_conf.json: { "job_parameters": { "common": { "job_type": "train", "pulsar_run": {}, "auto_retries": 0, "computing_engine": "SPARK", "task_parallelism": 1, "rabbitmq_run": {}, "engines_address": {}, "computing_partitions": 3, "federated_status_collect_type": "PUSH", "inheritance_info": {}, "auto_retry_delay": 1, "adaptation_parameters": { "request_task_cores": 4, "task_cores_per_node": 1, "task_nodes": 3, "if_initiator_baseline": true, "task_memory_per_node": 0 }, "eggroll_run": {}, "spark_run": {}, "federated_mode": "MULTIPLE" } }, "component_parameters": { "role": { "host": { "0": { "reader_2": { "table": { "name": "bank_li", "namespace": "experiment" } }, "reader_1": { "table": { "name": "bank_li", "namespace": "experiment" } } } }, "guest": { "0": { "reader_2": { "table": { "name": "insurance_li", "namespace": "experiment" } }, "reader_1": { "table": { "name": "trust_li", "namespace": "experiment" } } } } }, "common": { "feldman_verifiable_sum_0": { "q_n": 6, "sum_cols": [ 0 ] }, "intersect_0": { "dh_params": { "salt": "12345", "hash_method": "sha256", "key_length": 1024 }, "intersect_method": "dh", "only_output_key": false, "sync_intersect_ids": true } } }, "dsl_version": 2, "role": { "host": [ 7199 ], "guest": [ 7188 ] }, "initiator": { "role": "host", "party_id": 7199 } }

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem. 截屏2024-09-27 20 43 30

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context Add any other context about the problem here.

from-alice-to-bob avatar Sep 27 '24 12:09 from-alice-to-bob