FATE
FATE copied to clipboard
Two parties with three dataset cannot fetch the result from FeldmanVerifiableSum.
Describe the bug Hi,
My task involves two parties with three dataset, could be understood as: host: bank_li guest: insurance_li, trust_li
All of these dataset are under the same format as: thd,asset 1,100 2,45.5 ...
The first column thd is the ID and the second column asset is a float column for the later calculation. Here is a task to calculate the sum of asset for each user appears in both host and guest side. Before do the intersection, we should do the union for guest to get a dataset for all users in guest with their sum of asset. E.g.
provided:
insurance_li thd,asset 1,100 4,150 7,200
trust_li thd,asset 1,50 3,45 5,71 7,90
we should get a result as the union of guest as: thd,asset 1,150 3,45 4,150 5,71 7,290
and then calculate the sum for the intersection between bank_li and this union data. E.g.
provided:
bank_li thd,asset 1,1000 2,1200 3,800
we should get a result as: thd,asset 1,1150 3,845
However, when I tried to implement this pipeline, I cannot get the 'data output' from FATEBoard on the guest side.
Can anyone help me to have a look? Thank you so much!
To Reproduce My job_dsl.json and job_conf.json are shown below: job_dsl.json:
{ "components": { "feldman_verifiable_sum_0": { "module": "FeldmanVerifiableSum", "input": { "data": { "data": [ "intersect_0.data" ] } }, "output": { "data": [ "result" ] } }, "reader_2": { "output": { "data": [ "data" ] }, "provider": "fate_flow", "module": "Reader" }, "intersect_0": { "output": { "cache": [ "cache" ], "data": [ "data" ] }, "input": { "data": { "data": [ "union_0.data" ] } }, "provider": "fate", "module": "Intersection" }, "reader_1": { "output": { "data": [ "data" ] }, "provider": "fate_flow", "module": "Reader" }, "union_0": { "output": { "data": [ "data" ] }, "input": { "data": { "data": [ "reader_1.data", "reader_2.data" ] } }, "provider": "fate", "module": "UnionColumn" } } }
job_conf.json: { "job_parameters": { "common": { "job_type": "train", "pulsar_run": {}, "auto_retries": 0, "computing_engine": "SPARK", "task_parallelism": 1, "rabbitmq_run": {}, "engines_address": {}, "computing_partitions": 3, "federated_status_collect_type": "PUSH", "inheritance_info": {}, "auto_retry_delay": 1, "adaptation_parameters": { "request_task_cores": 4, "task_cores_per_node": 1, "task_nodes": 3, "if_initiator_baseline": true, "task_memory_per_node": 0 }, "eggroll_run": {}, "spark_run": {}, "federated_mode": "MULTIPLE" } }, "component_parameters": { "role": { "host": { "0": { "reader_2": { "table": { "name": "bank_li", "namespace": "experiment" } }, "reader_1": { "table": { "name": "bank_li", "namespace": "experiment" } } } }, "guest": { "0": { "reader_2": { "table": { "name": "insurance_li", "namespace": "experiment" } }, "reader_1": { "table": { "name": "trust_li", "namespace": "experiment" } } } } }, "common": { "feldman_verifiable_sum_0": { "q_n": 6, "sum_cols": [ 0 ] }, "intersect_0": { "dh_params": { "salt": "12345", "hash_method": "sha256", "key_length": 1024 }, "intersect_method": "dh", "only_output_key": false, "sync_intersect_ids": true } } }, "dsl_version": 2, "role": { "host": [ 7199 ], "guest": [ 7188 ] }, "initiator": { "role": "host", "party_id": 7199 } }
Expected behavior A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]
Smartphone (please complete the following information):
- Device: [e.g. iPhone6]
- OS: [e.g. iOS8.1]
- Browser [e.g. stock browser, safari]
- Version [e.g. 22]
Additional context Add any other context about the problem here.