dataflo.ws
dataflo.ws copied to clipboard
Clustered running of dataflows
I am running multiple processes of dataflows, e.g.
dataflows daemon core
dataflows daemon redis-events
dataflows daemon listeners2
But I can not define how much of each initiator to run in each command, since we use initiator types in daemons.
for this to happen:
- Can we add multiple
etc/projectfiles in dataflow? (e.g. dataflows project2 daemon test)
OR
- is it easier to change the project json definition so that I can use the same initiators in multiple daemons? something like this:
"daemon": {
"test": {
"initiator": [ "cluster1" ]
},
"test2": {
"initiator": [ "cluster2"]
}
}
"initiator":{
"cluster1": {
"type": "http",
"workflows":[
{1}, {2}, {3}
]},
"cluster2": {
"type": "http",
"workflows":[
{4}, {5}, {6}
]}
}