[Question] persistent volumes and autoscaling

[liorze]

Hi,

I have a couple of questions:

1. Can the scheduler automatically increase or decrease the number of brokers? Ref: https://mesosphere.com/blog/2015/07/16/making-apache-kafka-elastic-with-apache-mesos/
2. Do you support mesos persistent volumes?

[oreh]

I also want to know if mesos persistent volumes are really supported. There is an '--volume' option in adding brokers. But after I setup persistent volume and passing its id to '--volume', the broker can be added but cannot be started.

[steveniemitz]

short answer: --volume is pretty much useless. long answer: I've been experimenting with much better volume support. I think this would be a killer feature and a huge win, however I don't have a ton of time to test it.

The code is in a branch here: https://github.com/tc-dc/kafka-mesos/tree/dynamic-volume-support if anyone wants to test it out. Satya Karthik has been playing around with it as well. (see the slack channel for more info).