Andrew Melo
Andrew Melo
@wyegelwel - Would you still accept a PR for this functionality? Like a followup comment mentioned, I'm not sure how it works to accept mesos principals and not their corresponding...
@DaoWen Excellent. It's been a few years since I've done lisp-y things, so hopefully it comes back easily... In terms of the PR, I think the outline posted above makes...
Is it possible that the (undocumented) option `spark.executor.cook.container` [1] could be used to emulate "native" docker support? https://github.com/twosigma/spark/blob/a72488df9e89d2570a0dbbb80767b398a87e1d8d/resource-managers/cook/src/main/scala/org/apache/spark/scheduler/cluster/cook/CookSchedulerContext.scala#L47
Okay, I started work on this, my goal is to wire the existing mesos/docker config options into Cook as opposed to making cook-specific keys for the ame functinality. Is that...
Thanks for the help! RE spark and blocking, I think we might be talking about different things. The snippet above calls out to spark two separate times - once to...
Right -- I have multiple dataframes (one per sample), and I'd like to fill multiple histograms. I'm not wanting (or suggesting!) to combine them into a single dataframe, then separate...
>Spark has a non-blocking interface, but PySpark doesn't, so Book runs independent queries in Python threads. > >https://github.com/scikit-hep/histbook/blob/master/histbook/book.py#L557 Exactly! That's what I was trying to (inarticulately) say above. Since PySpark's...
I'll look into the `SamplesBook`, I guess the `fill` function could be overrided there to provide multiple dataframes at some point. RE needing different plotting routines -- I guess that's...
But I guess we're getting close to the use-case.. I have 10 samples and 100 different histograms I want to generate/plot. How do I do that in histbook efficiently, in...
I guess perhaps it's a specific combination that's currently disallowed I'm trying to do. ```python Hist.group(WJets=wjet_met, DYJets=dyjet_met).stack("source").step("MET_pt").to(canvas) ``` yields ``` TypeError: only area and bar can be stacked ``` If...