Jim Crist-Harif

Results 483 comments of Jim Crist-Harif

Apologies for the delayed response here, things have gotten busy. I don't think we can robustly specify the number of log files to pull, as this doesn't support dynamic workloads....

Thanks @georgepachitariu. I'm currently on break between jobs (and without a computer), but will try to look at the changes as soon as I can (max 2 weeks from now)....

Hi all. I just started a new job, so a fair bit of my time is occupied ramping up on that. I expect to be able to give this a...

Apologies, things have been a bit chaotic. Thinking about this a bit more, I think the method returning logs should be a streaming output method, so the msg size matters...

Hmmm, yeah. In that case we may want to stream in fixed bytesize chunks (line-by-line seems too much to me). To the end user I think this should keep the...

👍 That rpc design makes sense to me.

Seems reasonable to me. I'd handle this by adding a `proxy=False` kwarg to `add_page`, defaulting to `True`. I'd also probably rename the `ProxiedPage` class to `Page`, and add a `proxied`...

Apologies for the delay here, I've been out-of-office (vacation, then SciPy). Why are you passing in `java_options`? Most users don't need to use these (the defaults are usually sufficient). For...

YARN is a bit odd with that - the above exception may be a sign of an issue with our code, but it may be innocuous - when YARN failover...

Hmmm, this is a new one. I suspect your `spark-submit` configuration has some extra things specified that we're not picking up (spark and hadoop CLIs allow specifying configuration options in...