Sean Ingerson
Sean Ingerson
Back again! Thank you for improving the support for this use case. I can't get precommit hooks to complete in new project (which uses renv). This is using renv 0.15.2.9...
Currently, passing a custom objective function causes an error downstream when predicting. This happens in `xgb_pred()` when using `switch()` off of the objective (usually a character string) to modify the...
# Problem The `prod_degree` argument cannot be specified if `prune_method="cv"`. Using `translate()`, the equivalent `earth::earth()` call runs, so I think this is a bug in parsnip. The parsnip model does...
Provides a concrete example for #6 within documentation. I would be happy to work on a PR with a more traditional interface (modeling function + predict method) if that is...
[This sparklyr line](https://github.com/sparklyr/sparklyr/blob/661fc4cf8ef61c70d84968f106007e1df809985e/java/spark-1.5.2/backend.scala#L207C35-L207C35) calls `System.exit(0)` for non-service connections. However, according to [this comment in the YARN ApplicationMaster code](https://github.com/apache/spark/blob/7db85642600b1e3b39ca11e41d4e3e0bf1c8962b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala#L234C8-L244C1), it is incorrect for `System.exit(0)` (or status) to be called by the...
## Issue Launching a job with `sparklyr::spark_connect(mode='yarn-cluster',...)` always results in a final status of "FAILED". In particular, this occurs even when the batch R script has clearly run to the...
I'm trying to use `sparklyr::spark_submit(master='yarn-cluster'...)`. Unfortunately, I receive an "RScript not found" type error. R is not installed on nodes, however I distribute a conda environment to each node, and...
[In yarn-cluster.R](https://github.com/sparklyr/sparklyr/blob/eb3e795447887908d9e795512ad08eeeb32eede5/R/yarn_cluster.R#L13), the app is looked up by the environment variable over the config value `sparklyr.yarn.cluster.lookup.username`. These should be reversed, as `sparklyr.yarn.cluster.lookup.username` is narrower in scope than the environment variable...
Closes #331. As mentioned in #287, this is important to be able to control how a recipe behaves when used within a workflow -- as far as I can tell,...