Cook
Cook copied to clipboard
twosigma
Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark
**Is your feature request related to a problem? Please describe.** The `/progress` API for POSTing job instance progress updates from k8s sidecars is initially being implemented unauthenticated. This obviously isn't...
**Describe the bug** Adding new line to the `:require` list in components.clj (which should basically be a no-op) causes a compile-time error. **To Reproduce** Adding this single line to the...
Bumps [psutil](https://github.com/giampaolo/psutil) from 5.4.1 to 5.6.6. Changelog Sourced from psutil's changelog. 5.6.6 2019-11-25 Bug fixes 1179_: [Linux] Process cmdline() now takes into account misbehaving processes renaming the command line and...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
**Is your feature request related to a problem? Please describe.** It consolidates the sandbox directory for both mesos and k8s. **Describe the solution you'd like** We should either mount or...
Our [current REST API doc](https://github.com/twosigma/Cook/blob/v1.14.1/scheduler/docs/scheduler-rest-api.adoc) has some parts that are outdated or have always been inaccurate. We should fully document the REST API using the swagger annotations in the code....
Relevant function: cook.mesos.optimizer/calculate-expected-complete-time
**Describe the bug** In a couple places [1] [2], the user is instructed to postfix the ZK connection string with a directory (zk node?) `/cook`. If the user does this,...
For the caches, including, but not limited to: (defonce ^Cache job-ent->resources-cache (new-cache)) (defonce ^Cache categorize-job-cache (new-cache)) (defonce ^Cache task-ent->user-cache (new-cache)) (defonce ^Cache job-ent->user-cache (new-cache)) (cook.mesos.data-locality/reset-data-local-costs!) Today, we initialize them here,...
