Coyote Codornices Marin
Coyote Codornices Marin
I'm using CoffeeScript for my startup, [SpendRight](http://spendright.org) and really appreciate being able to use coffee-mode in Emacs. I'd love to use [React](http://facebook.github.io/react/) as well (compiling it with @jsdf's [coffee-react](https://github.com/jsdf/coffee-react) compiler),...
`_parse_progress_from_resource_manager()` assumes that there will be at most one job running on a cluster at the same time, which is wrong now that clusters can run steps concurrently. If we...
We've made a tremendous effort to reduce the number of API calls used by cluster pooling, but we still sometimes describe a cluster without saving information about it to our...
The mrjob README is pretty dated; it tries to sell mrjob as "the Python Hadoop streaming library" and doesn't talk about Spark features at all. We should highlight things like:...
When we set up an SSH tunnel to the resource manager, we use the tunnel to check the job's progress and log/print it to the user. Now that we're checking...
AWS's own tags start with `aws:`. We should do the same with mrjob tag names, e.g. `mrjob:version` rather than `__mrjob_version` and `mrjob:pool:name` rather than `__mrjob_pool_name`. Old tag names used by...
Python 3.8 was released last October. Currently, tests do not pass with Python 3.8. The problem seems to be with `pyspark`.
If you run `python -m mrjob.examples.mr_wc -r dataproc --image-version 1.4`, it fails with: ``` Traceback (most recent call last): File "mr_wc.py", line 18, in from mrjob.job import MRJobImportError: No module...
If a `MRJob`s has a very large number of entries associated with the same reducer key, it can be difficult to run through the Spark runner, because all the entries...
As noted in #1376, `PYSPARK_PYTHON` may not take arguments. This means running Spark scripts with something like `--python-bin 'python -v'` won't work. This can be solved by using a Python...