Klaas Bosteels

Results 16 comments of Klaas Bosteels

Yup, we were already aware of this but it's definitely a good idea to create a github issue for it. Patches are welcome.. :)

Hey Brandyn, It would indeed be more elegant to use unicode strings for typed bytes strings (in which case we could use plain strings for the bytes type), but we...

Mostly the decoding I think, but could be both I guess... -K Sent from my iPad On 11 Jan 2012, at 03:53, Brandyn White [email protected] wrote: > Do you recall...

Yeah, that's actually sort of by design. Dumbo options always apply to the whole program, and attaching them to individual mappers is basically just a convenient way of specifying that...

Sounds good! Will try to find some time to review and merge this soonish.

Typedbytes indeed hasn't been ported to python 3 yet. It should be pretty straightforward though, so feel free to create a PR!

This error alone doesn't give me much to go on unfortunately. Could you post the code for the program that you were trying to run by any chance?

Presumably the error happens for the iteration that executes "video_to_primary_mapper"? It looks like the "newopts['numreducetasks'] = '0'" on line 400 of "dumbo/core.py" is somehow not going through, which will indeed...

Sound good! Will try to find some time to review soonish.

Two comments: - Doesn't adhere to PEP 8 style guide. - The Hadoop backend already has "nummaptasks" and "numreducetasks" options — maybe it would be better to use the same...