dumbo icon indicating copy to clipboard operation
dumbo copied to clipboard

Crash if mapper or reducer does not yield anything

Open a4tunado opened this issue 12 years ago • 1 comments

Some jobs do not produce any output for ex. uploading input data to external storage or something like this. Dumbo expected that each reducer or mapper yields some data otherwise it leads to crash.

a4tunado avatar Dec 20 '12 09:12 a4tunado

You can create empty generator like this

def reducer(data):
    for key, values in data:
        # do something

    return
    yield

ediskandarov avatar Apr 03 '14 13:04 ediskandarov