morphir-elm icon indicating copy to clipboard operation
morphir-elm copied to clipboard

Spark: Map Support

Open stephengoldbaum opened this issue 2 years ago • 0 comments

Description

Supporting the ability to map (select) values from fields or calculations from a data set.

Criteria

Morphir provides the ability to map from a collection of records via a function that takes the record as an argument and returns the desired record as a result. Spark provides the same capability through its DataFrame API. The goal is to transform the maps in the Morphir IR to the appropriate Spark DataFrame calls.

Definition of Done

This epic will be considered complete when it can sufficiently support the requirements for the LCR.

stephengoldbaum avatar Jun 13 '22 18:06 stephengoldbaum