morphir-elm
morphir-elm copied to clipboard
Spark: Map Support
Description
Supporting the ability to map (select) values from fields or calculations from a data set.
Criteria
Morphir provides the ability to map from a collection of records via a function that takes the record as an argument and returns the desired record as a result. Spark provides the same capability through its DataFrame API. The goal is to transform the maps in the Morphir IR to the appropriate Spark DataFrame calls.
Definition of Done
This epic will be considered complete when it can sufficiently support the requirements for the LCR.