compose icon indicating copy to clipboard operation
compose copied to clipboard

Published 20 hours ago • verified publisher icon alteryx

Koalas support for ComposeML

Open mohitjn91 opened this issue 3 years ago • 1 comments

Hi Team, as per documentation ComposeML is a crucial step for automated ML pipeline. For our project, the dataset cannot be loaded into pandas dataframe because of its huge size. Therefore we started working with Koalas dataframe. But now we have hit a roadblock since ComposeML does not support Koalas.

Request you to provide Koalas support for the entire automated pipeline

mohitjn91 avatar Nov 10 '21 04:11 mohitjn91

Given recent changes to Featuretools and Koalas, this would now need to be updated to use the new spark pandas API instead of Koalas.

thehomebrewnerd avatar Mar 16 '22 15:03 thehomebrewnerd