whylogs icon indicating copy to clipboard operation
whylogs copied to clipboard

Remove references to confusing methods in PySpark profiling example

Open jamie256 opened this issue 8 months ago • 0 comments

Description

The PySpark profiling example notebook uses the collect_column_profile_views method as the first example which returns a dictionary and is not easy to then use to write to WhyLabs. We should start with the most commonlyapplicable method, as this one is a more advanced use case which requires an integration to manage column profiles rather than using the dataset profile or result set as a wrapper.

PySpark Integration

jamie256 avatar Jun 12 '24 20:06 jamie256