unitxt icon indicating copy to clipboard operation
unitxt copied to clipboard
verified publisher icon IBM

Disable nan transformation in loaders.LoadCSV

Open benjaminsznajder opened this issue 1 year ago • 1 comments

Currently, we use pd.read_csv() for loading csv file.

It causes that empty cells in a csv file are transformed to nan (which is not suited)

The fix is simple:

pd.read_csv('test.csv', keep_default_na=False)

benjaminsznajder avatar Mar 21 '24 14:03 benjaminsznajder

Makes sense. Can you create a PR?

yoavkatz avatar Mar 21 '24 14:03 yoavkatz