kedro icon indicating copy to clipboard operation
kedro copied to clipboard

Published 20 hours ago • verified publisher icon kedro-org

Fix issue with specifying format for SparkHiveDataSet

Open jstammers opened this issue 2 years ago • 0 comments

Description

The current implementation of SparkHiveDataSet contains a bug that prevents a user from specifying a save format. This issue is discussed in #1528 .

Development notes

The proposed fix for this is to pop the format argument if it exists. A unit test has also been added to assert that the dataset has the required format and that the table can be saved.

Checklist

  • [x] Read the contributing guidelines
  • [ ] Opened this PR as a 'Draft Pull Request' if it is work-in-progress
  • [ ] Updated the documentation to reflect the code changes
  • [x] Added a description of this change in the RELEASE.md file
  • [x] Added tests to cover my changes

jstammers avatar Sep 20 '22 11:09 jstammers