ion-hive-serde icon indicating copy to clipboard operation
ion-hive-serde copied to clipboard

Type Specific Extraction

Open cheqianh opened this issue 3 years ago • 0 comments

Currently, Ion-hive-serde will throw an error to notify users when writing an unexpected type value into the hive table.

E.g.

Example Table DDL
CREATE EXTERNAL TABLE example_ion_table(
   name: string
)

# Example Ion file with 2 documents. Document 2 will cause the extraction to fail.
{name: "ion_doc_1"}
{name: 2}

# Path Extractors
ion.name.path_extractor = ( name )

# Table retrieves
|  name: string  |  
------------------------------------------
| "ion_doc_1"    | 
| ERROR          | 

cheqianh avatar Sep 23 '21 01:09 cheqianh