Owen O'Malley

icon indicating a website link http://people.apache.org/~omalley/ icon indicating an email [email protected]

icon company retired icon location Sunnyvale, CA icon location I'm a software engineer that has been working on big data open source projects since 2006. I'm a PMC member of Hadoop, Hive, and ORC.

Results 15 comments of Owen O'Malley

GetObjectRequest in S3 should support final bytes as a Range header value

This will also be useful for file formats like ORC and Parquet that want to read the file footer first.

Uppercased schemas are not readable in Iceberg-mr/ hive

I thought Hive only lowercases the top level column names. Does it also lowercase the fields in structs?

Support read large statistics exceed 2GB

Yeah, I've seen ORC files upto 2gb or so, but @deshanxiao 's point is accurate that you'll probably get better performance out of Spark & Trino if you keep them...

Update plugin intellij

Agreed. Gateway is currently completely useless for Github's Codespaces. I guess I'll stick with their web ui or switch to vs code.

ordering different from source file

What type is causing a problem? The tool will sort the fields of structs by their name.