Hadoop-snippets icon indicating copy to clipboard operation
Hadoop-snippets copied to clipboard

Hadoop-misc

This project contains helper and misculeneus classes you may need in your daily life on a hadoop cluster.

Contents:

  • YarnAppMetricsCollector - Helper class for collecting Yarn apps performance(vcore-seconds/Mb-seconds) metrics, may help in the case of a big number of apps.

  • ParquetReaderWriterWithAvro - Example of reading writing Parquet in java without BigData tools.

  • AvroWriter - Example of writing an Avro file in Java without BigData tools.

  • AvroReader - Example of reading an Avro file in Java without BigData tools.