aws.s3 icon indicating copy to clipboard operation
aws.s3 copied to clipboard

Published 20 hours ago • verified publisher icon cloudyr

Support Athena queries

Open dylancis opened this issue 6 years ago • 2 comments

Hi there- Python boto3 equivalent package no supports Athena; boto3-athena I would be great if aws.s3 could also supports Amazon Athena - at the moment the only way to run Athena via R is to use the JDBC driver and having rJava installed.

Thank you, Dykan

dylancis avatar Aug 06 '18 14:08 dylancis

Yep, it's in the pipeline. Forthcoming over here: https://github.com/cloudyr/aws.athena

leeper avatar Aug 06 '18 15:08 leeper

Worth noting there are big differences between the performance of the various Athena drivers. Specifically, with some of the drivers, the speed at which query results are received by R is slow. So if you do a select * from a big table, it can be 10s of minutes to return the data, even if the query itself ran very fast.

The latest JDBC driver is much faster.

There also seem to be differences in handling of data types between the drivers.

RobinL avatar Aug 29 '18 07:08 RobinL