superset icon indicating copy to clipboard operation
superset copied to clipboard

Superset with Athena connection

Open kapilgarg83 opened this issue 4 years ago • 9 comments

Hi,

Facing issue in connection with Athena using PyAthena created the connection string

awsathena+rest://{aws_access_key_id}:{aws_secret_access_key}@athena.{region_name}.amazonaws.com/{schema_name}?s3_staging_dir={s3_staging_dir}

Now the problem is {schema_name} parameter is not working Ii am not able to connect to a particular DB or scheme it's always connected to a default data source from my Athena

Kindly suggest

kapilgarg83 avatar Oct 21 '21 12:10 kapilgarg83

Hi kapilgarg83 - can you please explain how you made the connection work? I tried, but I always face an error. I used PyAthena as well. awsathena+rest://@athena.us-east-1.amazonaws.com/?s3_staging_dir=s3://superset-output-workgroup/output-athena/ is my URI, and the error I get is: An error occurred while creating databases: Connection failed, please check your connection settings. I am not using the key/secret key because I am using a role in IAM.

youcefjd avatar Oct 29 '21 23:10 youcefjd

Hi, I can confirm somehow similar behavior. There are multiple datasources configured in our AWS Athena, up on configuring database in superset in a form of:

awsathena+rest://key:[email protected]:443/schema?s3_staging_dir=bucket&work_group=some_group

I can successfully establish (test) connection, however when I'm trying to create dataset - Superset showing schemas only from first Athena datasource (AWS Glue) so far I wasn't able to make it choose somehow other Athena datasource

morokin avatar Feb 03 '22 20:02 morokin

@kapilgarg83, are you able to solve the problem? facing the same issue here :(

JasbirCodeSpace avatar Apr 14 '22 20:04 JasbirCodeSpace

@eschutho @betodealmeida I can't remember the details, but I know there were some changes/ideas around the Athena connector after this was open. Is this still an issue in your minds?

Curious also if anyone else on the thread is able to repro this in 2.0.1 or on master?

rusackas avatar Jan 26 '23 06:01 rusackas

Same issue here!

arnoroos-dataroots avatar Oct 31 '23 10:10 arnoroos-dataroots

@arnoroos-dataroots what version are you running?

Anyone able to verify this issue on Superset 3.x?

rusackas avatar Feb 01 '24 22:02 rusackas

Same Issue: When test the connection it show "Connection looks good!". When click Connect Button it through error: "An error occurred while creating databases: Database could not be created."

irfanmajeed avatar May 13 '24 12:05 irfanmajeed

@irfanmajeed on what version of Superset?

rusackas avatar May 13 '24 21:05 rusackas

@irfanmajeed on what version of Superset?

Version: 4.0.0

irfanmajeed avatar May 14 '24 04:05 irfanmajeed