ramadda icon indicating copy to clipboard operation
ramadda copied to clipboard

S3 environment variables

Open penelsonUMN opened this issue 7 months ago • 5 comments

Hi,

Is it possible to set custom S3 profiles to be used by RAMADDA (i.e ~/.aws/config)? We have a Ceph based S3 storage platform that's compliant with the S3 protocol but isn't AWS hosted.

I'm curious to know if a custom S3 endpoint_url and AWS_ACCESS_KEY_ID, AWS_SECRET_KEY can be set?

Thanks! -Peter

penelsonUMN avatar May 22 '25 17:05 penelsonUMN

Hi Peter, There is integration with S3 in RAMADDA. Here are some examples (note: some of these buckets don't exist anymore) https://asdi.ramadda.org/repository/a/asdi

And documentation- https://ramadda.org/repository/userguide/s3.html

RAMADDA does support api keys but currently it uses the default S3 API endpoint. It uses the Java AmazonS3Client library and, from ChatGPT, it appears that one can configure different end points-

[image: image.png]

I would need to make some changes to allow for the specification of an alternative endpoint and, to do so, I would need an endpoint to test against. Do you have an end point available that I could use?

-Jeff

On Thu, May 22, 2025 at 11:57 AM penelsonUMN @.***> wrote:

penelsonUMN created an issue (geodesystems/ramadda#6) https://github.com/geodesystems/ramadda/issues/6

Hi,

Is it possible to set custom S3 profiles to be used by RAMADDA (i.e ~/.aws/config)? We have a Ceph based S3 storage platform that's compliant with the S3 protocol but isn't AWS hosted.

I'm curious to know if a custom S3 endpoint_url and AWS_ACCESS_KEY_ID, AWS_SECRET_KEY can be set?

Thanks! -Peter

— Reply to this email directly, view it on GitHub https://github.com/geodesystems/ramadda/issues/6, or unsubscribe https://github.com/notifications/unsubscribe-auth/AANCOT52K4SCUV6KHJXE7EL27YFXLAVCNFSM6AAAAAB5WXIJJ2VHI2DSMVQWIX3LMV43ASLTON2WKOZTGA4DIMJVGE4DONY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

jeffmcwhirter avatar May 22 '25 21:05 jeffmcwhirter

Hi Peter, I have added an optional end point and end point region to the S3 handling. This is in the development release- https://ramadda.org/repository/entry/release#development_release

When creating an S3 entry in RAMADDA there are the fields-

[image: image.png]

I can't actually test this so please try it out

In general there are some issues with the S3 entry type that I never resolved when I initially did this work 3 years ago. In particular, (if I recall) the paging of multiple entries was buggy.

-Jeff

On Thu, May 22, 2025 at 3:28 PM Jeff McWhirter @.***> wrote:

Hi Peter, There is integration with S3 in RAMADDA. Here are some examples (note: some of these buckets don't exist anymore) https://asdi.ramadda.org/repository/a/asdi

And documentation- https://ramadda.org/repository/userguide/s3.html

RAMADDA does support api keys but currently it uses the default S3 API endpoint. It uses the Java AmazonS3Client library and, from ChatGPT, it appears that one can configure different end points-

[image: image.png]

I would need to make some changes to allow for the specification of an alternative endpoint and, to do so, I would need an endpoint to test against. Do you have an end point available that I could use?

-Jeff

On Thu, May 22, 2025 at 11:57 AM penelsonUMN @.***> wrote:

penelsonUMN created an issue (geodesystems/ramadda#6) https://github.com/geodesystems/ramadda/issues/6

Hi,

Is it possible to set custom S3 profiles to be used by RAMADDA (i.e ~/.aws/config)? We have a Ceph based S3 storage platform that's compliant with the S3 protocol but isn't AWS hosted.

I'm curious to know if a custom S3 endpoint_url and AWS_ACCESS_KEY_ID, AWS_SECRET_KEY can be set?

Thanks! -Peter

— Reply to this email directly, view it on GitHub https://github.com/geodesystems/ramadda/issues/6, or unsubscribe https://github.com/notifications/unsubscribe-auth/AANCOT52K4SCUV6KHJXE7EL27YFXLAVCNFSM6AAAAAB5WXIJJ2VHI2DSMVQWIX3LMV43ASLTON2WKOZTGA4DIMJVGE4DONY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

jeffmcwhirter avatar May 23 '25 12:05 jeffmcwhirter

Thanks Jeff!

I was able to add an s3 entry with one of our endpoints and it listed out the files in the S3 bucket. I did encounter en error when trying to download a file:

Error processing tag: {{embed as="file" maxheight="600" maxSize="10000" }}The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null)

com.amazonaws.services.s3.model.AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null), S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E= at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715) at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5456) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5403) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5397) at com.amazonaws.services.s3.AmazonS3Client.listObjectsV2(AmazonS3Client.java:971) at org.ramadda.util.S3File.copyFileTo(S3File.java:528) at org.ramadda.util.S3File.copyFileTo(S3File.java:549) at org.ramadda.repository.StorageManager.getEntryFile(StorageManager.java:2007) at org.ramadda.repository.StorageManager.getEntryResourcePath(StorageManager.java:1982) at org.ramadda.repository.output.WikiManager.getWikiIncludeInner(WikiManager.java:2949) at org.ramadda.repository.output.WikiManager.my_getWikiInclude(WikiManager.java:1405) at org.ramadda.repository.output.WikiManager.handleWikiImport(WikiManager.java:7733) at org.ramadda.repository.output.WikiManager.getWikiPropertyValue(WikiManager.java:408) at org.ramadda.util.WikiUtil.handleProperty(WikiUtil.java:3664) at org.ramadda.util.WikiUtil.wikifyInner(WikiUtil.java:3345) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:352) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:325) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:565) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:543) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:462) at org.ramadda.repository.output.HtmlOutputHandler.handleDefaultWiki(HtmlOutputHandler.java:462) at org.ramadda.repository.output.HtmlOutputHandler.getHtmlResult(HtmlOutputHandler.java:411) at org.ramadda.repository.output.HtmlOutputHandler.outputEntry(HtmlOutputHandler.java:377) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1519) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1005) at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.ramadda.repository.ApiMethod.invoke(ApiMethod.java:181) at org.ramadda.repository.Repository.getResult(Repository.java:3651) at org.ramadda.repository.Repository.handleRequestInner(Repository.java:3272) at org.ramadda.repository.Repository.handleRequest(Repository.java:3143) at org.ramadda.repository.server.RepositoryServlet.doGet(RepositoryServlet.java:242) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.lang.Thread.run(Thread.java:750)

I'm looking to see if there's anything on our end that would interfere.

penelsonUMN avatar May 23 '25 16:05 penelsonUMN

Hi Peter, btw - can you send me a response to @.*** from your email so we don't have to go through github issues

I am glad something works with the endpoint. My bad on the error. In Copying the file from S3 I am not instantiating with the endpoint. It is hard coding when flying blind and not being able to test.

I have made the change and you can try this out from the dev release- https://ramadda.org/repository/alias/release#development_release

-Jeff

On Fri, May 23, 2025 at 10:00 AM penelsonUMN @.***> wrote:

penelsonUMN left a comment (geodesystems/ramadda#6) https://github.com/geodesystems/ramadda/issues/6#issuecomment-2904943210

Thanks Jeff!

I was able to add an s3 entry with one of our endpoints and it listed out the files in the S3 bucket. I did encounter en error when trying to download a file:

Error processing tag: {{embed as="file" maxheight="600" maxSize="10000" }}The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null)

com.amazonaws.services.s3.model.AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null), S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E= at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715) at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5456) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5403) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5397) at com.amazonaws.services.s3.AmazonS3Client.listObjectsV2(AmazonS3Client.java:971) at org.ramadda.util.S3File.copyFileTo(S3File.java:528) at org.ramadda.util.S3File.copyFileTo(S3File.java:549) at org.ramadda.repository.StorageManager.getEntryFile(StorageManager.java:2007) at org.ramadda.repository.StorageManager.getEntryResourcePath(StorageManager.java:1982) at org.ramadda.repository.output.WikiManager.getWikiIncludeInner(WikiManager.java:2949) at org.ramadda.repository.output.WikiManager.my_getWikiInclude(WikiManager.java:1405) at org.ramadda.repository.output.WikiManager.handleWikiImport(WikiManager.java:7733) at org.ramadda.repository.output.WikiManager.getWikiPropertyValue(WikiManager.java:408) at org.ramadda.util.WikiUtil.handleProperty(WikiUtil.java:3664) at org.ramadda.util.WikiUtil.wikifyInner(WikiUtil.java:3345) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:352) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:325) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:565) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:543) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:462) at org.ramadda.repository.output.HtmlOutputHandler.handleDefaultWiki(HtmlOutputHandler.java:462) at org.ramadda.repository.output.HtmlOutputHandler.getHtmlResult(HtmlOutputHandler.java:411) at org.ramadda.repository.output.HtmlOutputHandler.outputEntry(HtmlOutputHandler.java:377) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1519) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1005) at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.ramadda.repository.ApiMethod.invoke(ApiMethod.java:181) at org.ramadda.repository.Repository.getResult(Repository.java:3651) at org.ramadda.repository.Repository.handleRequestInner(Repository.java:3272) at org.ramadda.repository.Repository.handleRequest(Repository.java:3143) at org.ramadda.repository.server.RepositoryServlet.doGet(RepositoryServlet.java:242) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.lang.Thread.run(Thread.java:750)

I'm looking to see if there's anything on our end that would interfere.

— Reply to this email directly, view it on GitHub https://github.com/geodesystems/ramadda/issues/6#issuecomment-2904943210, or unsubscribe https://github.com/notifications/unsubscribe-auth/AANCOTY5CORSYGKUV26ROK3275A3PAVCNFSM6AAAAAB5WXIJJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDSMBUHE2DGMRRGA . You are receiving this because you commented.Message ID: @.***>

jeffmcwhirter avatar May 23 '25 23:05 jeffmcwhirter

btw - I am curious - what kind of data do you work with?

-Jeff

On Fri, May 23, 2025 at 5:04 PM Jeff McWhirter @.***> wrote:

Hi Peter, btw - can you send me a response to @.*** from your email so we don't have to go through github issues

I am glad something works with the endpoint. My bad on the error. In Copying the file from S3 I am not instantiating with the endpoint. It is hard coding when flying blind and not being able to test.

I have made the change and you can try this out from the dev release- https://ramadda.org/repository/alias/release#development_release

-Jeff

On Fri, May 23, 2025 at 10:00 AM penelsonUMN @.***> wrote:

penelsonUMN left a comment (geodesystems/ramadda#6) https://github.com/geodesystems/ramadda/issues/6#issuecomment-2904943210

Thanks Jeff!

I was able to add an s3 entry with one of our endpoints and it listed out the files in the S3 bucket. I did encounter en error when trying to download a file:

Error processing tag: {{embed as="file" maxheight="600" maxSize="10000" }}The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null)

com.amazonaws.services.s3.model.AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: RVJS6PG2XSY6G7NX; S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E=; Proxy: null), S3 Extended Request ID: jc3iigcOeWnCMHioDffYhxSlbAslSxKL+FyjtCMpEP9W3KEcHYqnmlI52SeeBLYlqNDspryrJ3E= at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755) at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715) at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561) at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5456) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5403) at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5397) at com.amazonaws.services.s3.AmazonS3Client.listObjectsV2(AmazonS3Client.java:971) at org.ramadda.util.S3File.copyFileTo(S3File.java:528) at org.ramadda.util.S3File.copyFileTo(S3File.java:549) at org.ramadda.repository.StorageManager.getEntryFile(StorageManager.java:2007) at org.ramadda.repository.StorageManager.getEntryResourcePath(StorageManager.java:1982) at org.ramadda.repository.output.WikiManager.getWikiIncludeInner(WikiManager.java:2949) at org.ramadda.repository.output.WikiManager.my_getWikiInclude(WikiManager.java:1405) at org.ramadda.repository.output.WikiManager.handleWikiImport(WikiManager.java:7733) at org.ramadda.repository.output.WikiManager.getWikiPropertyValue(WikiManager.java:408) at org.ramadda.util.WikiUtil.handleProperty(WikiUtil.java:3664) at org.ramadda.util.WikiUtil.wikifyInner(WikiUtil.java:3345) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:352) at org.ramadda.util.WikiUtil.wikify(WikiUtil.java:325) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:565) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:543) at org.ramadda.repository.output.WikiManager.wikifyEntry(WikiManager.java:462) at org.ramadda.repository.output.HtmlOutputHandler.handleDefaultWiki(HtmlOutputHandler.java:462) at org.ramadda.repository.output.HtmlOutputHandler.getHtmlResult(HtmlOutputHandler.java:411) at org.ramadda.repository.output.HtmlOutputHandler.outputEntry(HtmlOutputHandler.java:377) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1519) at org.ramadda.repository.EntryManager.processEntryShow(EntryManager.java:1005) at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.ramadda.repository.ApiMethod.invoke(ApiMethod.java:181) at org.ramadda.repository.Repository.getResult(Repository.java:3651) at org.ramadda.repository.Repository.handleRequestInner(Repository.java:3272) at org.ramadda.repository.Repository.handleRequest(Repository.java:3143) at org.ramadda.repository.server.RepositoryServlet.doGet(RepositoryServlet.java:242) at javax.servlet.http.HttpServlet.service(HttpServlet.java:687) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.lang.Thread.run(Thread.java:750)

I'm looking to see if there's anything on our end that would interfere.

— Reply to this email directly, view it on GitHub https://github.com/geodesystems/ramadda/issues/6#issuecomment-2904943210, or unsubscribe https://github.com/notifications/unsubscribe-auth/AANCOTY5CORSYGKUV26ROK3275A3PAVCNFSM6AAAAAB5WXIJJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDSMBUHE2DGMRRGA . You are receiving this because you commented.Message ID: @.***>

jeffmcwhirter avatar May 23 '25 23:05 jeffmcwhirter