Adam Struck

Results 87 comments of Adam Struck

@kmhernan funnel does not modify the URIs that are given to it. That `null` must be coming from bunny.

@milos-ljubinkovic @kmhernan I am working on extending our s3 support. I am hoping to get a PR up by tomorrow that you could test.

@kmhernan @milos-ljubinkovic -> https://github.com/ohsu-comp-bio/funnel/pull/356 As I note in the PR there are still some outstanding issues I need to address. But this should unblock further testing / development.

@milos-ljubinkovic funnel was updated to use the new [TES v0.3 spec](https://github.com/ga4gh/task-execution-schemas/releases/tag/v0.3) recently. To use these new features we will need to update the TES model in bunny. Let me know...

The config isn't correct. Please look at the new docs: https://github.com/adamstruck/funnel/blob/3370b1df2271886e56a9a883535aea196592f408/website/content/docs/storage/aws-s3.md Sorry about the confusing config structure. It's something we are working on.

The config isn't propagated to the worker node unless there is a shared file system. You can put the config on the worker and modify the submit template to point...

Scatter seems to be working for me. Whether or not all tasks are started simultaneously is determined by the pool size which can now be configured (`rabix.tes.task-thread-pool-size`).

> I'm guessing this is abandoned. I do not have any plans to work on this again. It was only ever a proof-of-concept. Feel free to fork the repo.

I assume this is due to one of these PRs: https://github.com/cube-js/cube/pull/6019 https://github.com/cube-js/cube/pull/8158

I only set `CUBESTORE_AWS_CREDS_REFRESH_EVERY_MINS`. The credentials used to be picked up automatically from the pod / instance. We have been running various versions of cube for the past year and...