lithops
lithops copied to clipboard
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
This would help reduce friction when getting started since there would be no need to install docker, and it would avoid a large upload (multi-GB potentially). Is this something that...
Hi I am running lithops with code engine. I set `runtime_timeout` and `execution_timeout` in the cofig to be both 21600 seconds (6 hours). But the `execution_timeout` will be always set...
Hi Is there a implementation of Lithops with FastApi ?
Very cool project! Am excited to play with it :) I'm trying to set this up with GCP, on a kubernetes cluster with [workload identity](https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity) setup to provide GCP IAM...
Currently the following code fails on pickle when trying to invoke the pool.map from inside of the map function ``` #!/usr/bin/python import lithops import multiprocessing def mult(val): print(val) return val...
Hello, I've created a JSON Schema v4 which is compatible with the current Lithops YAML configuration file. Hopefully this will help a lot of new users with the initial setup...
Recently, I have been seeing frequent HTTP 409 errors when processing data in bulk. I spoke with the IBM customer support to clarify where the source of the problem is...
When trying to debug which modules are being transmitted, setting ``` lithops: log_level: DEBUG ``` doesn't show any messages from `ModuleDependencyAnalyzer`. This doesn't seem to work either (in an example...
I have found it very useful to use [Fil](https://pythonspeed.com/fil/docs/index.html) for finding the peak memory use of functions running on Lithops. The way I got it to work was to change...
I have encountered an issue with the repo where the code stops working as expected starting from commit e636cde6adf695f7990096c43e8694c41d36eac9. I haven't been able to locate what is causing the problem....