Marcin Nowak

Results 34 comments of Marcin Nowak

Oh, and I didn't tested the slicer. Please treat this as a some idea, not a target implementation.

> Nice addition. > > I am currently working on a small framework called Expressions: > > https://github.com/Stiivi/expressions > > Great! I'll check it. > > That parses simple arithmetic...

> Why don't Python nerds need to ETL? Maybe they have custom solutions, like me. The most important thing is parallelism, jobs scheduling and execution, a possibility to track issues...

I didn't know about Luigi when I was starting work with ETLs. I created something similar to this, but way limited - without dependency handling, parallelism only within a run()...

I can try to do something with the app. I have limited time, so my commits can be rare. I'll fork the repo and do some initial code cleaning.

Possibly this is related to Django and accessing db in threads. Sorry disturbing you.

I've moved accessing db to main thread, but the issue exists, so I'm reopening.

It's possible that horse is killed when long redis operation is executing. After digging the code I've found that ThreadPoolExecutor was swallowing exceptions. Probably something was crashing but no exception...