conduit

conduit copied to clipboard

The MonadUnliftIO instance of ResourceT makes it incredibly tricky to use with threads

5

I was using MonadUnliftIO so I could easily parallelise functions by running them in multiple threads, but after a refactoring to use more parallelism I've started noticing some errors from...

merijn

Improving docs about lines processing

1

As a conduit **and** haskell newbie, I'm having problems understanding how conduit should be used processing text file one line at a time. I'm going to list the things that...

wfranzini

So, I admit I haven't looked at the code of `process` and the GHC runtime enough to be sure, but as far as I can tell `withCheckedProcessCleanup` calls `terminateProcess` to...

merijn

CP.sourceProcessWithStreams with stdin will raise exception if process ends

1

I'm not sure if this is a bug or just undocumented behaviour, but the following will raise an exception: CP.sourceProcessWithStreams (proc "false" []) (CC.yieldMany ["Hello", "World"]) CL.consume CL.consume See full...

luispedro

Consume items in batch, instead of one by one

1

Hi, I have a situation like the one outlined in the image below, where my producer feeds Products to a function that queries a database for some information about them....

mnecochear

Proposal: a yieldMany variant that returns the last element

1

I often use conduit for converting paginated systems into providing a flat stream of elements. Typically I need to get the last element of a page and pull the appropriate...

iand675

Conduit's internal Pipe is eating my RAM

6

Here's an interesting space leak that we have discovered after switching to `lts-11` (and `conduit-1.3`). ### Background We have a sync job that requests a big XML file over HTTP,...

zudov

Principled Treatment of sinkHandle etc.

3

It seems the variety of I/O functions exposed is a little ad-hoc. Consider sinkHandle, it has an IO variant, a cautious variant, a Builder variant, a Flush variant, but only...

m00ngoose

Peformance: mapM_ is very inefficient

6

I have been struggling with why conduit performance results are out of the whack in these benchmarks https://github.com/composewell/streaming-benchmarks. I have root caused the issue to `mapM_` to discard the stream....

harendra-kumar

Process conduits hang because child process stdin is buffered

7

I wrote an application based on https://github.com/snoyberg/conduit/blob/829195895420b90dc7daa393d4178da4141e22ed/PROCESS.md and `conduit-extra-1.2.3.2`. It talks to `ghci`, submitting it input commands like `:reload`. If found it not to work: With `input` looking like this:...

nh2