DrMaphuse

Results 18 comments of DrMaphuse

Add support for pyarrow Table and/or polars DataFrame

Surprisingly, polars Series seem to work out of the box, as you write in your workaround. I am curious how this is possible.

read_csv slow (single threaded) on large delimited file

Just chiming in to say that I, too, am struggling with this issue. Although I have tried extensively, I am currently unable to create a sample dataset that reproduces this...

Add a `.parse_str()` method that acts like `read_csv()` on DataFrames

Yes, that would be one way to do it. Another would be `pl.when().then()`. My request refers more to the out-of-the-box capabilities of `cast` when it comes to standard scenarios like...

Add a `.parse_str()` method that acts like `read_csv()` on DataFrames

I get your point. It would still be extremely useful to have a way to programatically access the "smart" string parsing functionalities of the csv reader - even if we...

Add a `.parse_str()` method that acts like `read_csv()` on DataFrames

I use Polars for automated data pipelines and often need to convert data ingested in string format into known schemata. If I were to round-trip the data to CSV, it...

Add a `.parse_str()` method that acts like `read_csv()` on DataFrames

### Utility of a csv-equivalent `.parse_str()` method I am going to try to add a little more detail to my suggestion here after thinking about it. What I am suggesting...

'n_rows' not respected in reading / scanning .csv files

It looks like you are reading from a local directory, but it's worth noting that some filesystems that are commonly used for remote storage don't allow partial file reads. Specifically,...

Implement `.get_column()` for LazyFrames (i.e. Lazy Series)

You are correct in that my use case could be covered with a join (or anti-join). I still think that it would be useful to have this functionality, since it...

Cannot create Hyper Files on mounted webdav volumes despite full write permission.

Sure! Can you narrow it down to specific sections of the log? As it is, the log contains some sensitive information, which means that I can't put it online. Edit:...

Recognize integer timestamps when `dtypes=pl.Datetime` is passed to `read_csv`

> IMO the csv parser should parse the data as is. I don't see this as a contradiction. Timestamps are de facto integers in [arrow](https://arrow.apache.org/docs/python/timestamps.html): > Arrow timestamps are stored...