Ishan Bhanuka

I have a specific use case where I want `n` records satisfying a filter condition. I don't really need the ability to paginate. Here's a **partial** workaround** for anyone who...

I'm facing a similar issue. I'm trying to run some of the weld tests using `cargo test --package weld --test binop_tests -- simple_binop --exact` but it's giving linking errors. ```...

In recent changes we've made `ParquetWriter` and `ParquetReader` generic over their underlying reader and writer. This serves two purposes: * Support reading and writing to both a file and memory...

The next step is to reduce the amount of Cython code by implementing logic as a pyo3 module.  We do this by moving the reader/writer logic and interface to...

Here's a high level picture of the current state. Firstly what is the source and sink of data. The source is a bunch of partitioned parquet files and the sink...

Yes datafusion or similar libraries will help with fully featured query/filtering without additional maintenance burden. Cython PyCapsule approach will have to stay for now, since we need to convert rust...

You're right this is a sore point with the datafusion library. Push down predicates aren't working well. However the good thing is the maintainers are aware of this and are...

Based on the guiding principles in #991 the catalog v2 is focusing on performance, usability and most importantly reduced maintenance burden. To that end this version aims to port the...

These are the structs for the query engine and query results implemented in #997. The structs also implement pyo3's pyclass and expose relevant python methods as well. The query engine...

Here's a test that demonstrates how this interface can be used. It can also be found in `test_catalog.rs`. ```rust use nautilus_model::data::tick::{Data, QuoteTick}; use nautilus_persistence::session::{PersistenceCatalog, QueryResult}; #[tokio::test] async fn test_quote_ticks() {...