huleilei

WIP: feat: implement Lance filter+count pushdown optimization

2

This commit implements filter+count joint pushdown optimization for Lance tables, significantly improving query performance for count queries with filter conditions. Key changes: - Enhanced push_down_aggregation.rs to support filter+count joint pushdown...

feat: add count() pushdown optimization in Iceberg datasource

3

## Changes Made Reference https://github.com/Eventual-Inc/Daft/pull/4969#event-19181860315 ， adds count pushdown optimization support to Iceberg data sources. But, for the MOR table, there are multiple delete operations, and calculating the number of...

Add Kafka Data Source Support for Streaming Data Processing

4

### Is your feature request related to a problem? Currently, Daft lacks native support for consuming data directly from Apache Kafka, which creates significant limitations for real-time data processing scenarios....

fix(autoscaling): add downscale support via idle worker retirement in…

1

… flotilla mode Root cause - Autoscaling only triggers scale-up when backlog ratio exceeds threshold, and RayWorkerManager enforces a monotonic upper bound (resource request must exceed historical max). - Daft...

TypeError Expected input to be a struct type, received: Python

11

### Describe the bug Now there is a scenario where text data is processed to generate tensor data with an accuracy of bfloat16. However, since bfloat16 is not supported in...