captify-sivakhno

[BUG] Can't access Unity Catalogue data on Databricks AWS cluster

3

**Describe the bug** I have set up RAPIDS on Databricks AWS cluster (runtime 12.2.x-gpu-ml-scala2.12) as described in https://docs.nvidia.com/spark-rapids/user-guide/23.12.2/getting-started/databricks.html I then trying to read delta lake on the Unity Catalogue (we...

SparkNLP Embeddings inference 3X slower than with pandas_udf

3

### Is there an existing issue for this? - [X] I have searched the existing issues and did not find a match. ### Who can help? _No response_ ### What...

[Performance]: TTFT increases linearly with the number of batched tokens

2

### Proposal to improve performance I have observed that TTFT increases linearly with a total number of batched tokens. For example, given 100k batch - TTFT is around 2min when...

context-free grammars example does not work with vLLM integration

6

### Describe the issue as clearly as possible: When running provided arithmetic grammar example with vLLM, I get an error `TypeError: Error in model execution: argument 'ids': 'list' object cannot...