azure-kusto-python icon indicating copy to clipboard operation
azure-kusto-python copied to clipboard

Fetching a large dataset more tha 64MB, returns None to execute function.

Open naman-shah-2829 opened this issue 1 year ago • 1 comments

When I am using the execute() function to fetch data from the Kusto using python, if the response is more than 64MB, it returns me None rather than returning partial data how it does in ADX. I dont want to use the notruncation method as it can lead the dead kernel situations. Is there any other way where I can receive the partial data ?

naman-shah-2829 avatar May 13 '24 07:05 naman-shah-2829

You can use streaming query to get the results as they arrive-

            result = client.execute_streaming_query(self.test_db, self.streaming_test_table_query + ";" + self.streaming_test_table_query)
            for primary in result.iter_primary_results():
                for row in primary:
                    # work on rows

AsafMah avatar May 19 '24 12:05 AsafMah

Closing, feel free to open with a comment.

AsafMah avatar Jun 23 '24 10:06 AsafMah