data-diff icon indicating copy to clipboard operation
data-diff copied to clipboard

TypeError while running data-diff between MySQL and Snowflake via python api

Open srik1981 opened this issue 1 year ago • 4 comments

Describe the bug Trying to run data-diff with min_key=[0] and max_key=[10000] via python, running into the following exception -

<[TableSegment] Attribute 'min_key' expected value of type (NoneType+Vector). Instead got [0]>

code block within python file with the error - for row in data_diff.diff_tables(source_con, target_con, bisection_factor=100, min_key=[0], max_key=[10000]):

Exception -

        <[TableSegment] Attribute 'min_key' expected value of type (NoneType+Vector). Instead got [0]>
        <class 'TypeError'>

Describe the environment

Python 3.9.12 data-diff==0.7.8 mysql-connector-python==8.0.29

This was run on Mac with the Apple M1 Pro Chip running macOS Ventura 13.4.

srik1981 avatar Jun 08 '23 18:06 srik1981

Hi @srik1981 thanks for reporting this, what was the column type of the key column?

dlawin avatar Jun 23 '23 20:06 dlawin

relates to https://github.com/datafold/data-diff/issues/603

dlawin avatar Aug 11 '23 16:08 dlawin

Hi @srik1981, any chance you could share the column type of the key column?

leoebfolsom avatar Sep 07 '23 20:09 leoebfolsom

Hi @srik1981, any chance you could share the column type of the key column?

Integer I believe

srik1981 avatar Sep 10 '23 23:09 srik1981

Hi @srik1981,

I'm sorry for the delay in following up on this. Thank you for taking the time to raise this issue!

We made a hard decision to sunset the data-diff package and won't provide further development or support.

If that's of interest, over the past few months, we have rewritten the diffing engine in Datafold Cloud and solved many issues that existed in this package's diffing algorithm.

-Gleb

glebmezh avatar May 17 '24 13:05 glebmezh