geoHeil

Possible duplicate of https://github.com/eirslett/frontend-maven-plugin/issues/430

No Davide Cavarretta schrieb am Di. 8. Mai 2018 um 09:11: > @geoHeil have you solved this problem? > > — > You are receiving this because you were mentioned....

What about simply replacing pandas with koalas? https://github.com/databricks/koalas? Maybe it is worth a shot?

https://github.com/databricks/koalas/issues/1028

https://koalas.readthedocs.io/en/latest/user_guide/options.html#default-index-type After setting `ks.set_option('compute.default_index_type', 'distributed')` it is still slow and the window function is being used

https://openmetadata.slack.com/archives/C02B6955S4S/p1659636703811829 The orm profiler is failing for one table for me: ``` TypeError: __init__() missing 1 required positional argument: 'item_type' File "site-packages/metadata/orm_profiler/api/workflow.py", line 221, in execute profile_and_tests: ProfilerResponse = self.processor.process(...

Ideally, you could parse the CRS attribute from it as well.

https://openmetadata.slack.com/archives/C02B6955S4S/p1659539501092759?thread_ts=1659537963.701169&cid=C02B6955S4S DBT`s `schema.yaml` which is defining documentation around column metadata does not seem to be imported as well. I think this would be most important to get these semantics imported.

One more great missing integration is `dbt test`. Ideally, one does not need to define additional tests in OpneMetadata - rather the ones from DBT can be integrated.

This could be a first start in understanding the PG query log schema: ``` import pandas as pd df = pd.read_csv('path/to/pg_log/postgresql-fixed.csv', header=None) ``` https://www.postgresql.org/docs/current/runtime-config-logging.html#RUNTIME-CONFIG-LOGGING-CSVLOG ``` CREATE TABLE postgres_log ( log_time...