Adding support for a new database?

[mjhittes]

We are evaluating DQOPS for implementing a data quality platform, but our database, OneTick, is not currently supported by DQOPS. The OneTick database offers a JDBC driver. A Python sqlalchemy package is also available, which in turn relies on the JDBC driver.

How do I add support for OneTick to DQOPS?

Thank you!

Mick Hittesdorf

[dqops]

DQOps uses JDBC connectors to access databases, which could make it work. For each database type, we create SQL queries for all supported data quality checks, which are defined as templated SQL queries. Typically, we pick a database that has the most similar SQL dialect, and we copy the templates of SQL queries. We also copy integration tests, adding another ~1000 tests to verify those queries. Because the integration tests load the same set of test data into each tested database, we can evaluate whether the queries can detect the same data quality issues.

Additionally, a few more changes are required:

• Add a dedicated connection screen to the UI
• Add a dedicated connector that knows how to build the JDBC connection string
• Add a dedicated specification class to store the connection parameters unique to that database
• A few small changes to add that database to the documentation publishing tool, the configuration section to support customization, and a few other small places.

If you are interested in the details, you can book a call using our Contact Us page.