DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

[Feature Request]: <Provide ML features that augment automated data processing into BigQuery/BigTable>

Open allamsudha opened this issue 1 year ago • 0 comments

Related Template(s)

All templates

What feature(s) are you requesting?

AI Integration:

  1. Natural key determination as the data being read for the first time utilizing AI is ideal. This is a good use case for data integration and cleansing. A report as to what combinations match the % of rows/messages agree, illustrates the glitches in the modeling and source systems. It aids customers to correct source systems so that linearity in data integration could be obtained. (T) in ETL removal gradually enhances the Enterprise outlook in many different ways.

  2. Another use case for AI integration would be Entity Resolution. For example, take the case of the Chronicle Google product which has all customers data in one table. One can functionally normalize the data and AI would recommend for better clustering and partitioning on BigQuery and other storages. Recommendations could be in the form of statistics presented depicting the likely hood of compressing the distance between the non homogeneity of different enterprise datasets and the methods thereof.

allamsudha avatar Apr 12 '24 11:04 allamsudha