velox icon indicating copy to clipboard operation
velox copied to clipboard

Remove connector factory registrations

Open majetideepak opened this issue 11 months ago • 10 comments

We must register connector factories in the client and not in the Velox library.

majetideepak avatar Feb 27 '24 14:02 majetideepak

Deploy Preview for meta-velox canceled.

Name Link
Latest commit c804611c95925907bc4082a343b930855b7c5b2d
Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/66e45270801886000832f0f0

netlify[bot] avatar Feb 27 '24 14:02 netlify[bot]

@mbasmanova This work was motivated by our discussion here https://github.com/facebookincubator/velox/pull/8765#discussion_r1504212279 where I was trying to add aliases support for a connector factory. However, I realized the HiveConnectorFactory has a constructor that accepts a name for the connector factory and therefore, we don't need the aliases support for the HiveConnectorFactory. But from a Velox library standpoint, we should not be registering the factories in the library. This PR achieves that.

majetideepak avatar May 09 '24 20:05 majetideepak

@czentgr I addressed your comments. This would be a breaking change. After this lands, we will add the registrations in Prestissimo. I also plan to update the Velox Slack channel.

majetideepak avatar May 10 '24 16:05 majetideepak

This would change how externals interact with Velox - as in they need to define the connector factories to be used.

External users have to explicitly register the connector factories. This is similar to any other Velox component say functions. No need to define connector factories.

majetideepak avatar May 10 '24 16:05 majetideepak

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 17 '24 17:05 facebook-github-bot

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 17 '24 20:05 facebook-github-bot

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 20 '24 16:05 facebook-github-bot

@kgpai Any update on this? Thanks!

majetideepak avatar May 31 '24 01:05 majetideepak

Hi Deepak, Please give me a day or so , hoping to land it soon.

kgpai avatar May 31 '24 07:05 kgpai

Spoke with Krishna and he found this PR breaks Presto Native, he sent details to Deepak offline, I'm going to remove the ready-to-merge tag until that's addressed

kevinwilfong avatar Jun 10 '24 17:06 kevinwilfong

@majetideepak Can you fix conflicts , should be good to merge after that..

kgpai avatar Aug 16 '24 17:08 kgpai

@kgpai this is ready. Can you please import? Thanks.

majetideepak avatar Aug 20 '24 15:08 majetideepak

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar Aug 20 '24 17:08 facebook-github-bot

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar Aug 26 '24 22:08 facebook-github-bot

@kgpai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar Sep 13 '24 14:09 facebook-github-bot

@kgpai merged this pull request in facebookincubator/velox@74a0db903f92179e3abcf4760e4a46ad5dba331c.

facebook-github-bot avatar Oct 11 '24 17:10 facebook-github-bot

Conbench analyzed the 1 benchmark run on commit 74a0db90.

There was 1 benchmark result indicating a performance regression:

The full Conbench report has more details.

conbench-facebook[bot] avatar Oct 11 '24 17:10 conbench-facebook[bot]