feathr

feathr copied to clipboard

UI: not able to fully log out

1

Repro steps 1. Login Feathr UI 2. Click logout button 3. Wait till logout complete, if prompted for confirming which account to logout, selected current logged in one. 4. Fresh...

blrchen

ADLS/WASB/S3 enabled configurations are not honored

4

Currently we have configurations in the YAML file to configure whether users use ADLS/WASB/S3 to ingest offline stores etc. However they are not honored (i.e. Feathr will still try to...

xiaoyongzhu

Here's the code to repro: For the code below, put in the right value for `DATABRICKS_WORKSPACE_TOKEN_VALUE`. Then run the whole code. ``` from feathr import AvroJsonSchema from feathr import KafKaSource...

xiaoyongzhu

xiaoyongzhu

As the Registry Service become more complex, we need to have a centralized module to deal with all exceptions that Registry API would raise.

Yuqing-cat

Update databricks sample

1

xiaoyongzhu

Currently Feathr is using cloud based spark service (Azure synapse/Databricks) as runtime, and adding on-prem spark should be straightforward by adding an additional launcher here: https://github.com/linkedin/feathr/tree/main/feathr_project/feathr/spark_provider

xiaoyongzhu

Currently Feathr supports databricks on AWS; however it doesn't support EMR as a spark launcher.

xiaoyongzhu

Add docs for AWS deployment.

2

xiaoyongzhu

Allow `OUTPUT_PARALLELISM` and `OVERWRITE_MODE` in join output

2

Seems it's not honored per this line: https://github.com/linkedin/feathr/blob/main/src/main/scala/com/linkedin/feathr/offline/generation/SparkIOUtils.scala#L21

xiaoyongzhu