amoro

amoro copied to clipboard

[IMPROVEMENT]AMS using too much memory

1

When the AMS starts, it will use 400-500MB memory. When execute first sql in AMS Dashboard, MEM usage will rise to about 1GB. After writing some datas, then execute select...

HuangFru

## Why are the changes needed? Add getTables function for improve performance in production environment as described in issue #233 ## Brief change log 1. add getTables function to arctic_table_metastore.thrift...

hhippodnsla

### Description Supporting Pulsar as a new type for Logstore ### Use case/motivation Arctic support Kafka as its Logstore type only now. We should support Pulsar too. ### Describe the...

zhoujinsong

### Description Supporting RocketMQ as a new type for Logstore ### Use case/motivation Arctic support Kafka as its Logstore type only now. We should support RocketMQ too. ### Describe the...

zhoujinsong

### Description AMS terminal use Kyuubi as its backend sql engine ### Use case/motivation AMS terminal use a embedded spark client as its SQL engine now. When user use termial...

zhoujinsong

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?page=4&q=is%3Aissue) and found no similar issues. ### What would you like to be improved? In the production environment, there...

hhippodnsla

[IMPROVMENT] AMS does not support to create table under the Sentry managed dir

2

Precondition: Installed a hive with sentry permission controlled. Also, the user didn't have root permission for hive warehouse dir. Phenomenon: When user try to create a table with new database,...

hhippodnsla

[Flink] An unstable UT: testMultiParallelismFailoverConsistencyRead(HiddenLogOperatorsTest) FAILURE!

1

Running com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest 22/08/2022 03:38:37.184 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:38:37.184 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] Starting KafkaTestBase 22/08/2022 03:38:37.185 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:38:37.187 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] Starting KafkaTestBase.prepare() for Kafka 2.0 22/08/2022 03:38:38.362 INFO...

YesOrNo828

[Subtask]: Store watermark in the snapshot level

1

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues. ### Description Currently, the watermark is stored in table properties, which makes it...

wangtaohz

[AMORO-2002][DOC]: Introduce the Lookup Join with mixed-format table via Flink

2

## Why are the changes needed? Close #2002. ## Brief change log - Add Introduce the Lookup Join with mixed-format table via Flink ## How was this patch tested? -...

czy006