wulei

Results 9 comments of wulei

> 目前刚刚整合,出现比较严重的问题就是聚合性能问题,请问您是怎么调整优化的? 场景:新建app浏览量图表(按用户汇总),开启聚合功能、视图缓存 问题:直接执行sql的平均耗时都是接口响应平均耗时的一半(目前浏览表有百万数据) ![image](https://private-user-images.githubusercontent.com/37392285/365858221-d823e0f7-65e4-4477-b7cc-8ea4b1e7b4e8.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU5NjE2OTQsIm5iZiI6MTcyNTk2MTM5NCwicGF0aCI6Ii8zNzM5MjI4NS8zNjU4NTgyMjEtZDgyM2UwZjctNjVlNC00NDc3LWI3Y2MtOGVhNGIxZTdiNGU4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTEwVDA5NDMxNFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRlYTM2YzQxZGVjODRmMjhjY2Q0ZmFlNjlmMGRmMDM0ZDU1MTNmOTc4YjY0YzQ0YzgyNWY1N2YxZGRjZjRjM2QmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.csYMvwMQUTO-LPc5_z3eiZdks9fKPfi5N6fOWU-kndg) 请教:您或您的团队是如何解决这个性能问题的(目前 还不考虑升级服务器) @Wesilnt 我们实现了物化视图的能力,能显著提高性能,不过对应的技术难点和流程复杂度会提高很多

> 强,你们这是迭代了多长时间 datart刚开源我们就跟着了

> > > 目前刚刚整合,出现比较严重的问题就是聚合性能问题,请问您是怎么调整优化的? 场景:新建app浏览量图表(按用户汇总),开启聚合功能、视图缓存 问题:直接执行sql的平均耗时都是接口响应平均耗时的一半(目前浏览表有百万数据) ![image](https://private-user-images.githubusercontent.com/37392285/365858221-d823e0f7-65e4-4477-b7cc-8ea4b1e7b4e8.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU5NjE2OTQsIm5iZiI6MTcyNTk2MTM5NCwicGF0aCI6Ii8zNzM5MjI4NS8zNjU4NTgyMjEtZDgyM2UwZjctNjVlNC00NDc3LWI3Y2MtOGVhNGIxZTdiNGU4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTEwVDA5NDMxNFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRlYTM2YzQxZGVjODRmMjhjY2Q0ZmFlNjlmMGRmMDM0ZDU1MTNmOTc4YjY0YzQ0YzgyNWY1N2YxZGRjZjRjM2QmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.csYMvwMQUTO-LPc5_z3eiZdks9fKPfi5N6fOWU-kndg) 请教:您或您的团队是如何解决这个性能问题的(目前 还不考虑升级服务器) @Wesilnt > > > > > > 我们实现了物化视图的能力,能显著提高性能,不过对应的技术难点和流程复杂度会提高很多 > > 确实是比较复杂。 请问您是使用的什么数据库?目前我这还是mysql,没有对物化视图的支持,我想参考下,看看是换数据库还是通过其它手段在mysql实现物化视图? 支持的数据库还挺多,但是能物化的数据库只有impala

> 贡献出来? 改动太多了,已经朝着私有项目奔跑俩年了,不适合开源了……

> > 官方已经停止迭代了,大家自行维护的自定义报表迭代成什么样子了呢? 首先,十分感谢官方开源,替我们走出了重要的第一步。 简单说一下我们的。 可视化: 编辑和预览合为一体,不需要多次跳转和加载了,性能和值控制等都有很多迭代 ![image](https://private-user-images.githubusercontent.com/27821997/364718332-273b30b7-09a8-45f1-95b7-1881d966b878.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTgzMzItMjczYjMwYjctMDlhOC00NWYxLTk1YjctMTg4MWQ5NjZiODc4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNmMzZkOWQyYjlmZmI0MmUyMjk0MWRmY2U4MjQ2ZTJmM2RkNGRkYTA1MjhmYTc5N2UzMDYxOWRhNDQ0MDQyN2YmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Dfj1AgekhpUE32Avd9wWhWzVoht2EbBf0PKTcTQwZNM) > > 增加了一种新的图表类型-group,增强了图表跳转能力 ![image](https://private-user-images.githubusercontent.com/27821997/364720830-c80966e3-27ba-4e1a-b643-45eab861c350.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MjA4MzAtYzgwOTY2ZTMtMjdiYS00ZTFhLWI2NDMtNDVlYWI4NjFjMzUwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNkNzUxN2RiN2FmOTIyYTIwOTkxODY5NjFlODViYzc1OGRiNjU2ZTc5ZDU1MjA0YTA0ZGFhNWMyYmYzOWUzNmEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.fpmYbcIKlBxpuJHh6WnporZKeZXk67eQtc9NfyXyRts) > > 数据: 物化视图(缓存数据,加快访问),变更追踪(数据比对,显示差异样式) ![image](https://private-user-images.githubusercontent.com/27821997/364719645-59729b06-8f0d-4f0b-9478-28c68050b103.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTk2NDUtNTk3MjliMDYtOGYwZC00ZjBiLTk0NzgtMjhjNjgwNTBiMTAzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNiNWJkYTNiYWNlNzcxMTA0MzgwNTk5NjYwODY3MzE4MDI4OWIyOTVkZjFiMmRiNjdjOTY2OWQwMDNlNTY3NTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.eTa7W2J50bmC_zolMEdzOCqCPKkwB0ttatV9RG8wBtA) > > 接口请求: 缓存、可取消等 > > AI: done:AI分析图表和报表、操作和用户手册指引。待开发:AI生成变量、AI生成SQL、AI生成图表 > > 其余功能都有很多优化,不一一列举 > >...

> > 官方已经停止迭代了,大家自行维护的自定义报表迭代成什么样子了呢? 首先,十分感谢官方开源,替我们走出了重要的第一步。 简单说一下我们的。 可视化: 编辑和预览合为一体,不需要多次跳转和加载了,性能和值控制等都有很多迭代 ![image](https://private-user-images.githubusercontent.com/27821997/364718332-273b30b7-09a8-45f1-95b7-1881d966b878.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTgzMzItMjczYjMwYjctMDlhOC00NWYxLTk1YjctMTg4MWQ5NjZiODc4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNmMzZkOWQyYjlmZmI0MmUyMjk0MWRmY2U4MjQ2ZTJmM2RkNGRkYTA1MjhmYTc5N2UzMDYxOWRhNDQ0MDQyN2YmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Dfj1AgekhpUE32Avd9wWhWzVoht2EbBf0PKTcTQwZNM) > > 增加了一种新的图表类型-group,增强了图表跳转能力 ![image](https://private-user-images.githubusercontent.com/27821997/364720830-c80966e3-27ba-4e1a-b643-45eab861c350.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MjA4MzAtYzgwOTY2ZTMtMjdiYS00ZTFhLWI2NDMtNDVlYWI4NjFjMzUwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNkNzUxN2RiN2FmOTIyYTIwOTkxODY5NjFlODViYzc1OGRiNjU2ZTc5ZDU1MjA0YTA0ZGFhNWMyYmYzOWUzNmEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.fpmYbcIKlBxpuJHh6WnporZKeZXk67eQtc9NfyXyRts) > > 数据: 物化视图(缓存数据,加快访问),变更追踪(数据比对,显示差异样式) ![image](https://private-user-images.githubusercontent.com/27821997/364719645-59729b06-8f0d-4f0b-9478-28c68050b103.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTk2NDUtNTk3MjliMDYtOGYwZC00ZjBiLTk0NzgtMjhjNjgwNTBiMTAzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNiNWJkYTNiYWNlNzcxMTA0MzgwNTk5NjYwODY3MzE4MDI4OWIyOTVkZjFiMmRiNjdjOTY2OWQwMDNlNTY3NTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.eTa7W2J50bmC_zolMEdzOCqCPKkwB0ttatV9RG8wBtA) > > 接口请求: 缓存、可取消等 > > AI: done:AI分析图表和报表、操作和用户手册指引。待开发:AI生成变量、AI生成SQL、AI生成图表 > > 其余功能都有很多优化,不一一列举 > >...

已回复 ------------------ 原始邮件 ------------------ 发件人: ***@***.***>; 发送时间: 2024年12月28日(星期六) 下午4:06 收件人: ***@***.***>; 抄送: ***@***.***>; ***@***.***>; 主题: Re: [running-elephant/datart] [纯好奇]现在还有哪些公司在做自定义报表,做成什么样了 (Issue #2345) 官方已经停止迭代了,大家自行维护的自定义报表迭代成什么样子了呢? 首先,十分感谢官方开源,替我们走出了重要的第一步。 简单说一下我们的。 可视化: 编辑和预览合为一体,不需要多次跳转和加载了,性能和值控制等都有很多迭代 增加了一种新的图表类型-group,增强了图表跳转能力 数据: 物化视图(缓存数据,加快访问),变更追踪(数据比对,显示差异样式) 接口请求: 缓存、可取消等 AI: done:AI分析图表和报表、操作和用户手册指引。待开发:AI生成变量、AI生成SQL、AI生成图表...

> > > > 官方已经停止迭代了,大家自行维护的自定义报表迭代成什么样子了呢? 首先,十分感谢官方开源,替我们走出了重要的第一步。 简单说一下我们的。 可视化: 编辑和预览合为一体,不需要多次跳转和加载了,性能和值控制等都有很多迭代 ![image](https://private-user-images.githubusercontent.com/27821997/364718332-273b30b7-09a8-45f1-95b7-1881d966b878.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTgzMzItMjczYjMwYjctMDlhOC00NWYxLTk1YjctMTg4MWQ5NjZiODc4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNmMzZkOWQyYjlmZmI0MmUyMjk0MWRmY2U4MjQ2ZTJmM2RkNGRkYTA1MjhmYTc5N2UzMDYxOWRhNDQ0MDQyN2YmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Dfj1AgekhpUE32Avd9wWhWzVoht2EbBf0PKTcTQwZNM) > > > > 增加了一种新的图表类型-group,增强了图表跳转能力 ![image](https://private-user-images.githubusercontent.com/27821997/364720830-c80966e3-27ba-4e1a-b643-45eab861c350.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MjA4MzAtYzgwOTY2ZTMtMjdiYS00ZTFhLWI2NDMtNDVlYWI4NjFjMzUwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNkNzUxN2RiN2FmOTIyYTIwOTkxODY5NjFlODViYzc1OGRiNjU2ZTc5ZDU1MjA0YTA0ZGFhNWMyYmYzOWUzNmEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.fpmYbcIKlBxpuJHh6WnporZKeZXk67eQtc9NfyXyRts) > > > > 数据: 物化视图(缓存数据,加快访问),变更追踪(数据比对,显示差异样式) ![image](https://private-user-images.githubusercontent.com/27821997/364719645-59729b06-8f0d-4f0b-9478-28c68050b103.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzUzNzM0NDMsIm5iZiI6MTczNTM3MzE0MywicGF0aCI6Ii8yNzgyMTk5Ny8zNjQ3MTk2NDUtNTk3MjliMDYtOGYwZC00ZjBiLTk0NzgtMjhjNjgwNTBiMTAzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMjI4VDA4MDU0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNiNWJkYTNiYWNlNzcxMTA0MzgwNTk5NjYwODY3MzE4MDI4OWIyOTVkZjFiMmRiNjdjOTY2OWQwMDNlNTY3NTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.eTa7W2J50bmC_zolMEdzOCqCPKkwB0ttatV9RG8wBtA) > > > > 接口请求: 缓存、可取消等 >...