ahern88

Results 15 comments of ahern88

> pika_migrate版本,我记得是支持多db的 好的,我试下,我看文档([pika_migrage.md](https://github.com/OpenAtomFoundation/pika/blob/v3_2_7_migrate/pika-migrate.md))说不支持多db > 注意事项 > Pika支持不同数据结构采用同名Key, 但是Redis不支持, 所以在有同Key数据的场景下, 以第一个迁移到Redis数据结构为准, 其他同Key数据结构会丢失 > 该工具只支持热迁移单机模式下, 并且只采用单DB版本的Pika, 如果是集群模式, 或者是多DB场景, 工具会报错并且退出. > 为了避免由于主库Binlog被清理导致该工具触发多次全量同步向Redis写入脏数据, 工具自身做了保护, 在第二次触发全量同步时会报错退出.

@kernelai 你好,单db下我同步没有问题,但是多db提示这个,请问是啥原因 `I0923 11:38:56.164340 5321 pika.cc:187] Server at: conf/pika.conf I0923 11:38:56.164978 5321 pika_server.cc:191] Using Networker Interface: ens192 I0923 11:38:56.165097 5321 pika_server.cc:234] host: 10.9.47.139 port: 9226 I0923 11:38:56.165114 5321 pika_server.cc:89] Worker...

@kernelai 请问下migrate这个版本为啥没有支持多db,是有啥考虑吗?如果自己去修改支持多db有没有需要注意的地方

> 你好 请问下 你们用的codis+pika 模式,slot 数量用的默认的1024吗?一共用了几台机器? 是的,1024够我们的业务场景了,现在遇到从单机迁移数据到集群模式的问题,你有啥办法吗

> > > > 我们目前的情况是想把codis 的数据迁移到pika,之前考虑过pika sharding模式,因为数据量没那么大,所以就几台机器,但是得配合codis1024个slot,这样相当于每台机器就要上百个slot,而pika一个slot 就要起5个roksdb实例,对于一台机器来说好像压力比较大。不知道你们有没有类似的问题。 刚看到消息,我修改了codis和pika的默认slot,我5台物理机,将slot修改为了128,目前运行下来比较稳定,最开始使用1024个slot,性能很差,还经常timeout。

我也遇到了同样的问题,codis+pika性能非常差。

> > 奇怪,我这里好像是好的 ![image](https://github.com/openai-translator/openai-translator/assets/4074609/3008215d-e945-48b9-9740-27e3b63e0881)

就是针对这个问题的修复, [[Bug] Not working while using ChatGPT(Web) #1288](https://github.com/openai-translator/openai-translator/issues/1288)

> ![动画](https://private-user-images.githubusercontent.com/33274390/305776169-f57dac0f-1336-4564-8f58-eca5199199cb.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDgzMTE4NzMsIm5iZiI6MTcwODMxMTU3MywicGF0aCI6Ii8zMzI3NDM5MC8zMDU3NzYxNjktZjU3ZGFjMGYtMTMzNi00NTY0LThmNTgtZWNhNTE5OTE5OWNiLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjE5VDAyNTkzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA0MDc5MjE1YWY1ZTg1NzRhNzgyMTVkNzc5MDc3MmMzMjdhNDM4NmM1YTEzOWMyNzE5NWU5OTMxZWRkYTdmODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.SA5hIlPAfFl2a0kgvtT6Vkc2rX2PrfBDNRGJxxWf8rQ) [ ![动画](https://private-user-images.githubusercontent.com/33274390/305776169-f57dac0f-1336-4564-8f58-eca5199199cb.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDgzMTE4NzMsIm5iZiI6MTcwODMxMTU3MywicGF0aCI6Ii8zMzI3NDM5MC8zMDU3NzYxNjktZjU3ZGFjMGYtMTMzNi00NTY0LThmNTgtZWNhNTE5OTE5OWNiLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjE5VDAyNTkzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA0MDc5MjE1YWY1ZTg1NzRhNzgyMTVkNzc5MDc3MmMzMjdhNDM4NmM1YTEzOWMyNzE5NWU5OTMxZWRkYTdmODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.SA5hIlPAfFl2a0kgvtT6Vkc2rX2PrfBDNRGJxxWf8rQ) ](https://private-user-images.githubusercontent.com/33274390/305776169-f57dac0f-1336-4564-8f58-eca5199199cb.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDgzMTE4NzMsIm5iZiI6MTcwODMxMTU3MywicGF0aCI6Ii8zMzI3NDM5MC8zMDU3NzYxNjktZjU3ZGFjMGYtMTMzNi00NTY0LThmNTgtZWNhNTE5OTE5OWNiLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjE5VDAyNTkzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA0MDc5MjE1YWY1ZTg1NzRhNzgyMTVkNzc5MDc3MmMzMjdhNDM4NmM1YTEzOWMyNzE5NWU5OTMxZWRkYTdmODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.SA5hIlPAfFl2a0kgvtT6Vkc2rX2PrfBDNRGJxxWf8rQ) [ ](https://private-user-images.githubusercontent.com/33274390/305776169-f57dac0f-1336-4564-8f58-eca5199199cb.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDgzMTE4NzMsIm5iZiI6MTcwODMxMTU3MywicGF0aCI6Ii8zMzI3NDM5MC8zMDU3NzYxNjktZjU3ZGFjMGYtMTMzNi00NTY0LThmNTgtZWNhNTE5OTE5OWNiLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjE5VDAyNTkzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA0MDc5MjE1YWY1ZTg1NzRhNzgyMTVkNzc5MDc3MmMzMjdhNDM4NmM1YTEzOWMyNzE5NWU5OTMxZWRkYTdmODAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.SA5hIlPAfFl2a0kgvtT6Vkc2rX2PrfBDNRGJxxWf8rQ) 这就不太科学了,我试了好多次是不行的。然后看了下代码,发现老的方式是使用Server-sent Events方式与chatgpt交互,而新的网页版采用了websocket,所以我将实现改成了websocket

我修改了MaxSlotNum,同时也修改了页面上的几个地方后重新编译OK,没发现啥问题