onyx icon indicating copy to clipboard operation
onyx copied to clipboard
verified publisher icon onyx-dot-app

Multi-Attach error

Open tpoxa opened this issue 2 years ago • 6 comments

I am trying to install danswer into kubernetes cluster. Problem that two different pods (api-server and background server) appear to be using the same volumes. Can this be omitted? Do they both have to write there or some service only read?

thanks

tpoxa avatar Jan 24 '24 23:01 tpoxa

Can you make use of RXW volumes?

voarsh2 avatar Jan 25 '24 14:01 voarsh2

@voarsh2 yes, we can use ReadWriteMany The easiest way of doing it in GCP is using of Filestore (managed NFS server)

Each PVC creates 1TB instance (minimal size allowed) of Filestore which is quite expensive. So why do we need two volumes? Can it be the same volume so danswer will just use different filesystem paths? Is it supported? Thanks.

tpoxa avatar Jan 25 '24 22:01 tpoxa

I see they are already using different mount paths

tpoxa avatar Jan 25 '24 22:01 tpoxa

@tpoxa did you manage to solve this without switching to ReadWriteMany?

al-lac avatar Apr 26 '24 10:04 al-lac

@tpoxa did you manage to solve this without switching to ReadWriteMany?

Nope @al-lac, we had to switch to RWX to solve this problem fast.

tpoxa avatar Apr 26 '24 12:04 tpoxa

Ah ok. For me it works if i scale everything up at the same time. But if one of the pods of api-server or background-server goes down, it cannot come back up.

al-lac avatar Apr 26 '24 13:04 al-lac