libpostal icon indicating copy to clipboard operation
libpostal copied to clipboard

Libpostal Memory consumption and memory allocation Configuration

Open nitinnitik opened this issue 2 years ago • 5 comments

Hi!

I was checking out libpostal, and saw something that could be improved.


My country is

India


Here's how I'm using libpostal

Using Libpostal to clearn the adresses in different format and bring it to a common format

My query is below:

We are deploying libpostal library on K8s cluster in a pod consisting of python library. After deployment we can see that the container is taking 6gb of memory without even users using the application. when we did further analysis we could find that Libpostal is taking more than 6 gb of memory on deployment.

  • Can you please help me understand where is the configuration file in libpostal which controls the memory allocation
  • what is the recommended memory allocation for libpostal library
  • any pointers or suggestion on why would it take 6 gb of memory on deployment

nitinnitik avatar May 17 '22 07:05 nitinnitik

Hi Libpostal support team- could you please help us with the issue we have with memory leakage in the application where we are using Libpostal library? let me know if you need any further details, will share accordingly.

thanks, Nitin Suryavanshi +91 9986538766

nitinnitik avatar Jan 16 '23 11:01 nitinnitik

6GB of memory? Can someone from the libpostal team confirm that this is the case?

walkman-kuan avatar May 11 '23 13:05 walkman-kuan

I only see 2GB for the parser (which is all I use). I suspect the user must be doing more than that to get to 6GB.

brianmacy avatar May 11 '23 13:05 brianmacy

@brianmacy how are you able to get libpostal running in k8s. I dockerized it but try to run a container using the image, but it kept exiting. I don't know what I am doing wrong. Anyone can help as well.

Olajide-A avatar Nov 17 '23 03:11 Olajide-A

What are you running in the container that you expect to be running? libpostal itself is just a library.

brianmacy avatar Nov 17 '23 10:11 brianmacy