libertysoft3

I think you could add something like this to the start of every function in write_html.py, and try to determine which function grows memory the most. import os import psutil...

@fturco Awesome man, thanks for putting in the effort. I'll try to fix this this weekend.

Can you try commenting out these two lines and seeing how the memory goes? sub_links.append(l) user_index[l['author']].append(l) The script is intentionally loading all content for a sub into memory, so it's...

Okay I pushed an update. Not everything was optimized, but I think it should be a lot better. If it's still bad, can you try commenting out this line: user_index[l['author']].append(l)

Thanks for the stats. Well how it stands now, I'm basically loading all /data/*/links.csv data into memory. So whenever you get 13GB of link data (only, not comments) in your...

Hello, glad you're digging this little tool. > instead of csv shove into sqllite db? Not a bad idea, that'd be cleaner. > support markdown? ie makemd.py It's using reddit's...

> Maybe its the original way they author added, but seeing a lot of 1-2 sentences then a paragraph You should be able to view the post on reddit and...

There's a concept of server side jquery in this codebase. Need R+D to decide if this is an easy change or not.

I'm calling this an enhancement although I know there are security concerns with older jQuery which is maybe an argument for calling it a bug.

@wizzwizz4 Just medium level stuff, I don't see much substantial https://retirejs.github.io/retire.js/