Aneel Nazareth

Python process to check for new URLs and run the pipeline on them

1

We would like to have the front end be able to submit new URLs to process by writing an article row into the DB with a status of NEW. We...

pgConfig change breaks production config

2

This code in `master` breaks production: ``` //if not using docker //create a pgConfig.js file in the same directory and put your credentials there const connectionObj = require('./pgConfig'); ``` ```...

The `docker-compose.yml` and `docker.env` files are currently set up with local development in mind. We'll want a production-friendly config. - Don't run localdb - DB config refers to AWS RDS...

Infrastructure Plan

13

Here's a sketch of an infrastructure plan: ## Development Scrapers run locally (on developer machine) in Docker for prototyping (internal-displacement repo) Write to local DB in docker Can read scrape...

New content slow to appear after crossing the International Date Line

3

I flew from the US to NZ on 12/26 Central time, landing on 12/28 NZ time. NNW was open on my laptop. I noticed that I seemed to not be...

Content-based filtering

3

I'd like to be able to filter out (hide, mark read, or just don't download) certain articles based on what's in them. For example, I'm subscribed to the ArsTechnica Science...