police-data-trust

police-data-trust copied to clipboard

[FEATURE] Switch backend container to Graviton

2

Graviton performs better and consumes less power and therefore costs 20% less than intel systems. We can adopt it for our backend containers. Steps: - add `--platform=linux/arm64` to docker builds...

zganger

Move backend container to Gravition / arm64

1

mikeyavorsky

[FEATURE] Data Insert Logic - Officer

1

Extend the Flask API to read from a .jsonl file of scraped Officers data and insert it into the Postgres DB. **Is your feature request related to a problem? Please...

DMalone87

[FEATURE] Data Insert Logic - Commands

1

Extend the Flask API to read from a .jsonl file of scraped Commands data and insert it into the Postgres DB. **Is your feature request related to a problem? Please...

mikeyavorsky

Use a cloudwatch/eventbridge scheduled event to run the scraper task once/week

zganger

[BUG] Diagnose why backend & scraper tasks run only on public subnets

1

For security's sake, these tasks should run on private subnets of the VPC.

zganger

1. Poll SQS queue 2. If a message exists in the queue 2a. change visibility to high `SQS.Client.change_message_visibility()` 2b. download from S3 at `parsed.Records[0].s3.bucket.name + "/" + parsed.Records[0].s3.object.key` and log...

mikeyavorsky

-Added alembic migration to set up a Postgres materialized view for the search function to search relevant Officers, Agencies. -Migration handles insertions, deletions etc. to Agency, Officer Tables, and updates...

hrauniya

Location based search for Officers and Agencies

1

Added Location based search for officers and Agencies using Postgres full text search.

hrauniya

**Describe the Issue** We have a number of deprecation warnings showing up for python package that have passed their prime. We'll need to tackle these and move to processes that...

DMalone87