Reid Hewitt

the function causing the issue looks like it's been minified so it's difficult to read. i'm not familiar with that script/function so i can't immediately determine what the potential issues...

DOT Socrata Data.json returns 500 for [recent job](https://catalog-prod-admin-datagov.app.cloud.gov/harvest/dot-socrata-data-json/job/661dd8c1-1c5e-48af-9b01-67e66ed9da04). this hasn't occurred before. will report back if issue resolves itself.

montgomery county md json returns 500 for [recent job](https://catalog-prod-admin-datagov.app.cloud.gov/harvest/montgomerycountymd-json/job/452de802-8c2b-4ac2-888a-194ad91c6a6e). doesn't appear to be a common thing.

updated part of the sketch. this ticket involves refactoring the `HarvestSource` class and all tests referencing it so some additional time will be needed.

on the topic of integration tests, we may want to have another discussion on what we consider an integration test ( i.e. a test of multiple parts of an application...

two of the tests ( retrieving a task and cancelling a task ) are failing

it seems that getting a task by `name` isn't reliable. Using the `guid` cf assigns the task works.

We want to be able to get a cf task by name not just id. [relevant code](https://github.com/GSA/datagov-harvesting-logic/blob/fdf55eccf6b80bbba4b855d3c52d03b06ec4c61f/tests/integration/cf/test_cf_tasks_int.py#L11)

here's a list of things i've done so far. haven't pushed anything. - harvest.py - rewording things to describe "our" data vs "their" data - harvest source can describe a...

rewriting tests to work with the refactoring. completed the following unit test categories: - cf - compare - database - exception - extract remaining: - load - utils - validate...