dig-etl-engine

dig-etl-engine copied to clipboard

k.m.a.KafkaManagerActor - Updating internal state

8

I am attempting to run MyDIG on Ubuntu 16.04 on AWS. After running docker-compose up, the terminal keeps printing: kafka_manager_1 | [info] k.m.a.KafkaManagerActor - Updating internal state... I was also...

calvinleungyk

Create entity table extractor to populate KG fields

1

szeke

majidghgol

Coordinate with NYU do handle multiple projects

4

- [ ] Dynamically assign a kafka `topic` as output for the NYU crawler - [ ] Have the NYU crawler output kafka topic configurable via a `config` file -...

saggu

Fields like, website, city which we use internally use, should be hidden from the users in myDIG. They should in the myDIG interface so that users can change their appearance,...

saggu

In the Actions tab: - rename TLD to Website - rename ES to Available - rename Desired to Target Move `Desired number of docs per TLD` to be in top...

szeke

Round-robin TLD when adding docs to the kafka input queue

1

GreatYYX

saggu

Move logstash pipeline to project directory

1

Logstash pipeline files should be a part of persistent data. This is an incompatible change.

GreatYYX

szeke