OpenScraper issues

Modifier masterspider.py risque de casser des spiders existantes

2

Aujourd'hui, une spider est constituée de : - sa configuration (dont les XPath) - le code de `masterspider.py` qui tourne avec la configuration en argument Quand on modifie la configuration...

DavidBruant

foundations

scroll infinty scroll with selenium

1

JulienParis

M

preview website to scrap

JulienParis

?

XL

server in https / lets encrypt

JulienParis

tech

server

M

add CRON to schedule spiders' runs

JulienParis

M

fix search with or without commas

return different results when commas aroud strings : ex. "my search" != my search

JulienParis

M

correct collections indexation --> for now all collections and subfields are indexed for research...

2

https://github.com/entrepreneur-interet-general/CIS-front/issues/159

JulienParis

M

JWT integration / read token on request API endpoint

JulienParis

L

run all spiders at once

JulienParis

tech

front

?

M

identify bugs API scraper (indexation)

JulienParis

?

OpenScraper
OpenScraper copied to clipboard

Metadata

Modifier masterspider.py risque de casser des spiders existantes

scroll infinty scroll with selenium

preview website to scrap

server in https / lets encrypt

add CRON to schedule spiders' runs

fix search with or without commas

correct collections indexation --> for now all collections and subfields are indexed for research...

JWT integration / read token on request API endpoint

run all spiders at once

identify bugs API scraper (indexation)

← Metadata

Owner

Metadata

OpenScraper OpenScraper copied to clipboard

Metadata

← Metadata

Owner

Metadata

OpenScraper
OpenScraper copied to clipboard