Daily-Arxiv-Tracking-Automation icon indicating copy to clipboard operation
Daily-Arxiv-Tracking-Automation copied to clipboard

Automatically download the all pdfs from a daily rss

Run arxiv_saver_to_db.py and commit changes

DARTA: Daily Arxiv Tracking Automation

How to use?

  1. on web: visit https://arxiv-searcher.onrender.com
  2. on your local machine: git clone and sh run_app.sh

스크린샷 2023-03-19 01 52 08

Features

1. Automatically parse a daily arxiv rss

  • a. python3 arxiv_saver_to_db.py: parse information and save into the database (sqlite3)
    • This DB is automatically growing (appending) via Github Action.
    • example
      • 스크린샷 2023-03-18 20 03 42
      • 스크린샷 2023-03-18 20 02 41
  • b. (optional) python3 arxiv_saver_as_pdf.py: download the all pdfs
    • with auto-naming as {YY} {Title}
    • example
      • image

2. Search web app

  • Just do run_app.sh
    • The dependencies: fastapi, uvicorn, and streamlit
  • example
    • The image of the top!

Tips

  • To make a requirements.txt file, pipreqs --encoding=utf8 would be helpful.

TODO

  • sqlite3 파일을 github repository (100mb 제한) 가 아닌 원격 저장소에서 pull해오고 push하기