Scoop-Core icon indicating copy to clipboard operation
Scoop-Core copied to clipboard

Indexer tweaks

Open Ash258 opened this issue 3 years ago • 8 comments

DB

manifests|old_manifests|buckets

  • [ ] created_at - simple created_at timestamp NOT NULL DEFAULT NOW() -- DEV
  • [ ] updated_at - more complex. With triggers? or just manually handle it? -- DEV
  • [ ] deprecated - will be handled manually from manager/cmd/db -- DEV
    • In case of archived, it will be just removed from db
  • [ ] Test migrations -- DEV

Installation statistics - #211

  • [x] Work out concept
  • [x] Prevent manipulations
  • [ ] Different versions stats from same manifest
    • [ ] Update process
  • [ ] Recent failed operations
  • [x] Allow user to disable it

Processing

  • [ ] Handle deprecations/move
  • [ ] Document bucket allowance and process
  • [ ] Array for query Invoke-DatabaseQuery -ScriptBlock[]
  • [ ] Export to modules
  • [ ] Parallelism?
  • [ ] Periodical verification runs
    • [ ] Weekly test of all URLs -> report to DB -> monitor -> trigger -> build up recommended commands to web host txt file

General

  • [ ] Dependencies update
    • [ ] Weekly report of all dependencies changelog
    • [ ] DB Update will be 2 steps verification - site 2 site in different container on different host
  • [ ] DB Replication
  • [ ] Adjust backups - 3|2|2
  • [ ] Ansible
  • [ ] Load balancing

Ash258 avatar Jun 17 '21 18:06 Ash258

Base bucket has to be adopted after 0.6.5 and added manually to fallback function

Ash258 avatar Aug 08 '21 18:08 Ash258

  • [x] Prevent manifests with encoding issues, being accepted in main
    • [x] Notify first in error log to trigger monitoring
    • [x] Auto recover
      • [x] rm
      • [x] git pull

Ash258 avatar Oct 20 '21 19:10 Ash258

  • [x] Check archived manifests addition

Duplication happen for some reason on full re-indexing.

Ash258 avatar Oct 20 '21 19:10 Ash258

https://squidfunk.github.io/mkdocs-material/

Ash258 avatar Nov 22 '21 20:11 Ash258

Install redirect

Ash258 avatar Nov 22 '21 20:11 Ash258

Installs script take 2

Ash258 avatar Nov 22 '21 20:11 Ash258

Patching

Ash258 avatar Dec 03 '21 20:12 Ash258

Migration

Ash258 avatar Dec 03 '21 20:12 Ash258