Discord-Scraper icon indicating copy to clipboard operation
Discord-Scraper copied to clipboard

Things to accomplish before merging experimental branch code with the main branch.

Open Dracovian opened this issue 4 years ago • 0 comments

  • [x] Implement a function to retrieve the latest post in a channel to alleviate lost time when grabbing from inactive channels.
  • [x] Rename gatherJSONData in config file to clearJSONData which serves as a cache of sorts.
  • [x] Make the script respond to a keyboard combination that will close the script during runtime.
  • [ ] Implement file header validation feature to work alongside MIME type checking.
  • [ ] Implement gzip compression for compressTextData
  • [ ] Implement a checksum system to improve upon duplicate file detection.
  • [ ] Implement DM (Direct Message) scraping.

When this is all complete, then that will set things up for a merge. This will also lead to a close in all currently open issues and I will leave a closing message that asks for creating another issue if the same problem occurs with the newly merged main branch code.

From there I will also make modifications to the repository wiki which currently has a ton of details on the experimental branch codebase from function reference to programmer's reference for those wanting to expand upon the codebase or for those wanting to implement this but in another language other than Python.

Dracovian avatar Dec 30 '20 22:12 Dracovian