Tristan Lee
Tristan Lee
Yes, feel free to submit a pull request!
Yes, this appears to be a problem with the tiktok-scraper dependency. I'm currently looking into alternative scrapers.
I implemented the requested changes: - Made attachment handling similar to Twitter's: dataclasses for Image, Video, and Gif. - Added capability to scrape multiple Videos from a single message -...
This is an example of a channel page with no `tme_messages_more` `data-before` attribute: https://t.me/s/proudboysusa?before=8033 I only started noticing such pages after I had started working on this fork, so maybe...
Incorporated your changes, let me know if there are other issues you'd like me to address
Here's a Truth Social API wrapper: https://github.com/stanfordio/truthbrush Unfortunately it requires authentication, there doesn't seem to be a way around that.
@JustAnotherArchivist Any additional changes you want us to make? We've been using this quite a bit and would love to see it get merged.
The `detect` function in https://github.com/Mimino666/langdetect/issues/77#issuecomment-880545747 needs to be updated to something like: ```python def detect(text, detector=detector): detector.text = "" detector.langprob = None detector.append(text) return detector.detect() ``` because in the [get_probabilities](https://github.com/Mimino666/langdetect/blob/a1598f1afcbfe9a758cfd06bd688fbc5780177b2/langdetect/detector.py#L141)...
Switched to working scraper in commit https://github.com/bellingcat/tiktok-hashtag-analysis/commit/900d6adc69f1e59cc9c405dcbf4792f36f6960c8, which fixes this problem.
We're using a native Python scraper now, so there shouldn't be any errors when no hashtags are downloaded. Let us know if you have any issues using the tool.