ebooks_example icon indicating copy to clipboard operation
ebooks_example copied to clipboard

TODO: Support (externally hosted) corpus consumption

Open BooDoo opened this issue 10 years ago • 7 comments

If user has a file they'd like to use to seed the corpus, and a place to host it in plaintext, we should support that!

BooDoo avatar Jan 08 '15 20:01 BooDoo

This is coming along nicely using Cloudinary's free tier at Heroku as the file store. There's a web interface and we can push/pull from the app itself.

ETA: Monday Feb 23 or sooner.

BooDoo avatar Feb 19 '15 23:02 BooDoo

Hello... I just started using your bot on the advice of Brett o'Connor. Wondering whether you ever deployed the externally hosted CSV for these bots? I'd love to use that as a feature.

(my bot is @zebrapedia by the way)

therourke avatar May 09 '15 13:05 therourke

There is a branch (persist-cloudinary) that I used for my @0xB00D00 account for about a month. Here's the Deploy to Heroku link.

It misses caching Cloudinary assets often, which means if you have a large corpus you'll run into problems with it re-fetching too often and running well over your allotted bandwidth.

I can't recommend it as stable, but ¯_(ツ)_/¯

BooDoo avatar May 09 '15 18:05 BooDoo

So for example I ended up getting an angry email from Cloudinary after I let a deployment with my twitter archive (~18MB) run for a month because I was at 469% of the allotted usage for a free account.

BooDoo avatar May 09 '15 18:05 BooDoo

Thanks. Have tried this, but having trouble. The Cloudinary url is in this format?

http://res.cloudinary.com/USERNAME

I keep getting 'configure environment' errors like this: "growing-nimbly-1303 will overwrite CLOUDINARY_URL on pkdbotcloud"

therourke avatar May 10 '15 10:05 therourke

Any idea what might be wrong with it? Am I missing something? Thanks

therourke avatar May 11 '15 18:05 therourke

Sorry about the delay - you leave CLOUDINARY_URL blank, it's automatically populated by the Cloudinary add-on.

BooDoo avatar May 14 '15 18:05 BooDoo