WIP: Storing records on remote s3 storage

[skrashevich]

Work in progress.

storage:
  s3: 
    enabled: true
    archive: false
    access_key_id: ****
    secret_access_key: *****
    bucket_name: frigate
    endpoint_url: http://192.168.88.171:9768
    path: "/"

[netlify[bot]]

✅ Deploy Preview for frigate-docs ready!

Name	Link
🔨 Latest commit	33c81262156e9c71936cc34286c18519cbe61851
🔍 Latest deploy log	https://app.netlify.com/sites/frigate-docs/deploys/646d2d14cf9c030008543025
😎 Deploy Preview	https://deploy-preview-6586--frigate-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site settings.

[blakeblackshear]

The VOD module needs to read the metadata of every segment file for recordings playback. It has a cache, but I imagine this would be incredibly slow if every recording file has to be fetched.

How long does it take to load an hour long m3u8 playlist when you have 24/7 recordings in all mode?

[skrashevich]

nginx vod module has "remote" and "mapped" modes for work with non-local files

[javydekoning]

@skrashevich this is a really awesome feature. I left a few comments for improvements.

I would disable s3 stats by default. Give users the option to enable it. On buckets with millions of objects this can become a slow operation due to its recursive nature. Also, I think you are gathering stats for the whole bucket.

What if a user uses "/frigate" as their base path. Wouldn't we want stats only for that path?

@blakeblackshear, I'm not an expert on VOD. That said, s3 is commonly used to store the main playlist and HLS files for VOD platforms. Hence, with the correct config wouldn't expect any performance issues.

[PovilasID]

I suggest adding a button next to a clip "Upload to S3" or option to "Upload only favorite clips". I personally do not have the bandwidth to upload all the vide that is captured but I would love to be able to backup specific certain clips.

[luckyycode]

any update?

[PovilasID]

There are couple of solution than you do yourself

1. Clip upload. In HA notification script you can add uploads to s3 or telegram using rclone or curl.
2. Rclone remote export. You can use rclone docker plugin to create volume that is actually a on remote server and specify it for exports, so that any time you export a clip it will get saved to remote server.