s3backer

s3backer copied to clipboard

[enhancement] make holes in cache file for zero blocks with fallocate

8

I noticed that while zero blocks are not written to remote storage, they *are written* to the block cache. This is not optimal. For example I am using s3backer as...

xmrk-btc

nbdclient fails to connect

4

``` Dec 23 00:57:59 host.domain.org s3backer[44815]: s3backer: connecting nbdcloud to /dev/nbd0 and daemonizing Dec 23 00:57:59 host.domain.org nbdkit[44952]: s3backer: starting non-zero block survey Dec 23 00:57:59 host.domain.org systemd[1]: Started s3backer...

bjo81

[enhancement] zero_cache should write a full block when writing into all-zero block, thus avoiding read-modify-write cycle

3

When zero_cache is doing write_block_part into all-zero block, it passes the request to block cache, which possibly does not have the full block, so it needs to read it from...

xmrk-btc

Branched from 1.4.1 tag. I implemented some stats for the upper filesystem block usage. For the entire filesystem (Yes! it will consume a lot of memory, 36 bytes per block...

xmas79

Feature: reserve thread for kernel reads that miss the cache

2

Thanks for making s3backer! It seems unreasonably cool to me. I set up a new s3backer drive/mount with these commands: ``` s3backer --blockSize=4k --size=240g --listBlocks --blockCacheFile=/media/s3backer/cache --blockCacheMaxDirty=500 --blockCacheThreads=4 --blockCacheRecoverDirtyBlocks --debug...

JasonWoof

s3backer is silently accepting invalid command line parameters

6

I would have expected the following to give me an error about an unknown command line flag: ``` nikratio@vostro ~/i/s/build (nbd) [1]> ./s3backer --invalid s3backer: no S3 bucket specified nikratio@vostro...

Nikratio

Improve README with a minimal S3 policy

5

The Minimal Policy would recommend the minimal rights needed for the application to run. Ex.: ``` GetObject PutObject DeleteObject ``` or a JSON: ``` { "Version": "2012-10-17", "Statement": [ {...

solracsf

Recommendations on Using s3backer with Docker?

2

Hi `s3backer` Folks! I am currently in the process of migrating my personal Nextcloud away from Nextcloud's first-party S3 support because of its incompatibility with encryption, which you can read...

elsiehupp

How to test s3backer? (question)

2

I'm experimenting with s3backer and making some changes. At the same time, I want to be sure all the previously implemented features are still alright. How can I check that?...

zenovich

Support lzma (xz) compression

2

Would it be feasible for s3backer to support alternative compression methods? At least in a residential setting, even with a very expensive compression algorithm it is likely that the bottleneck...

Nikratio