m3 icon indicating copy to clipboard operation
m3 copied to clipboard

Documentation Error for Commit Log integrity error

Open asafm opened this issue 4 years ago • 7 comments
trafficstars

The documentation at https://m3db.io/docs/m3db/architecture/commitlogs/ says :

Here are two integrity levels available for commit logs:

Synchronous: write operations must wait until it has finished writing an entry in the commit log to complete. Behind: write operations must finish enqueueing an entry to the commit log write queue to complete.

Depending on the data loss requirements users can choose either integrity level.

I was following the configuration code for commitlog.Options for Strategy and it seems that in server.go it is hard coded to be Behind integrity level:

	opts = opts.SetCommitLogOptions(opts.CommitLogOptions().
		SetInstrumentOptions(opts.InstrumentOptions()).
		SetFilesystemOptions(fsopts).
		SetStrategy(commitlog.StrategyWriteBehind).
		SetFlushSize(cfgCommitLog.FlushMaxBytes).
		SetFlushInterval(cfgCommitLog.FlushEvery).
		SetBacklogQueueSize(commitLogQueueSize).
		SetBacklogQueueChannelSize(commitLogQueueChannelSize))

Am I missing something in the code or it’s configured somewhere else?

asafm avatar Dec 02 '20 17:12 asafm

@ChrisChinchilla

asafm avatar Dec 02 '20 17:12 asafm

@ChrisChinchilla

gibbscullen avatar Dec 02 '20 19:12 gibbscullen

@ChrisChinchilla

asafm avatar Dec 16 '20 16:12 asafm

Hey all, yes I saw the assignment, I am getting there, but this would involve me getting engineer time, which take a little longer…

ChrisChinchilla avatar Dec 17 '20 07:12 ChrisChinchilla

Following up on this; for this, we are going to update the documentation to make it more clear as the code in the config is correct.

gibbscullen avatar Jan 28 '21 16:01 gibbscullen

@ChrisChinchilla

gibbscullen avatar Jan 28 '21 16:01 gibbscullen

Hey all,

Is it on the roadmap to make this parameter configurable? I would like to try synchronous writes.

Thanks

mhoffm-aiven avatar May 24 '22 09:05 mhoffm-aiven