utils icon indicating copy to clipboard operation
utils copied to clipboard

zeroize: use `asm!` to improve performance

Open cbeck88 opened this issue 3 years ago • 9 comments

The purpose of the change is to make calls to x.as_mut_slice().zeroize() considerably faster, particularly for types like [u8; n]. We take @sopium's proposed code from #743 without significant changes.

The reason it becomes faster is that the call to volatile_set before this change appears not to be easily optimizable, and (for example) leads to setting bytes one at a time, instead of the compiler consolidating them into SIMD instructions.

In the modified code, we don't use volatile_set, we instead loop over the slice setting the elements to Default::default(), and to ensure that the writes are not optimized out, we use an empty asm block. (There is discussion of the correct asm options to use here in the issue.)

Because the asm block potentially reads from the pointer and makes a syscall of some kind, the compiler cannot optimize out the zeroizing, or it could cause observable side-effects. In the improved code, we only create such an optimization barrier once, rather than after each byte that it is written.

The call to atomic_fence() is not changed.


This change may help give users a way to improve performance, if they have to zeroize very large arrays, or, frequently have to zeroize many small objects. We tested code-gen here in godbolt (in addition to the tests posted in the github issue) and found that this change is typically enough for llvm to start adding in SIMD optimizations that zero many bytes at once.

cbeck88 avatar Feb 28 '23 07:02 cbeck88

This should probably be feature gated to avoid a massive MSRV bump and disrupting existing users. That was very problematic the last time we bumped MSRV to add const generic support.

And if all the inline ASM is doing is providing an optimization barrier, it seems like core::hint::black_box could be used instead.

tarcieri avatar Feb 28 '23 15:02 tarcieri

I'm a little worried about this part of the documentation for core::hint::black_box: https://doc.rust-lang.org/beta/core/hint/fn.black_box.html#when-is-this-useful

Maybe we should just use the asm and feature gate it?

cbeck88 avatar Mar 01 '23 17:03 cbeck88

Oh wow, definitely an important detail about core::hint::black_box!

An ASM optimization barrier seems good then, although let me run this implementation by a few people.

It would definitely still be good to feature gate it in order to preserve MSRV.

tarcieri avatar Mar 01 '23 19:03 tarcieri

Hmm, when did that warning get added?

It doesn't appear on the current stable docs. Is it new?

https://doc.rust-lang.org/stable/std/hint/fn.black_box.html

tarcieri avatar Mar 01 '23 19:03 tarcieri

Maybe I looked up the wrong docs, my url says "beta". Maybe they removed that later.

cbeck88 avatar Mar 01 '23 20:03 cbeck88

Maybe we can look up the implementation, if it's very similar to Sopium's suggested barrier then maybe it's fine

cbeck88 avatar Mar 01 '23 20:03 cbeck88

This is the optimization barrier @chandlerc recommended (C++ version, similar idea): https://compiler-explorer.com/z/bh9WzvTPq

tarcieri avatar Mar 01 '23 20:03 tarcieri

Maybe I looked up the wrong docs, my url says "beta". Maybe they removed that later.

To me that implies those docs were recently added. I guess we'll see what happens in the next release.

tarcieri avatar Mar 01 '23 20:03 tarcieri

Worth following some discussion here: https://rust-lang.zulipchat.com/#narrow/stream/122651-general/topic/black_box.20and.20crypto

elichai avatar May 18 '23 14:05 elichai