grok-1 icon indicating copy to clipboard operation
grok-1 copied to clipboard

Security Update and Enhancement for run.py

Open MiChaelinzo opened this issue 1 year ago • 19 comments

The key changes:

  • 1.) Validate checkpoint integrity by comparing hashes
  • 2.) Add rate limiting on inferences
  • 3.) Use authentication for any inference endpoints
  • 4.) Other general security best practices This helps secure the checkpoint loading, limits blast radius of any issues, and adds authentication around the API access.

MiChaelinzo avatar Mar 21 '24 19:03 MiChaelinzo