mergekit icon indicating copy to clipboard operation
mergekit copied to clipboard

Published 20 hours ago • verified publisher icon arcee-ai

ABM corrections

Open metric-space opened this issue 6 months ago • 0 comments

Fixes

  1. uncaught dataset loader bug that pops up because padding wasn't set correctly

Improves

  1. Use of transpose law to simplify expression
  2. Removes unnecessary complexity and unifies averaging for every weight matrix as opposed to the previous conditional

Testing

Has been tested multiple times with the original (smoke) testing script and alignment has been gauged via cosine angles and frob norms

metric-space avatar Jul 30 '24 04:07 metric-space