David S. Rosenberg
David S. Rosenberg
On further reflection... maybe this is fine: say you have a classic latent variable model z --> x, where x is observed, z is latent. When the distributions of z...
More ideas: one could draw a circle around each point, color-coded based on the coefficient (e.g. yellow for zero, red for the max value, and some version orange for everything...
@vakobzar where do we stand with this? Thanks...
Yeah definitely should have the full rank condition.
This is for showing that l2 spreads weight evenly? and showing it's a descent direction is a cute inner product with the gradient. I like it - where do we...
This sounds good -- want to write this up? We can use it for concept check or move it into homework #2.
The "traditional form" of soft margin SVM that Brett gives in 3-SVM-Notes.pdf is basically the Tikhonov form of SVM. The formulations I mention above the Ivanov form and another form...
These slides have a nice way of motivating max margin in hard-margin case: http://bit.ly/2jOnINC For a picture showing separation but with very small margin, they say: "Better not these, since...
Hi Vlad -- 2d animation looks good. for minibatch SGD, what about just linear regression (no ridge penalty)? Linear model with additive Gaussian noise sounds fine. Let's start with a...