efficient-kan icon indicating copy to clipboard operation
efficient-kan copied to clipboard

Can configure efficient-kan model for continual learning?

Open lukmanulhakeem97 opened this issue 9 months ago • 9 comments

Similar like what authors shown in official git repo, can use this efficient-kan model for continual learning settings. . For using efficient-kan for CL settings, I haven't found some attributes that need to be set given in official pykan;

######### cl code from pykan

setting bias_trainable=False, sp_trainable=False, sb_trainable=False is important.

otherwise KAN will have random scaling and shift for samples in previous stages

model = KAN(width=[1,1], grid=200, k=3, noise_scale=0.1, bias_trainable=False, sp_trainable=False, sb_trainable=False)

how can I set bias_trainable=False, sp_trainable=False, sb_trainable=False here, is there a way?

lukmanulhakeem97 avatar May 19 '24 01:05 lukmanulhakeem97