GuYi comments

Results 12 comments of


                                            GuYi

Size mismatch, Error(s) in loading model finetuned by lora

> > Okay, I upgrade transformers to 4.38.0, and use peft=0.7.0 now, but meet some errors which I haven't met when I use peft=0.9.0. ![image](https://private-user-images.githubusercontent.com/48597370/311592437-5a58b1dd-a801-4658-84ba-84ff9d9b21ac.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTQwMTM3MjQsIm5iZiI6MTcxNDAxMzQyNCwicGF0aCI6Ii80ODU5NzM3MC8zMTE1OTI0MzctNWE1OGIxZGQtYTgwMS00NjU4LTg0YmEtODRmZjlkOWIyMWFjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDI1VDAyNTAyNFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY5OWI2ZmI4NTFhMDZiMzFiZDFkNTY0YzE5MDI2MjhhMWRlZDQ3ZjdkNzhjNzFmMzRiMTNjY2IwNGYzODI1ODYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.KDfJ03U9tf8zBmF0ESuxFKDF_bKo9iUejYzwMqsVW5w) > > config.json is here,...

Question: Support for Dynamic Categorical Inputs in iTransformer

I have a similar question, I want to use covariates in training. Does the iTransformer support dynamic covariates? If so, could you provide some guidance or examples on how to...