Sukai Huang
Sukai Huang
Hello, I am currently try to use external source method to read videos that are stored as a sequence of image frames (fixed length). However, it looks like the `fn.decoders.image`...
### System Info I saw that in the PPOv2 example, the policy model is directly created from `AutoModelForCausalLM.from_pretrained` I want to know if it is interchangeable with `AutoModelForCausalLMWithValueHead.from_pretrained` Also I...
Hi, can I get a LoRA PPO example script?
## Description Currently, Kedro does not support running a pipeline with `accelerate launch`, which is commonly used for distributed training in large language model training workflows. This limitation makes it...