llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

Persistence for localfs dataset provider

Open yanxi0830 opened this issue 10 months ago • 1 comments

🚀 Describe the new functionality needed

  • We should be able to persist localfs datasetio provider: https://github.com/meta-llama/llama-stack/blob/b1a63df8cdae6e45d1db10f8c73eca6cd75ba68e/llama_stack/providers/inline/datasetio/localfs/datasetio.py#L82-L98

  • Example persistence for huggingface datasetio provider: https://github.com/meta-llama/llama-stack/blob/b1a63df8cdae6e45d1db10f8c73eca6cd75ba68e/llama_stack/providers/remote/datasetio/huggingface/huggingface.py#L55-L78

💡 Why is this needed? What if we don't build it?

Consistent persistence alignment for datasetio providers

Other thoughts

No response

yanxi0830 avatar Nov 27 '24 22:11 yanxi0830