[feature] Allow models/datasets import option to dsl.importer

[nsingla]

Feature Area

/area sdk

What feature would you like to see?

I would like to use dsl.importer to allow imports from hugging face that may or may not be behind authentication (just to keep things consistent)

What is the use case or pain point?

Pain point is consistency, we have dsl.importer for oci, s3, gcp but not for other storages like hugging face.

Is there a workaround currently?

Direct call to hugging face api with tokens defined in the pipeline code as enviornment variable (via kubesecret)

---

Love this idea? Give it a 👍.