text-to-image-eval
text-to-image-eval copied to clipboard
encord-team
Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN...
When adding the JSON definition of the [alkzar90/NIH-Chest-X-ray-dataset](https://huggingface.co/datasets/alkzar90/NIH-Chest-X-ray-dataset) Hugging Face medical dataset, found that it's a multi-label dataset instead of a multiclass. JSON definition: ``` { "dataset_type": "HFDataset", "title": "NIH-Chest-X-ray",...
When adding the JSON definition of the [Qdrant/google-landmark-geo](https://huggingface.co/datasets/Qdrant/google-landmark-geo) Hugging Face dataset, got `datasets.exceptions.DatasetGenerationError: An error occurred while generating the dataset`. JSON definition: ``` { "dataset_type": "HFDataset", "title": "geo-landmarks", "title_in_source": "Qdrant/google-landmark-geo"...
Metadata
Owner
Metadata
Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN...