Fovea icon indicating copy to clipboard operation
Fovea copied to clipboard

Clarifai support

Open 28mm opened this issue 7 years ago • 4 comments

Clarifai has a free tier that supports < 5000 requests / month. Clarifai offers a set of features that overlaps with other services:

  1. General image classification
  2. Face detection
  3. Celebrity recogntion (also: Microsoft, Watson)
  4. Dominant Color determination (also: Microsoft)
  5. NSFW Image detection (also: Microsoft)

As well as some interesting models that offer greater specificity within a restricted domain:

  1. Travel
  2. Wedding
  3. Food
  4. Apparel

In addition, Clarifai has

  1. the ability to train custom models, which would be an interesting feature addition.
  2. multiple language support.

https://developer.clarifai.com/models https://developer.clarifai.com/pricing

28mm avatar Feb 23 '17 02:02 28mm

A 1st pass at multiple/selectable models.

[user@host]$ fovea --provider clarifai --model nsfw-v1.0 --model travel-v1.0  ../ex/petit\ soldat.jpg
0.9975989	sfw
0.002401174	nsfw
0.81481314	Wardrobe
0.7422658	Couch
0.5821117	Massage
0.5710578	People
0.45137754	Television
0.43034348	Lamp
0.34137008	Details
0.311964	Animals
0.30856794	Wedding
0.30099514	Chair
0.2610772	Telephone
0.23296061	Daytime
0.2257206	In-Room Kitchenette
0.22352721	Bathroom Shower
0.19117762	Bathroom Bathtub
0.13685365	Bathroom Sink
0.12062782	Bunk Beds
0.10399384	Desk
0.103389286	Coffee Machine
0.089739025	Minibar

28mm avatar Feb 28 '17 17:02 28mm

list available models with --list-models:

[user@host]$ fovea --provider clarifai --list-models
general-v1.3	aaa03c23b3724a16a56b629203edc62c
food-items-v1.0	ecf02b31ad884d6785a9bd950f8e986c
apparel	e0be3b9d6a454f0493ac3a30784001ff
weddings-v1.0	c386b7a870114f4a87477c0824499348
travel-v1.0	eee28c313d69466f836ab83287a54ed9
celeb-v1.3	e466caa0619f444ab97497640cefc4dc
color	eeed0b6733a644cea07cf4c60f87ebb7
nsfw-v1.0	e9576d86d2004ed1a38ba0cf39ecb4b1

Find new models with .../utilities/clarifai/clarifai-models.py:

[user@host]$ ./clarfai-models.py
weddings-v1.0	beaecb4d63b2485689d9b5aa95a33e40	2017-02-15T00:19:30.306957Z
food-items-v1.0	ecf02b31ad884d6785a9bd950f8e986c	2017-02-15T00:19:30.306957Z
nsfw-v1.0	ebfdb56692f34e18b88ff9ae258e756f	2017-02-15T00:19:30.306957Z
apparel	aeae096937544d1e9e24545590004caa	2017-02-15T00:19:30.306957Z
travel-v1.0	aa59a3a6a5ed43c49ac99dccbfd97c10	2017-02-15T00:19:30.306957Z
age_gender_ethnicity	c0c0ac362b03416da06ab3fa36fb58e3	2016-12-23T06:08:44.271674Z
apparel	e0be3b9d6a454f0493ac3a30784001ff	2016-12-20T22:43:29.831402Z
celeb-v1.3	e466caa0619f444ab97497640cefc4dc	2016-10-25T19:30:38.541073Z
face-v1.3	a403429f2ddf4b49b307e318f00e528b	2016-10-25T19:30:38.541073Z
face-v1.3	d02b4508df58432fbb84e800597b8959	2016-10-25T19:30:38.541073Z
weddings-v1.0	c386b7a870114f4a87477c0824499348	2016-09-22T19:14:51.993209Z
nsfw-v1.0	e9576d86d2004ed1a38ba0cf39ecb4b1	2016-09-17T22:18:59.955626Z
travel-v1.0	eee28c313d69466f836ab83287a54ed9	2016-09-17T22:18:59.955626Z
food-items-v1.0	bd367be194cf45149e75f01d59f77ba7	2016-09-17T22:18:59.955626Z
general-v1.3	cccbe437d6e54e2bb911c6aa292fb072	2016-06-17T22:01:04.144732Z
general-v1.3	bbb5f41425b8468d9b7a554ff10f8581	2016-06-17T22:01:04.144732Z
color	eeed0b6733a644cea07cf4c60f87ebb7	2016-05-11T18:05:45.924367Z
general-v1.3	aaa03c23b3724a16a56b629203edc62c	2016-03-09T17:11:39.608845Z

28mm avatar Feb 28 '17 23:02 28mm

Celebrity face recognition. left-x, top-y, length, width, confidence, id, name...

fovea --provider clarifai --celebrities https://upload.wikimedia.org/wikipedia/en/1/15/Edward_Said.jpg
83	70	88	88	0.61	ai_90xmCG20	james cromwell
83	70	88	88	0.07	ai_5MZwFQSw	richard portnow

28mm avatar Mar 28 '17 20:03 28mm

[patrick@fausto]$ fovea --color --provider clarifai ~/Desktop/Alejandro+Valverde+b9UASwuiGQHm.jpg
0.11	#2c2a27	#000000	Black
0.61	#4b7ea7	#4682b4	SteelBlue
0.07	#da3037	#dc143c	Crimson
0.09	#a6beb9	#c0c0c0	Silver
0.01	#ddbf3f	#daa520	Goldenrod
0.10	#a27b67	#bc8f8f	RosyBrown

28mm avatar Mar 29 '17 20:03 28mm