image_embeddings icon indicating copy to clipboard operation
image_embeddings copied to clipboard

Published 20 hours ago • verified publisher icon rom1504

batch mode and multithread

Open arita37 opened this issue 3 years ago • 3 comments

Hello,

Thx for the package ? How to setup batch mode and multithread easily ? (inference on CPU).

  1. Think one should be able load some small fine tuner head for quick fine tuning and save the model back.

arita37 avatar Jan 22 '22 13:01 arita37

hi, batching is already happening by default https://github.com/rom1504/image_embeddings/blob/master/image_embeddings/inference/inference.py

rom1504 avatar Jan 22 '22 16:01 rom1504

Hi,

Sure. Thanks.

Thinking of one command to skip or hide (The tfrecords part)

folder of images —> emb in numpy on disk

with model_path =…. (ie typically eff or some fine tuned eff)…

  1. Is reallt tfrecord necessary ? Why not image —> numpy—> TF tensor

Anwway, thanks for the package.

On Jan 23, 2022, at 1:09, Romain Beaumont @.***> wrote:

 hi, batching is already happening by default https://github.com/rom1504/image_embeddings/blob/master/image_embeddings/inference/inference.py

— Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. You are receiving this because you authored the thread.

arita37 avatar Jan 22 '22 16:01 arita37

Does the package use cuda if it's available or is it CPU inference only @rom1504 ?

Butanium avatar Apr 06 '23 17:04 Butanium