deeplake icon indicating copy to clipboard operation
deeplake copied to clipboard

[FEATURE] hub.auto for audio and video htypes

Open FayazRahman opened this issue 2 years ago • 13 comments

🚨🚨 Feature Request

  • [ ] Related to an existing Issue
  • [ ] A new implementation (Improvement, Extension)

Is your feature request related to a problem?

Extend hub.auto to enable ingesting audio and video data. Take a look at ingesting image datasets for a start.

Description of the possible solution

Adding a video_ingestion.py file to hub/auto/unstructured with necessary changes would work. But this might mean rewriting a lot of code as in image_classification.py

An alternative solution to the problem can look like

To avoid this, a general class could be written and used as base class for image, audio and video.

FayazRahman avatar Mar 19 '22 06:03 FayazRahman

Can I work on this issue ??

neel2299 avatar Mar 21 '22 20:03 neel2299

@neel2299 Of course. I'll assign it to you.

FayazRahman avatar Mar 22 '22 05:03 FayazRahman

Hello!! Can we add dependencies to get the video/audio meta data ?? @FayazRahman @farizrahman4u @mikayelh

neel2299 avatar Mar 29 '22 18:03 neel2299

Hello!! Can we add dependencies to get the video/audio meta data ?? @FayazRahman @farizrahman4u @mikayelh

No, hub already has all the dependencies required for reading meta data from audio and video.

farizrahman4u avatar Apr 03 '22 12:04 farizrahman4u

Also note that we are switching from miniaudio to PyaAV for audio in this PR : #1576 , so it would be ideal if you base your PR against it.

farizrahman4u avatar Apr 03 '22 12:04 farizrahman4u

I am Interested to work on this issue

vaibhavjack11 avatar Apr 04 '22 15:04 vaibhavjack11

Noted, Thanks for the heads up. I will check the PR out.

neel2299 avatar Apr 05 '22 04:04 neel2299

I would like to contribute to this issue. Can you please elaborate?

aryatalathi avatar Sep 04 '22 07:09 aryatalathi

hi @aryatalathi, do you prefer working on this issue or the datase tupload issue? I would recommend working on one issue at a time.

mikayelh avatar Sep 08 '22 16:09 mikayelh

Yeah, sure! I will prefer the dataset upload issue. Thank you!

aryatalathi avatar Sep 08 '22 17:09 aryatalathi

gotcha, good luck - let us know if you have any questions and hit me up in community slack for some guidance.

mikayelh avatar Sep 08 '22 23:09 mikayelh

Can I work on this?

aadityasinha-dotcom avatar Dec 20 '22 09:12 aadityasinha-dotcom

Hi @aadityasinha-dotcom, go for it!

tatevikh avatar Dec 20 '22 17:12 tatevikh