CubbyDNN icon indicating copy to clipboard operation
CubbyDNN copied to clipboard

Implement Image class

Open Yoogeonhui opened this issue 6 years ago • 6 comments

To put image to a tensor, implementation of image class is needed

Basic Features

  • Support some image types(jpg, png, gif, bmp)
  • Load and save images
  • Resizable and croppable
  • Rotate, transform
  • Convertable to tensor(or array)

Additional features

  • Gaussian blur
  • Noise
  • Adjust hue, rgb etc...
  • ETC...

Yoogeonhui avatar Mar 16 '19 13:03 Yoogeonhui

How does this design work together with video streams? One very important use case of a DL environment is object recognition and tracking, with our without optical flow.

Make certain that the image class works well together with video processing workloads.

Ravenwater avatar Mar 16 '19 14:03 Ravenwater

There'll be a video class which can return an image class per frame. And the video class will be implemented after this work is completed.

Yoogeonhui avatar Mar 17 '19 07:03 Yoogeonhui

Awesome.

What about optical flow-based video analysis? Do you know what is needed for that use case? I don't know, so asking in earnest.

Ravenwater avatar Mar 17 '19 14:03 Ravenwater

I'm not familiar with flow-based video analysis. I saw a dataset whose r, g and b represents x, y, z-axis movements respectively. But actually I don't know what is needed for that use case specifically.

Yoogeonhui avatar Mar 17 '19 15:03 Yoogeonhui

We should look into what the best practice is for optical flow. I believe that most insect visual systems are optical flow based, and I would think that this translates to DL for autonomous systems such as drones. It might be a separate cognitive system, so a fancy drone may have a 3D visual system for object recognition and tracking, and an optical flow DL system for control.

Let's make certain that CubbyDNN can support these use cases.

Ravenwater avatar Mar 17 '19 20:03 Ravenwater

We separate task that implements load images.

  • @Yoogeonhui: Load bmp and gif file format
  • @utilForever: Load png and jpg file format

utilForever avatar May 01 '19 05:05 utilForever