community icon indicating copy to clipboard operation
community copied to clipboard

[INS-2201] [Feature] CSV Operator

Open praharshjain opened this issue 9 months ago • 6 comments

Is There an Existing Issue for This?

  • [X] I have searched the existing issues

Project

Instill VDP

Is your Proposal Related to a Problem?

No, it is a new feature request.

Describe Your Proposed Solution

We can have an operator to extract/query data from a CSV file, and write structured data (maybe JSON data) to it.

Highlight the Benefits

VDP will have support for working with CSV format.

Anything Else?

Ref - https://pkg.go.dev/encoding/csv

INS-2201

praharshjain avatar Sep 28 '23 16:09 praharshjain

This issue is available for anyone to work on.

:sparkles: Thank you for your contribution! :sparkles:

github-actions[bot] avatar Oct 06 '23 03:10 github-actions[bot]

I think I can tackle this one too! (If someone wants this one before I merge the previous PR please give it to them)

QQ: How can we make sure that the PRs to the operator repo will interface correctly with the UI? Are we assuming that the csv file is uploaded to the backend and then we pass the csv path to this operator ?

Thank you!

miguel-ortiz-marin avatar Oct 10 '23 17:10 miguel-ortiz-marin

Hi @miguel-ortiz-marin! Absolutely, we’re thrilled about your interest in our project! :rocket: Here’s the Contributing Guideline for Instill VDP to get you started on your journey! Please refer to the Contributing Guidelines for components as well. Don’t forget to link your pull request to the corresponding issue, and after your PR gets merged, please complete this form to claim your well-deserved points! If you ever have any questions or need a hand along the way, don’t hesitate to drop a message in this thread or hop into our Discord. Happy contributing! :blush::star2:

harshsoni7 avatar Oct 12 '23 14:10 harshsoni7

@donch1989 please help answer @miguel-ortiz-marin's question above.

harshsoni7 avatar Oct 12 '23 14:10 harshsoni7

Hi @donch1989 does it make sense to proceed with an implementation like what I mentioned?

Are we assuming that the csv file is uploaded to the backend and then we pass the csv path to this operator ?

If so I can try to submit a PR today or tomorrow

miguel-ortiz-marin avatar Oct 24 '23 13:10 miguel-ortiz-marin

Hi @miguel-ortiz-marin,

The current requirement of the CSV operator is not clear yet. We are planning the new roadmap for these operators, and will update the feature description next week.

cc @harshsoni7

donch1989 avatar Oct 26 '23 08:10 donch1989