tablib icon indicating copy to clipboard operation
tablib copied to clipboard

CSVW: CSV on the Web

Open westurner opened this issue 8 years ago • 11 comments

  • Read/write CSVW

    • [ ] Read CSVW
    • [ ] Write CSVW

CSVW

Homepage: https://w3c.github.io/csvw/ Standard: https://www.w3.org/TR/tabular-data-primer/ Standard: https://www.w3.org/TR/tabular-data-model/ Standard: https://www.w3.org/TR/tabular-metadata/ Standard: https://www.w3.org/TR/csv2json/ Standard: https://www.w3.org/TR/csv2rdf/ Namespace: http://www.w3.org/ns/csvw# xmlns: @prefix csvw: <http://www.w3.org/ns/csvw#> . @context: http://www.w3.org/ns/csvw.jsonld

CSVW (CSV on the Web) is a set of relatively new standards for representing CSV rows and columns as RDF (and JSON / JSON-LD) along with metadata.

  • URIs for datatypes (XSD, ...)
  • URIs for columns (RDF)
  • Document Metadata
  • CSV -> JSON ( -> JSON-LD -> RDF )
  • CSV -> RDF

.

  • https://wrdrd.github.io/docs/consulting/knowledge-engineering#csvw

westurner avatar Sep 01 '17 02:09 westurner

From https://twitter.com/westurner/status/901988850330996736 :

@kennethreitz SQL Query (from any DB) ⟿ Pandas DataFrame, in one line of code: https://github.com/kennethreitz/records#records-sql-for-humans

@westurner What about #CSVW #JSONLD? (#nbmeta #linkedreproducibility)

https://w3c.github.io/csvw/primer/

@kennethreitz want to send a pull request?

@westurner I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

@kennethreitz that'd be good! i just want to make sure curl/requests and friends get back data, not html

@westurner "Model for Tabular Data and Metadata on the Web" (#JSONLD, #RDFa HTML) is for Data on the Web #dwbp #linkeddata http://www.w3.org/TR/tabular-data-model/

@kennethreitz sounds like something to add to tablib! http://docs.python-tablib.org/en/master/

@westurner The challenge/opportunity is where to add the additional columnar metadata: {@sqlalchemy, #tablib,}

@westurner "7 metadata header rows (column label, property URI path, DataType, unit, accuracy, precision, significant figures)" https://wrdrd.github.io/docs/consulting/linkedreproducibility#csv-csvw-and-metadata-rows …

@kennethreitz hmm, tablib is quite dumb when it comes to that stuff.... could autodetect if all columns match

@kennethreitz or we just support strings out the gate and call it v0

@westurner #CSVW defaults to xsd:string if unspecified. "How do you support units of measure?" #qudt https://www.w3.org/TR/tabular-data-primer/#units-of-measure

@kennethreitz
i say we stick to strings and call it v0 :)

westurner avatar Sep 01 '17 02:09 westurner

@westurner I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

nbmeta: https://github.com/westurner/nbmeta

@westurner #CSVW defaults to xsd:string if unspecified.

From https://www.w3.org/TR/tabular-data-primer/#datatypes :+1:

NOTE You don't have to include "datatype": "string" for columns that are strings — columns are assumed to hold strings if no datatype is explicitly specified.

westurner avatar Sep 01 '17 02:09 westurner

this sounds awesome!

kennethreitz avatar Sep 01 '17 03:09 kennethreitz

Unfortunately I don't know when I'll be able to get to this while job searching.

On Thursday, August 31, 2017, Kenneth Reitz [email protected] wrote:

this sounds awesome!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/kennethreitz/tablib/issues/305#issuecomment-326480489, or mute the thread https://github.com/notifications/unsubscribe-auth/AADGy9bcXuifI956S5qCu2vlKN2f0TmRks5sd388gaJpZM4PJoIM .

westurner avatar Sep 01 '17 05:09 westurner

@westurner I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

attrs

  • Src: https://github.com/python-attrs/attrs
  • Docs: https://attrs.readthedocs.io/en/stable/
  • Docs: https://attrs.readthedocs.io/en/stable/examples.html#metadata
  • Docs: https://attrs.readthedocs.io/en/stable/extending.html#extending-metadata

westurner avatar Sep 01 '17 05:09 westurner

hey @westurner and @hugovk, I would like to collaborate on this feature and get it up and going. Can you guys guide me or may be point me in the right direction to start this. Thanks in advance. :smiley:

farhaanbukhsh avatar Oct 31 '19 07:10 farhaanbukhsh

Have a look at the dev docs:

  • https://tablib.readthedocs.io/en/stable/development/

hugovk avatar Oct 31 '19 07:10 hugovk

@hugovk thanks for pointing this to me will try to do a WIP and then we can take this ahead.

farhaanbukhsh avatar Nov 06 '19 06:11 farhaanbukhsh

Autho comment

56789KD avatar Sep 13 '24 17:09 56789KD

Comment

56789KD avatar Sep 16 '24 09:09 56789KD

@56789KD Please stop spamming.

hugovk avatar Sep 16 '24 10:09 hugovk