Embedding source and data files alongside knowledge posts via post metadata

[shashj199]

Auto-reviewers: @NiharikaRay @matthewwardrop @earthmancash @danfrankj

Hi Guys,

I was wondering if I can somehow integrate data associated with Jupyter notebook in the knowledge repo. I am testing knowledge repo but I don't see how we can do that.

Thanks for your help

[matthewwardrop]

Hi @shashj199 !

Currently this can be done using: knowledge_repo ... add ... --src <src files separated by spaces>

This is a little clunky though, and so soon I am planning to add support for specifying the source files in the post metadata, something like:

title: "Awesome title of post"
...
srcfiles:
- my_srcfile1.data
- reference.pdf

whereupon these files will be included in the knowledge repo along with the post content. Should be done by end of June.

I'll keep this around so I don't forget :).

[shashj199]

Oh thanks, this will be game changing 👍 . But can this be connected to cloud like S3 and similar to what you have done for images. May this might be too much.

Thanks again

[matthewwardrop]

@shashj199 Since KnowledgePostProcessor instances have access to the entire knowledge post and all its references, this should be possible to do. Will keep this in mind when I implement it.

[susanjo80]

Once we're able to add source files with a knowledge post, how do we call them in the Rmd or Jupyter Notebook file? i.e. in R we would write something like: load(file = 'df.rdata')

[romanovzky]

Any updates on this? It would be very useful! Cheers

[csharplus]

@romanovzky we're working on the plan to add more new features, and would like to learn more about your use case. Is it Ok to set up a quick Zoom meeting to discuss this feature with you? cc @JJJ000