polymath
polymath copied to clipboard
Create a tool to generate embeddings given text
To start, it should produce a .pkl
file according to the format described in https://github.com/dglazkov/polymath/blob/main/format.md
It should accept a JSON document with a structure like:
{
chunks: [
text: '<raw text>',
//all of the following are optional
url: '<URL>',
image_url: '<IMAGE_URL>',
title: '<TITLE>',
description: '<DESCRIPTION>',
]
}