typedb-loader icon indicating copy to clipboard operation
typedb-loader copied to clipboard

TypeDB Loader - Data Migration Tool for TypeDB

Results 13 typedb-loader issues
Sort by recently updated
recently updated
newest added
trafficstars

Hi TypeDB-Loaders, Thank you for open-sourcing such a great tool! I cannot find any documentation on importing attributes of attributes. The appendAttribute functionality only is documented to work for entities...

```Is there any paramter/attribute there to limit the number of rows while loading the data to typedb in config.json?```

When trying to ingest from .tsv files using Loader 1.4.1 on Ubuntu 20.04, I receive the following error: ``` [open_alex_0::5] ERROR com.vaticle.typedb.osi.loader.loader - async-writer-4: [THW07] Invalid Thing Write: Attempted to...

To reproduce: Follow the steps in https://github.com/vaticle/typedb-examples/blob/catalogue-of-life/catalogue_of_life/README.md#quickstart Typical output: OOM in typedb server while finalizing the "naming" rule. Occasionally the loader OOMs as well.

It appears that as the TypeDB Java client is updated, and the TypeQL version has changed, the string representation of a query changed. There are places where the generators look...

In [ConfigurationValidation.java:68-75](https://github.com/typedb-osi/typedb-loader/blob/master/src/main/java/config/ConfigurationValidation.java#L68-L75) `getIgnoreGenerators()` is called when it may be null, which causes the loader to crash if the orderedBeforeGenerators or orderedAfterGenerators were defined, but ignoreGenerators weren't.

There seems to be an encoding issue when progress is logged when running typedb-loader in Windows Terminal/PowerShell terminal. See the screenshot below: ![image](https://user-images.githubusercontent.com/15805484/165325722-f64e82b9-9b2b-4e71-b988-7ffc1e89c6d1.png) This happens in typedb-loader-1.1.0 on Windows 11.

Occasionally, we get an error from the loader that needs to be traced back to the source query that caused the error. For this purpose, it would be good to...

enhancement

## Goal One feature that has been removed as of the 1.0.0 version is the ability to stop and/or continue loading the dataset from a particular point. This is particularly...

## Problem to Solve Replace handwritten migrators with type-safe composable workflow syntax. ## Current Workaround Currently, we need to manually manage potentially batching/pooling and lots of string interpolation for mutations....