Korean is not included in metadata

[rlatjgml38]

Describe the bug When I try to input Korean in description an error occurs. I think I need utf8 encoding to input Korean. What should I do?

To Reproduce

1. Made the json file (test3.json)

[
{
    "auditHeader": null,
    "entityType": "dataset",
    "entityUrn": "urn:li:dataset:(urn:li:dataPlatform:oracle,한글테스트2,PROD)",
    "entityKeyAspect": null,
    "changeType": "UPSERT",
    "aspectName": "datasetProperties",
    "aspect": {
        "value": "{\"description\": \"한글 설명\"}",
        "contentType": "application/json"
    },
    "systemMetadata": null
}
]

2. Made the yml file (file_to_datahub.yml)

source:
        type: "file"
        config:
                filename: "./test3.json"
sink:
        type: "datahub-rest"
        config:
                server: "http://localhost:8080"
reporting:
        - type: "datahub"
          config:
                  datahub_api:
                          server: "http://localhost:8080"

3. Run datahub ingest -c file_to_datahub.yml

Screenshots

Desktop (please complete the following information):

• OS: Ubuntu 18.04
• Datahub Version: 0.8.32

Additional context I succeeded in putting Korean in urn. When there is no Korean in the description. However, Korean is not included in metadata. (e.g. description, column name, subtype's typeName, etc.) And I tried to install v0.8.36 and v0.8.39, but I couldn't use it with a red error window saying "Oops, an error occurred".

[rlatjgml38]

#5306

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io

[aditya-radhakrishnan]

Hi is this still an issue? From our side it looks like Python ingestion does support non utf-8 characters