KAG
KAG copied to clipboard
OpenSPG
[Feature][Module Name] 领域知识抽取效果不佳
Search before asking
- [x] I had searched in the issues and found no similar feature requirement.
Description
KAG根据注入的schema抽取SPO三元组的效果不佳，运行日志查验发现，ner.py中schema变量仅提取了类的名称，未提取更多有效信息，这意味着LLM仅依靠类名称进行SPO抽取任务，导致抽取效果不佳。建议将预定义schema解析为结构统一的Python类，增加类注释和属性注释用于LLM理解。灵感来源，发表于ICLR-2024。
{
"instruction": "You're a very effective entity extraction system. Please extract all the entities that are important for knowledge build and question, along with type, category and a brief description of the entity. The description of the entity is based on your OWN KNOWLEDGE AND UNDERSTANDING and does not need to be limited to the context. the entity's category belongs taxonomically to one of the items defined by schema, please also output the category. Note: Type refers to a specific, well-defined classification, such as Professor, Actor, while category is a broader group or class that may contain more than one type, such as Person, Works. Return an empty list if the entity type does not exist. Please respond in the format of a JSON string.You can refer to the example for extraction.",
"schema": ["ArtificialObject", "Concept", "Date", "Keyword", "NaturalScience", "Transport", "Creature", "Others", "Organization", "Medicine", "GeographicLocation", "Works", "Building", "SemanticConcept", "Person", "Event", "Astronomy"],
"example": [
{
"input": "The Rezort is a 2015 British zombie horror film directed by Steve Barker and written by Paul Gerstenberger. It stars Dougray Scott, Jessica De Gouw and Martin McCann. After humanity wins a devastating war against zombies, the few remaining undead are kept on a secure island, where they are hunted for sport. When something goes wrong with the island's security, the guests must face the possibility of a new outbreak.",
"output": [
{
"name": "The Rezort",
"type": "Movie",
"category": "Works",
"description": "A 2015 British zombie horror film directed by Steve Barker and written by Paul Gerstenberger."
},
{
"name": "2015",
"type": "Year",
"category": "Date",
"description": "The year the movie 'The Rezort' was released."
},
{
"name": "British",
"type": "Nationality",
"category": "GeographicLocation",
"description": "Great Britain, the island that includes England, Scotland, and Wales."
},
{
"name": "Steve Barker",
"type": "Director",
"category": "Person",
"description": "Steve Barker is an English film director and screenwriter."
},
{
"name": "Paul Gerstenberger",
"type": "Writer",
"category": "Person",
"description": "Paul is a writer and producer, known for The Rezort (2015), Primeval (2007) and House of Anubis (2011)."
},
{
"name": "Dougray Scott",
"type": "Actor",
"category": "Person",
"description": "Stephen Dougray Scott (born 26 November 1965) is a Scottish actor."
},
{
"name": "Jessica De Gouw",
"type": "Actor",
"category": "Person",
"description": "Jessica Elise De Gouw (born 15 February 1988) is an Australian actress. "
},
{
"name": "Martin McCann",
"type": "Actor",
"category": "Person",
"description": "Martin McCann is an actor from Northern Ireland. In 2020, he was listed as number 48 on The Irish Times list of Ireland's greatest film actors"
}
]
}
],
"input": "Christopher Nolan_split_0
Christopher Edward Nolan ( ; born 30 July 1970) is an English-American film director, producer, and screenwriter.
He is one of the highest-grossing directors in history, and among the most successful and acclaimed filmmakers of the 21st century."
}
Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
