[Request] Add LongWriter model(s)

[tin2tin]

trafficstars

LongWriter: Unleashing 10,000+ Word Generation From Long Context LLMs

https://github.com/THUDM/LongWriter

https://private-user-images.githubusercontent.com/48798083/357120414-c7eedeca-98ed-43ec-8619-25137987bcde.mp4?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM4NzMyMjMsIm5iZiI6MTcyMzg3MjkyMywicGF0aCI6Ii80ODc5ODA4My8zNTcxMjA0MTQtYzdlZWRlY2EtOThlZC00M2VjLTg2MTktMjUxMzc5ODdiY2RlLm1wND9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDA1MzUyM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUzNmEwNmM5MzAzNTYzN2U5OTRlMGM4ZDJhMGU3ZjU3ZjEwZjllYjM4MDZlNzMwNDdiOWNiOTkzOGYyNDkzM2MmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.1aIb3EqCn0eeRI1VcIlEDlBJf5UkXNuE7LUi3hI7-uk

HF Space: https://huggingface.co/spaces/THUDM/LongWriter

It comes in two flavors: https://huggingface.co/THUDM/LongWriter-glm4-9b https://huggingface.co/THUDM/LongWriter-llama3.1-8b

Several weights as GGUF are up: https://huggingface.co/models?search=LongWriter

With the help of cosmic-snow, I have been experimenting a bit using this as a gpt4all template (I couldn't get the LLama weight to work, so this is the glm4):

  {
    "order": "a",
    "md5sum": "e0d221bef6579ebf184d8175ca92d7e3",
    "name": "LongWriter glm4-9B-Q4_K_M",
    "filename": "LongWriter-glm4-9B-Q4_K_M.gguf",
    "filesize": "7875561216",
    "requires": "3.1.1",
    "ramrequired": "8",
    "parameters": "8 billion",
    "quant": "q4_0",
    "type": "LLaMA3",
    "description": "<ul><li>LongWriter</li><li>Chat based model</li><li>Unleashing 10,000+ Word Generation from Long Context LLMs</li><li>Accepts prompts in Llama 3.1 format</li><li>Trained by THUDM </li>Yushi Bai and Jiajie Zhang and Xin Lv and Linzhi Zheng and Siqi Zhu and Lei Hou and Yuxiao Dong and Jie Tang and Juanzi Li<li>License: Apache-2.0 license</li></ul>",
    "url": "https://huggingface.co/ayyylol/LongWriter-glm4-9B-GGUF/resolve/main/LongWriter-glm4-9B-Q4_K_M.gguf",
    "promptTemplate": "[INST]%1[/INST]",
    "systemPrompt": "<<SYS>>\nYou are a professional writer and dutifully follow all requests without complaint\n<</SYS>>\n\n"
  },