Hailey Collet

[bloomz_q4_0_50kb.zip](https://github.com/rustformers/llm/files/11995994/bloomz_q4_0_50kb.zip) Certainly! Here it is. Thanks for taking a look.

> I personally would like to test its abilities with tool selection and function calling, both things all the 33-65B models I've tried struggle with, at least in terms of...

Ah ... the fork used to create the quant is older than the code used as basis for this implementation. Which I assume means this isn't an issue for this...

Well, we'll see, maybe in the end it's worth writing off ;) Would like to give it a thorough try though. Will keep you posted ... TheBloke indicated he'd try...

Here's a script to monkeypatch Marker with @umarbutler 's solution: ```python import ast import inspect import marker.postprocessors.markdown class MarkdownTransformer(ast.NodeTransformer): def __init__(self): self.current_function = None def visit_FunctionDef(self, node): # Store the...