drbh

Results 69 comments of drbh

@jploski thanks for starting this conversation in `ggml` and `llm-foundry`! I agree that adding Mosaic 7B is a great idea! I happen to see you mentioned that you started some...

tagging @djc for visibility

Hi @puppetm4st3r thank you for the feedback on the PR , I've updated the default prompt and looked into changing how the tools are appended to the input. Currently I'm...

@puppetm4st3r I think for now we'll include the current changes and keep the discussion open regarding tools and the template. It seems like there may be some convergence in using...

### note: details of tool -> grammar TGI is able to use tools by leveraging the grammar functionality. A tool is simply a specifically formatted grammar that includes `"$functions"` and...

Hi @yanivshimoni89 it's unclear if this is the intended functionality of the original openai chat api. Looking into the vllm issue linked above it looks like theres only been a...

Hey @philippgille, I've made some good progress on pulling the TX list. Heres what a single transaction from a transaction list looks like ```json [ { "raw_bytes": "0x0a20000000000000000000000000000000000000000000000000000000000000000028904e38bfecb8e9051af4010abf014c49425241564d0a010007014a000000060000000350000000060000000c56000000050000000d5b00000004000000055f0000003300000004920000002000000007b20000000d000000000000010002000300010400020002040203020402063c53454c463e0c4c696272614163636f756e74094c69627261436f696e046d61696e0f6d696e745f746f5f6164647265737300000000000000000000000000000000000000000000000000000000000000000001020004000c000c01110102122408011220f7d5da0c23abd8a7d33fbf200ed9f5a25329020cfecb7d2375f7447b22940354120a120800e1f50500000000", "sender_pub_key": "0x4bd5f14227c3c3dfcb74454fb31005dac5631522552b30ac0edae67cc8abe405",...

@itowlson thanks for the quick response. All of those points make sense! My use case is that I'd like to allow one component to handle incoming requests, it should parse...

This is a known issue with iOS Webviews. The fix is to inject JS into the Webview to stop it from zooming. ```js const iosZoomFix = "const meta = document.createElement('meta');...

related PR merged in TGI: https://github.com/huggingface/text-generation-inference/pull/1854