Thomas Antony

Canceling a streaming call from client side

2

My question is similar to these: [https://github.com/grpc/grpc/issues/8023](https://github.com/grpc/grpc/issues/8023) [https://github.com/grpc/grpc-java/issues/3095](https://github.com/grpc/grpc-java/issues/3095) I have a streaming call that is being processed by a client that I want to interrupt partway through. What is the...

Is it possible to use this crate and show the usage information automatically if arguments are missing or parsing fails? This is the default behavior in `structopt` and `clap`.

Create a C-style API similar to whisper.cpp

5

This change makes it easier to use this code as a library - say to build python bindings on top of it. It extracts out the following functions into `llama.cpp`...

There was an off-by-one bug in the line ``` if (embd.size() > params.n_batch) { break; } ``` it would copy `n_batch+1` elements rather than `n_batch`. This PR fixes that and...

Draft: Add support for llama.cpp

6

My proof of concept for adding support for [llama.cpp](https://github.com/ggerganov/llama.cpp). It requires my experimental [Python bindings](https://pypi.org/project/llamacpp/) (v0.1.8 and up). This has no dependencies (with some caveats mentioned below). This is what...

Adding windows pointer/integer data types

6

I have been trying to access a 3rd-party win32 API using `cxx`. One of the first things I am coming across is that the library contains extensive use of windows-specific...