[Problem] Trying to integrate Paperless AI with Foundry Local

[cswaas]

I'd like to use Microsoft Foundry Local on my Macbook Pro as LLM in combination with Paperless AI. I opened an Issue there as well.

From my investigation the problem points to Foundry Local not supplying the usage block in its response. Following a test curl call from the Paperless AI container to Foundry Local.

curl http://host.docker.internal:8081/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer local" \
  -d '{
    "model": "qwen2.5-14b-instruct-generic-gpu:4",
    "messages": [
      { "role": "user", "content": "Test usage field for Paperless AI integration." }
    ],
    "temperature": 0.2,
    "stream": false
  }'
> > > > > > > > > > 
{"model":"qwen2.5-14b-instruct-generic-gpu:4","choices":[{"delta":{"role":"assistant","content":"Integrating Paperless AI into various usage fields can significantly enhance efficiency and streamline processes in multiple industries. Here are some potential usage fields where Paperless AI could be effectively integrated:\n\n1. **Document Management Systems**: Automate the scanning, indexing, and categorization of documents to create a digital archive. This reduces physical storage needs and improves accessibility.\n\n2. **Legal and Compliance**: Assist in compliance with regulations by automatically identifying and tagging sensitive information such as personal data or financial details. It can also help in contract review and management.\n\n3. **Healthcare**: Enable the digitization of patient records, ensuring quick access to medical histories and improving patient care. AI can assist in identifying patterns in patient data that might indicate potential health issues.\n\n4. **Finance**: Implement AI for invoice processing, fraud detection, and risk assessment. Automated analysis of financial documents can provide real-time insights and reduce manual workload.\n\n5. **Customer Service**: Use AI to manage customer inquiries and complaints through chatbots that","tool_calls":[]},"message":{"role":"assistant","content":"Integrating Paperless AI into various usage fields can significantly enhance efficiency and streamline processes in multiple industries. Here are some potential usage fields where Paperless AI could be effectively integrated:\n\n1. **Document Management Systems**: Automate the scanning, indexing, and categorization of documents to create a digital archive. This reduces physical storage needs and improves accessibility.\n\n2. **Legal and Compliance**: Assist in compliance with regulations by automatically identifying and tagging sensitive information such as personal data or financial details. It can also help in contract review and management.\n\n3. **Healthcare**: Enable the digitization of patient records, ensuring quick access to medical histories and improving patient care. AI can assist in identifying patterns in patient data that might indicate potential health issues.\n\n4. **Finance**: Implement AI for invoice processing, fraud detection, and risk assessment. Automated analysis of financial documents can provide real-time insights and reduce manual workload.\n\n5. **Customer Service**: Use AI to manage customer inquiries and complaints through chatbots that","tool_calls":[]},"index":0,"finish_reason":"stop"}],"created":1764408781,"CreatedAt":"2025-11-29T09:33:01+00:00","id":"chat.id.22","IsDelta":false,"Successful":true,"HttpStatusCode":0,"object":"chat.completion"}

The response does not contain the usage block:

According to the Foundry Local docu the usage block should be contained in the response:

[natke]

Thank you for reporting this. We will look into adding the usage data, which is important for other scenarios too.