CodeGPT icon indicating copy to clipboard operation
CodeGPT copied to clipboard
verified publisher icon carlrobertoh

Problems with code completion using custom openai service (koboldcpp openapi)

Open unixshaman opened this issue 1 year ago • 2 comments

What happened?

IntelliJ IDEA code completion dont work with error image

Request to service: [koboldcpp.autocomplete.request.txt] (https://github.com/carlrobertoh/CodeGPT/files/15349274/koboldcpp.autocomplete.request.txt) Response from service: koboldcpp.autocomplete.response.txt

Relevant log output or stack trace

Stacktrace from idea:

2024-05-17 15:44:15,902 [  38035]   INFO - STDERR - [OkHttp https://ai.server.ru/...] INFO ee.carlrobert.llm.completion.CompletionEventSourceListener - Request opened.
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - [OkHttp https://ai.server.ru/...] ERROR ee.carlrobert.llm.completion.CompletionEventSourceListener - Could not serialize error response
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - java.lang.IllegalArgumentException: byteCount < 0: -1
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - 	at okio.RealBufferedSource.request(RealBufferedSource.kt:205)
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - 	at okio.RealBufferedSource.require(RealBufferedSource.kt:203)
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - 	at okio.RealBufferedSource.readFully(RealBufferedSource.kt:280)
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - 	at okhttp3.internal.sse.ServerSentEventReader$Companion.readData(ServerSentEventReader.kt:148)
2024-05-17 15:44:20,048 [  42181]   INFO - STDERR - 	at okhttp3.internal.sse.ServerSentEventReader$Companion.access$readData(ServerSentEventReader.kt:112)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at okhttp3.internal.sse.ServerSentEventReader.processNextEvent(ServerSentEventReader.kt:57)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at okhttp3.internal.sse.RealEventSource.processResponse(RealEventSource.kt:75)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at okhttp3.internal.sse.RealEventSource.onResponse(RealEventSource.kt:46)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2024-05-17 15:44:20,049 [  42182]   INFO - STDERR - 	at java.base/java.lang.Thread.run(Thread.java:833)
2024-05-17 15:44:20,050 [  42183] SEVERE - #ee.carlrobert.codegpt.codecompletions.CodeCompletionEventListener - Unknown API response. Code: 200, Body: 
com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
 at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1]
	at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
	at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4996)
	at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4898)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3848)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3816)
	at ee.carlrobert.llm.client.openai.completion.OpenAITextCompletionEventSourceListener.getErrorDetails(OpenAITextCompletionEventSourceListener.java:43)
	at ee.carlrobert.llm.completion.CompletionEventSourceListener.onFailure(CompletionEventSourceListener.java:109)
	at okhttp3.internal.sse.RealEventSource.processResponse(RealEventSource.kt:78)
	at okhttp3.internal.sse.RealEventSource.onResponse(RealEventSource.kt:46)
	at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)
2024-05-17 15:44:20,051 [  42184] SEVERE - #ee.carlrobert.codegpt.codecompletions.CodeCompletionEventListener - IntelliJ IDEA 2022.3.2  Build #IC-223.8617.56
2024-05-17 15:44:20,051 [  42184] SEVERE - #ee.carlrobert.codegpt.codecompletions.CodeCompletionEventListener - JDK: 17.0.5; VM: OpenJDK 64-Bit Server VM; Vendor: JetBrains s.r.o.
2024-05-17 15:44:20,051 [  42184] SEVERE - #ee.carlrobert.codegpt.codecompletions.CodeCompletionEventListener - OS: Windows 10
2024-05-17 15:44:20,052 [  42185] SEVERE - #ee.carlrobert.codegpt.codecompletions.CodeCompletionEventListener - Plugin to blame: CodeGPT version: 2.7.1-223

Steps to reproduce

  1. Setup CodeGPT with following settings: CodeGPT_CustomServiceSettings.xml.txt

  2. Press Enter anythere in the code

  3. Showing notification with fail

  4. Somethimes showing IDE Internal Error:


com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
 at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1]
	at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
	at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4996)
	at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4898)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3848)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3816)
	at ee.carlrobert.llm.client.openai.completion.OpenAITextCompletionEventSourceListener.getErrorDetails(OpenAITextCompletionEventSourceListener.java:43)
	at ee.carlrobert.llm.completion.CompletionEventSourceListener.onFailure(CompletionEventSourceListener.java:109)
	at okhttp3.internal.sse.RealEventSource.processResponse(RealEventSource.kt:78)
	at okhttp3.internal.sse.RealEventSource.onResponse(RealEventSource.kt:46)
	at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)

CodeGPT version

2.7.1-223

Operating System

Windows

unixshaman avatar May 17 '24 12:05 unixshaman

The error is reproduced on: Windows 10 koboldcpp-1.80.3 CodeGPT version 2.15.0

tverdostas avatar Jan 02 '25 21:01 tverdostas

Also reproduced on: Windows 10 KoboldCpp API 2025.06.03 ProxyAI version 3.4.4-241.1

andyceo avatar Jul 14 '25 16:07 andyceo