Ryuto Koike

icon indicating a website link ryuryukke.github.io icon indicating an email [email protected]

icon company Tokyo Institute of Technology icon location Tokyo, Japan icon location PhD @nlp-titech | Prev: UPenn | Trustworthy NLP

Results 2 comments of Ryuto Koike

How does google.generativeai.count_message_tokens work?

Furthermode, I tried another string "aaaaaaa", but got the same 12. Why does this happen? ```Python import google.generativeai as palm import os palm_api_key = os.getenv("PALM_API_KEY") palm.configure(api_key=palm_api_key) def count_tokens(string): res =...

google.generativeai.chat does not support max_output_tokens

I found that a PaLM Chat model in Vertex AI SDK supports max_output_tokens.: https://cloud.google.com/vertex-ai/docs/generative-ai/model-reference/text-chat