ircot

ircot copied to clipboard

Hi, when I was running `./reproduce.sh ircot flan-t5-base hotpotqa`, I faced a warning: > Token indices sequence length is longer than the specified maximum sequence length for this model (555...

oan-J

Dataset encoding format

1

What encoding method is used for the data set you provided? I opened it in UTF-8 encoding format. English characters are normal, but Russian and other languages are not normal.

foreverlove944

How the dataset in the experiment was passed into the framework？

1

Hi，may I ask how the dataset in the experiment was passed into the framework? In which directory? Is it passed in using ’id‘?

MR-Jin6

Connection refused

2

Hi, I encountered a problem: (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')). The specific error information is as follows. I'm not sure what the...

JessicaGao8

when index_exists = es.indices.exists(elasticsearch_index),elasticsearch.exceptions.ConnectionError

1

when index(error): elasticsearch.exceptions.ConnectionError: ConnectionError(: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(: Failed to establish a new connection: [Errno 111] Connection refused) I tried many...

C-YEE00

Where is the code that assigns a value to "rc_context_type"? I want to know in what situations the "rc_context_type" will have the "cot" suffix added.

ropz12138

For new dataset, how can I generate .jsonnet file for annotation and prompt? It seems that I have to design the prompt from scratch and cannot reuse the prompt-generation script...

Churrimorey

BlueTeamQQ1

How are prompts being picked up?

5

I am trying to experiment with prompts and I'm unable to check whether the system is picking up my changed prompts? 1. I have overwritten the "prompt_file" for my experiment...

mohdsanadzakirizvi

How is your retrieval recall calculated

1

How is your retrieval recall calculated

C-YEE00