MetaDialog icon indicating copy to clipboard operation
MetaDialog copied to clipboard

Atis fewshot generation error

Open niloofar17 opened this issue 4 years ago • 2 comments

Hi all,

I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the all_domain as follows: all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'], ['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'], ['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'], ['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'], ['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'], ['atis_day_name']] *note: I used the function load_data in the raw_data_loader.py to get the unique intents to add to the list.

after running the gen_meta_data.sh I get this error:

Screenshot 2021-10-12 at 10 01 42

can you please tell me what should I do about it? I also want to know if I can use this tool for dstc8-schema-guided-dialogue?

thank you in advance

niloofar17 avatar Oct 12 '21 06:10 niloofar17

@AtmaHou can you please let me know if you know the solution. thank you in advance

niloofar17 avatar Oct 20 '21 20:10 niloofar17

Hi all,

I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the all_domain as follows: all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'], ['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'], ['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'], ['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'], ['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'], ['atis_day_name']] *note: I used the function load_data in the raw_data_loader.py to get the unique intents to add to the list.

after running the gen_meta_data.sh I get this error:

Screenshot 2021-10-12 at 10 01 42

can you please tell me what should I do about it? I also want to know if I can use this tool for dstc8-schema-guided-dialogue?

thank you in advance

I haven't encountered the exact same error. It shows that you are sampling from an empty list, maybe you can check your label bucket and find if there are some label has no corresponding samples.

For dstc8, the tool itself is data-agnostic : )

AtmaHou avatar Oct 21 '21 00:10 AtmaHou