MetaDialog
MetaDialog copied to clipboard
Atis fewshot generation error
Hi all,
I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the all_domain as follows:
all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'],
['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'],
['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'],
['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'],
['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'],
['atis_day_name']]
*note: I used the function load_data in the raw_data_loader.py to get the unique intents to add to the list.
after running the gen_meta_data.sh I get this error:
can you please tell me what should I do about it? I also want to know if I can use this tool for dstc8-schema-guided-dialogue?
thank you in advance
@AtmaHou can you please let me know if you know the solution. thank you in advance
Hi all,
I am facing a new error while generating the few shot dataset for ATIS, even though the structure is so similar and both are using the same dataloader. the only difference is the config to edit the
all_domainas follows: all_domain = [['atis_flight'], ['atis_airfare'],['atis_airline'],['atis_ground_service'], ['atis_quantity'], ['atis_city'], ['atis_flight', 'atis_airfare'],['atis_abbreviation'], ['atis_aircraft'],['atis_distance'],['atis_ground_fare'],['atis_capacity'],['atis_flight_time'], ['atis_meal'],['atis_aircraft', 'atis_flight', 'atis_flight_no'],['atis_flight_no'],['atis_restriction'], ['atis_airport'],['atis_airline', 'atis_flight_no'],['atis_cheapest'],['atis_ground_service', 'atis_ground_fare'], ['atis_day_name']] *note: I used the functionload_datain theraw_data_loader.pyto get the unique intents to add to the list.after running the
gen_meta_data.shI get this error:![]()
can you please tell me what should I do about it? I also want to know if I can use this tool for dstc8-schema-guided-dialogue?
thank you in advance
I haven't encountered the exact same error. It shows that you are sampling from an empty list, maybe you can check your label bucket and find if there are some label has no corresponding samples.
For dstc8, the tool itself is data-agnostic : )