financial-demo
financial-demo copied to clipboard
bump up to 150 epochs
Intent Cross-Validation Results (3 folds)
class | support | f1-score | confused_with |
---|---|---|---|
macro avg | 337 | 0.8188 | N/A |
weighted avg | 337 | 0.8596 | N/A |
inform | 78 | 0.8889 | pay_cc(6), transfer_money(2) |
check_balance | 47 | 0.9485 | search_transactions(1) |
transfer_money | 36 | 0.8831 | pay_cc(2) |
pay_cc | 33 | 0.8649 | inform(1) |
search_transactions | 23 | 0.8980 | check_balance(1) |
greet | 20 | 0.8500 | transfer_money(1), inform(1) |
affirm | 15 | 0.6923 | inform(3), greet(2) |
check_recipients | 13 | 0.9600 | pay_cc(1) |
check_earnings | 13 | 0.8800 | search_transactions(1), check_balance(1) |
thankyou | 11 | 0.8800 | N/A |
deny | 10 | 0.5000 | transfer_money(1), thankyou(1) |
help | 10 | 0.9524 | N/A |
goodbye | 10 | 0.5333 | affirm(2), transfer_money(1) |
human_handoff | 9 | 0.8000 | deny(2), transfer_money(1) |
ask_transfer_charge | 9 | 0.7500 | transfer_money(1), search_transactions(1) |
Entity Cross-Validation Results (5 folds)
entity | support | f1-score | precision | recall |
---|---|---|---|---|
micro avg | 233 | 0.9451 | 0.9295 | 0.9614 |
macro avg | 233 | 0.9599 | 0.9456 | 0.9751 |
weighted avg | 233 | 0.9453 | 0.9303 | 0.9614 |
credit_card | 94 | 0.9468 | 0.9468 | 0.9468 |
account_type | 86 | 0.9213 | 0.8913 | 0.9535 |
payment_amount | 34 | 0.9714 | 0.9444 | 1.0000 |
vendor_name | 19 | 1.0000 | 1.0000 | 1.0000 |