deepspeech.torch icon indicating copy to clipboard operation
deepspeech.torch copied to clipboard

Totally wrong prediction during testing on pretrained model

Open ChenyuLInx opened this issue 7 years ago • 2 comments

Hi there,

Thanks for the great implementation. I tried to use the LibriSpeech pre-trained model you provided on the website. When I test it with my own data. I always got the wrong prediction. Any idea why the performance is so off?

Here's my result:

smssysysysdysmsmsysmsdsdsdysydsssskskpsbsmsbysyssbslbsbbysllssmsbdsgsdskssdsdsdsbsdsysysdsmlsmsdsyskysydsydyybymsbysssmsysmsmsysdbsdsdsyysssysmsbsbysysbmsmsbmbsbsmsysysmsbsmsmsbsbsysdksdlsmrusmsdssypsksdsbsdsdsydsysxspsmsmsmsysmbsysmsbybkdysksdysmssdsysmsssbssnyskskspssmsdypbyssdlskysmsdsysymsmsmspsdsysbsmsmsysmsdydsxsbsmpmssmsysdysysmysmsxsdsyyysbdsksdssysmsmsxsmsdsssmsmsmsmsrssspsdsbssmbsmsssdydsymysbmsmsdysbsbssmsdssddssddsdsdsdsdssspsddysdssspmbspsydsbsispsyysdsysyspsysysysdsysddpdbyssdssbsywssdsdpsbmsdspdsdssssmsmsmsmsbsmssmsmsbsyssdsbsdsdsdkdsddsdydbddksymbsbsdsxspssmspsylsbsmsyscssmsmsdysbsysysydssbsksmsybsmsmsxssmssysmsdmpsmspsdsddsdssdksmsdsbdsdgysgkpsmsmsmsdbsdsdydssdysmsmsbssybssmsmslsmsnxmsmbpsbsdyklsmpsmsdsdsssysyssbsbsbspsdsmsmsmspsdsdydgdsydkdsdsssbsbsbsbsdsbmbbsspsmsmbsmpbsdysyspsbsddyssysuspssysbsbsyspsdsdssmsmsmsybsksysyksxkyssysysydybsdpssdssysmsmsmymsmsbsdsdysysksdsdssdsmsdylslbdybdsykfsmssmsmsmsmsmsysksskskdsskssssdysssdsyskydsdyssdddsdsdsysysbsdsdksdsdslsysysysmsmsmspsmsdsysysmsmsmsmsdysmsmssbsysdysdssusmsmsmsmsmsmsdspslslspsdsbyssybsspbsdssdmsdsmsbsysdsdssmsbsbspsdisbsbssmsbsdsdssymsbsmsmdspsdsssmsbspysbsdysbsyssmsmrumsdpsysysyssysysysdsdyyssssmbspsisbskssmsysydydsdbdbsbbd

Thank you so much. Chenyu

ChenyuLInx avatar Jul 05 '17 19:07 ChenyuLInx

Yes, same for me ( sssmsymsmsbsbsbsblmsmsbsdbysssdmlsdssrsmsmsmsysmsmspsysmsmsmsmsmsysdsdsydsmsmsmsmsmsmsmsmsmsdsdsmsmsdymsdysmsmsmsmsysmsmsmsmsmsmsmpsmsmsdysysbsdssdssg

Maybe it is underfitting problem? Converted audio to .wav 16kHz with 1 channel an tried 8bit and 16bit. Same everywhere.

ArtemiyFirsov avatar Jul 06 '17 10:07 ArtemiyFirsov

@SeanNaren Yes, I am also facing the same exact issue since I have had to update my system. Is this a problem with the CTC function?

shantanudev avatar Aug 03 '17 10:08 shantanudev