NeMo
NeMo copied to clipboard
NVIDIA
Support Canary parallel inference
What does this PR do ?
Support Canary at transcribe_speech_parallel.py script
Collection: ASR
#python3 ./examples/asr/transcribe_speech_parallel.py model=./canary-1b.nemo predict_ds.manifest_filepath=./manifest.json output_path=/tmp trainer.devices=-1
PR Type:
- [ V] New Feature
- [ ] Bugfix
- [ ] Documentation
Who can review?
@pzelasko
+ like we talked offline, we have to work around global_rank being set incorrectly before trainer.predict() is called - the dataloader has to be initialized with the correct global_rank (and world_size) in order for lhotse's distributed sampler to work correctly
trainer.global_rank is apriori set by PTL in slurm environment. It does not require model to be built or it's functions to be called c
Is this a case where PTL cannot apriori detect global rank ?
This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
This PR was closed because it has been inactive for 7 days since being marked as stale.
This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days.
This PR was closed because it has been inactive for 7 days since being marked as stale.
[🤖]: Hi @karpnv 👋,
I just wanted to let you know that, you know, a CICD pipeline for this PR just finished successfully ✨
So it might be time to merge this PR or like to get some approvals 🚀
But I'm just a 🤖 so I'll leave it you what to do next.
Have a great day!
//cc @ko3n1g
[🤖]: Hi @karpnv 👋,
I just wanted to let you know that, you know, a CICD pipeline for this PR just finished successfully ✨
So it might be time to merge this PR or like to get some approvals 🚀
But I'm just a 🤖 so I'll leave it you what to do next.
Have a great day!
//cc @ko3n1g
[🤖]: Hi @karpnv 👋,
I just wanted to let you know that, you know, a CICD pipeline for this PR just finished successfully ✨
So it might be time to merge this PR or like to get some approvals 🚀
But I'm just a 🤖 so I'll leave it you what to do next.
Have a great day!
//cc @ko3n1g