Cesc

build successfully without cuda but failed to import libcudart.so when import

1

I've built warp-ctc and pytorch-binding successfully in cpu-only environment, but failed to import warpctc_pytorch with cudart error: ```python In [1]: import warpctc_pytorch --------------------------------------------------------------------------- ImportError Traceback (most recent call last) in...

Hey guys, I wanna know is the preprocess scripts avaliable to generate lyric text like following: https://github.com/microsoft/muzic/blob/de070928019becada50bf31d54e8f445bc06d899/deeprapper/data/lyrics/lyrics_samples/raw/rap_%E5%8A%9F%E5%A4%AB%E8%83%96KungFuPen/%E9%9A%8F%E5%8F%A3%E8%AE%B0/%E7%81%B5%E9%AD%82%E5%88%97%E8%BD%A6/lyric_with_beat.txt#L1-L3 I didn't find it in this repo.

telemelody: how can I get dict.trend.txt?

3

When inference using pretrained models, I got error about missing file: ```shell FileNotFoundError: [Errno 2] No such file or directory: 'data-bin/template2melody_zh/dict.trend.txt' ``` I have `dict.beat.txt` and `dict.lyric.txt` copied from training...

quetion about the loss and grad of "mbr"

3

https://github.com/hirofumi0810/neural_sp/blob/2b10b9cc4bdecb5180ecc45575c0ef410fb09aa3/neural_sp/models/seq2seq/decoders/las.py#L535-L548 I don't know much about mbr, according to these lines, it looks like a [mWER](https://ieeexplore.ieee.org/abstract/document/8461809) loss and gradient to me

what's the intention of mocha first layers?

18

https://github.com/hirofumi0810/neural_sp/blob/78fa843e7f9b27b93a57099104db49d481ff95bb/neural_sp/models/seq2seq/decoders/transformer.py#L190-L194 hey, I notice there'll be `mocha_first_layer - 1` transformer blocks without encoder-decoder attention, what's the intention of it? And I copied the neural_sp transformer decoder into espnet, training will...

I found some typo/bugs in your repo, feel sorry to ask, but could you provide a runner script which reproduce the experments in your paper

RuntimeError exporting stateless5 model using jit

4

I'm using ./pruned_transducer_stateless5/export.py with `--jit true` and get runtime error: ```python RuntimeError: Python builtin is currently not supported in Torchscript: File "/data/fangzhouhua/bluesky/icefall-master/egs/hik/asr1/pruned_transducer_stateless5/scaling.py", line 664 def forward(self, x: Tensor) -> Tensor:...

on-the-fly fbank feats

17

Hey guys, I notice there‘s on-the-fly feats in `asr_datamodule.py`: https://github.com/k2-fsa/icefall/blob/32de2766d591d2e1a77c06a40d2861fb1bbcd3ad/egs/wenetspeech/ASR/pruned_transducer_stateless2/asr_datamodule.py#L279-L298 However, I didn't find any recipe using that feats, how could I using on-the-fly feats instead of making fbank first(I'm...

streaming_decode.py or decode.py under stateless5?

2

Hey guys, I see both `streaming_decode.py` and `decode.py` under stateless5 support streaming decoding, what's the difference?

install error: Could not build wheels for lhotse, which is required to install pyproject.toml-based projects

2

I'm installing lhotse from source: ```bash pip install -e . ``` and got following message: ```bash ... Building editable for lhotse (pyproject.toml) ... done Created wheel for lhotse: filename=lhotse-1.10.0.dev.unknownsource-0.editable-py3-none-any.whl size=7657...