Hi, I am trying to use Conformer with ctc beam search decoder from https://github.com/parlance/ctcdecode. I have created 1000 subword tokens as classes using sentencepiece. Now whenever I use your code it runs smoothly for some iteration then suddenly gets killed and stops training. I use tiny batch size and model size and continuously monitor the GPU memory usage. Gpu use is always under half of the capacity of the GPU memory (using A5000 with 24 gb memory but training only using 7 gb). what could be the issue?

Thanks in advance.