Code relative to the participation of the Troy&AbedInTheMorning team in the ProfNER-ST: Identification of professions & occupations in Health-related Social Media.
Our proposed system is based on an encoder-decoder architecture with an attention mechanism powered by a combination of word embeddings that include pre-trained fine-tuned spanish BERT embeddings.
The developed code is here while the fine-tuned BETO proccess can be found here.