Does anyone know of a way to get the BERT model working for word embeddings in Mathematica? Doesn’t seem to be available on GitHub or the Wolfram Net Repo...
As Wolfram Language 12 is just released so are the following new relevant models compatible with it. They were just added to the Wolfram Neural Network repository:
BERT Trained on BookCorpus and English Wikipedia Data - Represent text as a sequence of vectors
GPT Transformer Trained on BookCorpus Data - Generate text in English and represent text as a sequence of vectors
There are more updates in Neural Nets Repo that can be quickly scanned at:
There is more to come of course, stay tuned !