Skip to content Skip to sidebar Skip to footer
Showing posts with the label Bert Language Model

Fine-tune Bert For Specific Domain (unsupervised)

I want to fine-tune BERT on texts that are related to a specific domain (in my case related to engi… Read more Fine-tune Bert For Specific Domain (unsupervised)

How To Stop Bert From Breaking Apart Specific Words Into Word-piece

I am using a pre-trained BERT model to tokenize a text into meaningful tokens. However, the text ha… Read more How To Stop Bert From Breaking Apart Specific Words Into Word-piece

Attributeerror: 'str' Object Has No Attribute 'dim' In Pytorch

I got the following error output in the PyTorch when sent model predictions into the model. Does an… Read more Attributeerror: 'str' Object Has No Attribute 'dim' In Pytorch

Bert Get Sentence Level Embedding After Fine Tuning

I came across this page 1) I would like to get sentence level embedding (embedding given by [CLS] t… Read more Bert Get Sentence Level Embedding After Fine Tuning