Domain adaptation of distilBERT on HTTP URIs and then using this URI2vec model to train URI sequence discriminating LSTM networks and transformer encoder
-
Updated
Sep 5, 2024 - Python
Domain adaptation of distilBERT on HTTP URIs and then using this URI2vec model to train URI sequence discriminating LSTM networks and transformer encoder
Code for "Using Masked Language Model Probabilities of Connectives for Stance Detection in English Discourse"
This project implements a Masked Language Model using BERT, a transformer-based model developed by Google, to predict masked words in text sequences.
Domain adaptation of DistilBERT to create a HTTP2vec model which is then trained end to end with a classifier head on CSIC 2010 HTTP dataset to detect HTTP attacks
Rescoring Automatic Speech Recognition using Large Language Models
SpringBoot-based microserviced web app which unmasks, using CodeBERT MLM, a code prompt
Using an LLM to discover the genetic causes of rare disease
Tutorial for creating a masked language model for a vernacular of your choice
BERT Attention Visualization is a web application powered by Streamlit, offering intuitive visualization of attention weights generated by BERT-based models.
Code for "ELLEN: Extremely Lightly Supervised Learning For Efficient Named Entity Recognition" (LREC-COLING 2024)
Data pipelines for both TensorFlow and PyTorch!
Score masked language models on grammar test suites
Unscrambles shuffled letters in a word sequence.
Final assigment for "Gestione dell'Informazione" ("Search Engines") course @ UniMoRe
Measuring Biases in Masked Language Models for PyTorch Transformers. Support for multiple social biases and evaluation measures.
Transformers Pre-Training with MLM objective — implemented encoder-only model and trained from scratch on Wikipedia dataset.
Training the first Cypriot Large Language Model on the Masked Language Modeling objective for predicting a given masked word token within a given context
[EMNLP 2024] Official Implementation of DisGeM: Distractor Generation for Multiple Choice Question with Span Masking
Predict the whole sequence and 3D structure of masked protein sequences with ESM by @evolutionaryscale
A Context Aware Approach for Generating Natural Language Attacks.
Add a description, image, and links to the masked-language-models topic page so that developers can more easily learn about it.
To associate your repository with the masked-language-models topic, visit your repo's landing page and select "manage topics."