Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2507.00994

Research material on research about pre-training encoders, with extensive comparison on masked language modeling paradigm vs causal langage modeling.

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-clm-40k-mlm50-42k

Feature Extraction • Updated Jul 4 • 11
MLMvsCLM/1b-mlm50-42k

Feature Extraction • Updated Jul 4 • 9
MLMvsCLM/610m-clm-42k-5000

Feature Extraction • Updated Jul 4 • 5

Should We Still Pretrain Encoders with Masked Language Modeling?

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLM vs CLM

Collection

65 items • Updated Sep 25 • 1

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-mlm40-42k-10000

Feature Extraction • Updated Jul 4 • 3
MLMvsCLM/610m-clm-40k-mlm20-42k

Feature Extraction • Updated Jul 4 • 4
MLMvsCLM/1b-mlm40-42k

Feature Extraction • Updated Jul 4 • 6

EuroBERT Encoding model

Suite of models for improved integration into RAG (for information retrieval), designed for ease-of-use and practicability in industrial context

EuroBERT/EuroBERT-210m

Fill-Mask • 0.3B • Updated Oct 18 • 10.8k • 78
EuroBERT/EuroBERT-610m

Fill-Mask • 0.8B • Updated Oct 18 • 1.39k • 32
EuroBERT/EuroBERT-2.1B

Fill-Mask • 2B • Updated Oct 18 • 207 • 63
EuroBERT: Scaling Multilingual Encoders for European Languages

Paper • 2503.05500 • Published Mar 7 • 79

MLM versus CLM for NLP tasks

Related paper: "Should We Still Pretrain Encoders with Masked Language Modeling?"

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-mlm40-42k-10000

Feature Extraction • Updated Jul 4 • 3
MLMvsCLM/610m-clm-40k-mlm20-42k

Feature Extraction • Updated Jul 4 • 4
MLMvsCLM/1b-mlm40-42k

Feature Extraction • Updated Jul 4 • 6

SAMed-2: Selective Memory Enhanced Medical Segment Anything Model

Paper • 2507.03698 • Published Jul 4 • 11
Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79

Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline

Paper • 2411.12814 • Published Nov 19, 2024 • 25
SegBook: A Simple Baseline and Cookbook for Volumetric Medical Image Segmentation

Paper • 2411.14525 • Published Nov 21, 2024 • 21
MRGen: Diffusion-based Controllable Data Engine for MRI Segmentation towards Unannotated Modalities

Paper • 2412.04106 • Published Dec 4, 2024 • 6
PepTune: De Novo Generation of Therapeutic Peptides with Multi-Objective-Guided Discrete Diffusion

Paper • 2412.17780 • Published Dec 23, 2024 • 5

Research material on research about pre-training encoders, with extensive comparison on masked language modeling paradigm vs causal langage modeling.

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-clm-40k-mlm50-42k

Feature Extraction • Updated Jul 4 • 11
MLMvsCLM/1b-mlm50-42k

Feature Extraction • Updated Jul 4 • 9
MLMvsCLM/610m-clm-42k-5000

Feature Extraction • Updated Jul 4 • 5

MLM versus CLM for NLP tasks

Related paper: "Should We Still Pretrain Encoders with Masked Language Modeling?"

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79

Should We Still Pretrain Encoders with Masked Language Modeling?

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLM vs CLM

Collection

65 items • Updated Sep 25 • 1

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-mlm40-42k-10000

Feature Extraction • Updated Jul 4 • 3
MLMvsCLM/610m-clm-40k-mlm20-42k

Feature Extraction • Updated Jul 4 • 4
MLMvsCLM/1b-mlm40-42k

Feature Extraction • Updated Jul 4 • 6

Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79
MLMvsCLM/610m-mlm40-42k-10000

Feature Extraction • Updated Jul 4 • 3
MLMvsCLM/610m-clm-40k-mlm20-42k

Feature Extraction • Updated Jul 4 • 4
MLMvsCLM/1b-mlm40-42k

Feature Extraction • Updated Jul 4 • 6

SAMed-2: Selective Memory Enhanced Medical Segment Anything Model

Paper • 2507.03698 • Published Jul 4 • 11
Should We Still Pretrain Encoders with Masked Language Modeling?

Paper • 2507.00994 • Published Jul 1 • 79

EuroBERT Encoding model

Suite of models for improved integration into RAG (for information retrieval), designed for ease-of-use and practicability in industrial context

EuroBERT/EuroBERT-210m

Fill-Mask • 0.3B • Updated Oct 18 • 10.8k • 78
EuroBERT/EuroBERT-610m

Fill-Mask • 0.8B • Updated Oct 18 • 1.39k • 32
EuroBERT/EuroBERT-2.1B

Fill-Mask • 2B • Updated Oct 18 • 207 • 63
EuroBERT: Scaling Multilingual Encoders for European Languages

Paper • 2503.05500 • Published Mar 7 • 79

Interactive Medical Image Segmentation: A Benchmark Dataset and Baseline

Paper • 2411.12814 • Published Nov 19, 2024 • 25
SegBook: A Simple Baseline and Cookbook for Volumetric Medical Image Segmentation

Paper • 2411.14525 • Published Nov 21, 2024 • 21
MRGen: Diffusion-based Controllable Data Engine for MRI Segmentation towards Unannotated Modalities

Paper • 2412.04106 • Published Dec 4, 2024 • 6
PepTune: De Novo Generation of Therapeutic Peptides with Multi-Objective-Guided Discrete Diffusion

Paper • 2412.17780 • Published Dec 23, 2024 • 5

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs