GIGAZINE

'ModernBERT', the successor to 'BERT', a model that vectorizes data for purposes such as search and classification, has been released

AI research institutes Answer.AI and LightOn have developed ModernBERT, an improved version of Google's natural language processing model BERT, released in 2018. It is said to show superior ...
Neowin

NVIDIA registers the world's quickest BERT training time and largest transformer-based model

The company's immensely powerful DGX SuperPOD trains BERT-Large in a record-breaking 53 minutes and trains GPT-2 8B, the world's largest transformer-based network, with 8.3 billion parameters. NVIDIA ...
Nature

Evaluation of rural tourism development level using BERT-enhanced deep learning model and BP algorithm

To address the insufficient expressive capabilities of traditional methods in assessing the development level of rural tourism, this study explores the fusion application of the Bidirectional Encoder ...
Nature

StructmRNA a BERT based model with dual level and conditional masking for mRNA representation

In this study, we introduce StructmRNA, a new BERT-based model that was designed for the detailed analysis of mRNA sequences and structures. The success of DNABERT in understanding the intricate ...