Titan AI LogoTitan AI

SparK

1,359
84
Python

Project Description

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

Project Information

Created on 1/5/2023
Updated on 11/2/2025