linear-attention-transformer

Project Description

Transformer based on a variant of attention that is linear complexity in respect to sequence length