What comes after attention? This startup says it already knows.

When Subquadratic launched earlier this year, it could build a sparse-attention model that could handle a 12-million token context window The post What comes after attention? This startup says it already knows. appeared first on The New Stack .