Data Science Wire

Has anyone tried this approach with Fast Byte Latent Transformers ? [R]

Reddit r/MachineLearning1mo4 min read

Paper Referred:- https://arxiv.org/pdf/2412.09871v1 Has anyone switched the transformer in the entropy model here to a Mamba model ? What could be the possible changes ? Just a ML fresher asking a genuine, since Mamba is more popular and saves computer (O(n)). Thanking you in advance ! submitted by /u/SoloLeveller07 [link] [comments]

Read the full story at Reddit r/MachineLearning →

More in Machine Learning

Reducing Human Annotation with ML Active Learning

Machine LearningTowards Data ScienceLucas Braga5d

AC

Learning What Matters: Supervising Sparse Attention Routing with Causal Evidence Sets

Machine LearningarXiv cs.LGJim Allchin5d

AC

On the Depth Scalability of Logic Gate Networks

Machine LearningarXiv cs.LGTaegun An, Dohun kim, Hae…5d

AC

Pretraining EHR Foundation Models with Patient-Aware Sampling

Machine LearningarXiv cs.LGJoshua Placidi, Yuxuan Li…5d

AC

From Perturbation Correction to Geometry-Aware Sampling: Sharpness-Guided Equilibrium Sampling for Balanced Flat Minima in Long-Tailed Learning

Machine LearningarXiv cs.LGJiaxin Deng, Junbiao Pang5d

AC

Parameter-free Adaptive Sparse Attention via Compression-Based Content Selection

Machine LearningarXiv cs.LGDebarshi Kundu, Swaroop G…5d