Data Science Wire

Is it okay to share my experiments implementing research papers on my own LLM here? [P]

Reddit r/MachineLearning1d4 min read

Hey everyone! I've built and trained a small LLM (~8M parameters) from scratch using PyTorch, mainly as an experimental lab where I can implement and test ideas from different research papers. I've been documenting the whole journey through casual blogs, including my mistakes, experiments, and things I've learned. So far: Building the Transformer Training it for 60,000 steps Next up is KV caching, followed by PagedAttention, Orca, and whatever else I find interesting. Just wanted to ask if sharing these experiments and blogs here would be welcome. Nothing promotional, just me experimenting, le

Read the full story at Reddit r/MachineLearning →

More in AI