A Practical LLM Pretraining Pipeline with LanceDB
LanceDB Blog8h4 min read
Training a GPT-2-like model from raw text in 25 minutes with LanceDB, using one table for curation, tokenization, shuffling, packing, training, and analysis.
Training a GPT-2-like model from raw text in 25 minutes with LanceDB, using one table for curation, tokenization, shuffling, packing, training, and analysis.