Python script for LLM-Based Hierarchical Topic Modeling / Data Normalization
Reddit r/dataanalysis1w4 min read
Hello! A couple months ago I asked on this sub for ways to do Hierarchical Topic Modeling (mapping strings to categories and sub-categories) standard sentences embeddings approaches such as BERTopic couldn't follow the instructions I wanted to give them. I decided to implement a custom LLM-Based script that maps raw variations to categories and sub-categories by following the users instruction and looping until all values are mapped. It's not perfect but through some iteration it reached a step where I feel like I can share it. If you've faced a similar problem with Hierarchical Topic Modeling