Data Science Wire

I compiled Doom's renderer into a 21B-parameter transformer -- no training anywhere [P]

Reddit r/MachineLearning1mo4 min read

This is the project my last two posts were building towards (this is the last of this silliness). I ported the Doom rendering algorithm to run inside a transformer. Instead of training a model, I used a compiler I wrote which converts computation graphs into transformer weights, and then ported Doom's algorithm into a compatible graph. The generated checkpoints can be loaded in Hugging Face without trust_remote_code -- it's just a standard transformers checkpoint. You feed the model a prompt representing the scene data, and generate until the model stops. The result is a token sequence which i

Read the full story at Reddit r/MachineLearning

More in Machine Learning