Engineering Lessons From Building an LLM PoC: What I Learned Building SheepOp
Creating a full transformer implementation and RAG optimizer from scratch provides insights that typical high-level frameworks obscure. Over the past days, I've built two open-source projects—SheepOp, a transformer implementation from scratch, and the LLM RAG Data Structures Optimizer, a production-grade optimization library. The experience revealed several lessons