
model architecture is starting to feel less like a fixed neural network & more like a runtime route different inputs through different experts allocate compute dynamically change depth update memory adapt parameters at inference the interesting question is no longer just how big is the model? it’s what does the model choose to execute?
