Some early experimentation suggests that these new ideas might replace the transformer as a fundamental neural network design ...

"While not an exact simulation, the neural model is able to perform complex game state updates, such as tallying health and ammo, attacking enemies, damaging objects, opening doors, and persist ...