Did you capture conversational "transactions" as structured data in the game state, or was the chat history itself the only storage for that aspect of the game?
I would think you could avoid much of this issue by creating a more sophisticated structured game model and use the language model only for converting between structured and unstructured data.
They do have structured game model although it doesn't capture everything in chat. Language model still had lots of problems with consistency even with structured game model input.
I would think you could avoid much of this issue by creating a more sophisticated structured game model and use the language model only for converting between structured and unstructured data.