Having a clear separation makes it easier to set up (application specific) persistence for your UI messages and additional context. It also helps putting prompt optimizations in place and improving results.
Having a clear separation makes it easier to set up (application specific) persistence for your UI messages and additional context. It also helps putting prompt optimizations in place and improving results.
E.g. short-term memory compresses, long-term memory and RAG enriches, system messages add additional information. You could have different model message prompts depending on the context.
E.g. short-term memory compresses, long-term memory and RAG enriches, system messages add additional information. You could have different model message prompts depending on the context.