For sure RAG is a must have and already here in 2023, and among other trends SLMs (small language models) with different architectures are also interesting to talk about in 2024)