LlamaIndex Sessions: Practical Tips and Tricks for Productionizing RAG (feat. Sisil @ Jasper)

Video Description

In this video, Sisil Mehta (ML eng @, Jasper) walks through practical tips and tricks that his team implemented for productionizing a RAG system at Jasper.ai, backed by LlamaIndex abstractions. These tricks include the following: 1. Picking a proper PDF parser that can maintain semantic structure, parse text from tables/images, and be represented as XML or Markdown 2. Adding the right "layers" of metadata; besides global document context, also inject summary context from "sub-documents" to more precisely localize context. 3. Hybrid fusion between different retrieval methods 4. LLM-powered reranking. Reduce token usage by reranking summaries that reference underlying chunks. 5. Use XML and emotion prompting to get well-structured outputs free of hallucinations