LlamaIndex Sessions: Practical Tips and Tricks for Productionizing RAG (feat. Sisil @ Jasper)

LlamaIndex February 18, 2024
Video Thumbnail
LlamaIndex Logo

LlamaIndex

View Channel

About

Official YouTube Channel for LlamaIndex - the platform to build document agents

Latest Posts

No results found. Try different keywords.

Video Description

In this video, Sisil Mehta (ML eng @, Jasper) walks through practical tips and tricks that his team implemented for productionizing a RAG system at Jasper.ai, backed by LlamaIndex abstractions. These tricks include the following: 1. Picking a proper PDF parser that can maintain semantic structure, parse text from tables/images, and be represented as XML or Markdown 2. Adding the right "layers" of metadata; besides global document context, also inject summary context from "sub-documents" to more precisely localize context. 3. Hybrid fusion between different retrieval methods 4. LLM-powered reranking. Reduce token usage by reranking summaries that reference underlying chunks. 5. Use XML and emotion prompting to get well-structured outputs free of hallucinations

Essential RAG Tools

AI-recommended products based on this video

Loading...
Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified
Best Seller

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified

(44,096)
$8.49
FREE delivery Thu, Jul 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

(16,565)
13.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
10K+ bought in past month
Loading...
Lenovo ThinkPad E14 Gen 5 Business Laptop (14" FHD+ Anti-glare, Intel 10-Core i7-1355U, 40GB RAM, 1TB SSD) Backlit, Fingerprint, Fast Charge, 1080p RGB Webcam, Wi-Fi 6, Win 11 Pro w/ Copilot

Lenovo ThinkPad E14 Gen 5 Business Laptop (14" FHD+ Anti-glare, Intel 10-Core i7-1355U, 40GB RAM, 1TB SSD) Backlit, Fingerprint, Fast Charge, 1080p RGB Webcam, Wi-Fi 6, Win 11 Pro w/ Copilot

(12)
$899.99
FREE delivery Wed, Jun 18
Loading...
Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

(6)
$849.00
FREE delivery Jun 18 - 23
50+ bought in past month
Loading...
Lenovo V15 Laptop | 15.6" FHD Anti-Glare Display | AMD Ryzen 7 7730U | 40GB RAM | 1TB PCIe SSD | HDMI | Type-C | Webcam | Wi-Fi | THUNDEROBOT Wireless Ergonomic Mouse | Windows 11 Pro | Black

Lenovo V15 Laptop | 15.6" FHD Anti-Glare Display | AMD Ryzen 7 7730U | 40GB RAM | 1TB PCIe SSD | HDMI | Type-C | Webcam | Wi-Fi | THUNDEROBOT Wireless Ergonomic Mouse | Windows 11 Pro | Black

(26)
$649.00$636.02
FREE delivery Jun 18 - 23
Loading...
Lenovo ThinkBook 15 Gen 4 Business Laptop (15.6" FHD Anti-Glare, Intel 10-Core i7-1255U, 40GB RAM, 1TB PCIe SSD), 1080p Webcam, Narrow Bezel, Fingerprint, Wi-Fi 6, Ethernet, Win 11 Pro, Grey

Lenovo ThinkBook 15 Gen 4 Business Laptop (15.6" FHD Anti-Glare, Intel 10-Core i7-1255U, 40GB RAM, 1TB PCIe SSD), 1080p Webcam, Narrow Bezel, Fingerprint, Wi-Fi 6, Ethernet, Win 11 Pro, Grey

(30)
$759.98
FREE delivery Wed, Jun 18
50+ bought in past month