Account

From model weights to API endpoint with TensorRT LLM: Philip Kiely and Pankaj Gupta

AI Engineer • September 13, 2024

Video Thumbnail

AI Engineer

About

Talks, workshops, events, and training for AI Engineers.

Latest Posts

Video Thumbnail

The State of AI Code Quality: Hype vs Reality — Itamar Friedman, Qodo

AI Engineer

Video Thumbnail

RL Environments at Scale – Will Brown, Prime Intellect

AI Engineer

Video Thumbnail

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

AI Engineer

Video Thumbnail

VoiceVision RAG - Integrating Visual Document Intelligence with Voice Response — Suman Debnath, AWS

AI Engineer

You May Also Like

Build enterprise generative AI apps using Llama 3 at 1,000 tokens/s on the SambaNova AI platform

Build enterprise generative AI apps using Llama 3 at 1,000 tokens/s on the SambaNova AI platform

AI Engineer1 year ago

The State of AI Code Quality: Hype vs Reality — Itamar Friedman, Qodo

The State of AI Code Quality: Hype vs Reality — Itamar Friedman, Qodo

AI Engineer6 days ago

Understanding the LLM Inference Workload - Mark Moyou, NVIDIA

Understanding the LLM Inference Workload - Mark Moyou, NVIDIA

PyTorch1 year ago

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

AI Engineer1 week ago

The New Code — Sean Grove, OpenAI

The New Code — Sean Grove, OpenAI

AI Engineer5 months ago

NVIDIA Triton Inference Server and its use in Netflix's Model Scoring Service

NVIDIA Triton Inference Server and its use in Netflix's Model Scoring Service

Outerbounds1 year ago

Fast LLM Serving with vLLM and PagedAttention

Fast LLM Serving with vLLM and PagedAttention

Anyscale2 years ago

2026: The Year The IDE Died — Steve Yegge & Gene Kim, Authors, Vibe Coding

2026: The Year The IDE Died — Steve Yegge & Gene Kim, Authors, Vibe Coding

AI Engineer1 week ago

Don't learn AI Agents without Learning these Fundamentals

Don't learn AI Agents without Learning these Fundamentals

KodeKloud1 month ago

Building the PERFECT Linux PC with Linus Torvalds

Building the PERFECT Linux PC with Linus Torvalds

Linus Tech Tips2 weeks ago

Do LLMs Understand? AI Pioneer Yann LeCun Spars with DeepMind’s Adam Brown.

Do LLMs Understand? AI Pioneer Yann LeCun Spars with DeepMind’s Adam Brown.

Pioneer Works5 days ago

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson1 year ago

ONNX and ONNX Runtime

ONNX and ONNX Runtime

Microsoft Research6 years ago

Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou

Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou

AI Engineer11 months ago

Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral

Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral

MLOps.community2 years ago

Building Production-Ready RAG Applications: Jerry Liu

Building Production-Ready RAG Applications: Jerry Liu

AI Engineer2 years ago

Ex-OpenAI Scientist WARNS: "You Have No Idea What's Coming"

Ex-OpenAI Scientist WARNS: "You Have No Idea What's Coming"

AI Upload5 months ago

Andrej Karpathy: Software Is Changing (Again)

Andrej Karpathy: Software Is Changing (Again)

Y Combinator5 months ago

Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Efficient NLP2 years ago

Demo: Optimizing Gemma inference on NVIDIA GPUs with TensorRT-LLM

Demo: Optimizing Gemma inference on NVIDIA GPUs with TensorRT-LLM

Google for Developers1 year ago

Home AiChat Shop Saved Account