*Why I started it, what it does today, and where Iโd love some help. ยท 5-minute read*
<figure style="margin: 1.5rem 0; display: flex; flex-direction...
<!-- Source presentation: torch.compile e2e.pdf. Date is the blog publication date. -->
I wanted to connect the parts of `torch.compile` that are of...
<!-- Source presentation: torch.compile in the wild.pdf. Date is the blog publication date. -->
The interesting question about `torch.compile` is of...
<!-- Source presentation: vLLM, torch.compile and IR.pdf. Date is the blog publication date. -->
vLLM already uses `torch.compile`, so why add anoth...
<!-- Source presentation: March meetup talk.pdf. Date is the blog publication date. -->
Calling `torch.compile` takes one line. Understanding how it...
<!-- Source presentation: vLLM & torch.compile.pdf. Date is the blog publication date. -->
After looking at vLLM's scheduler and KV cache, I wanted ...
<!-- Source presentation: vLLM presentation - Pytorch meetup.pdf. Date is the blog publication date. -->
For this PyTorch meetup talk, I started wit...
<!-- Source presentation: vLLM presentation.pdf. Date is the blog publication date. -->
Running one prompt through an LLM is fairly easy. Keeping a ...