Hi there, I'm Shawn👋
Welcome to my Blog.

A system-level deep dive into refactoring Qwen3-Reranker from an LM head (H→V) to a score head (H→1): correct decoder-only pooling, 0.6B FLOPs math, ~296 MiB VRAM savings, bandwidth effects, pitfalls, and a practical deployment checklist - plus open-source repos and a preview of Triton deployment with an OpenAI-style API.

Hi! I'm an AI developer who loves building real-time systems and writing about practical machine learning, systems, and tooling. Glad you're here.