Medusa Multi-Head Tree-Attention Telemetry
Medusa Multi-Token Heads
Generates candidate token trees directly from target model activations, eliminating auxiliary draft model VRAM footprint and memory bandwidth contention.
Parallel Rejection Sampling Verification
Verifies multiple candidate tokens concurrently in a single forward pass, slashing per-token generation latency below 15ms with 100% distribution fidelity.