Employment
Employment history is unavailable.
Education
Education history is unavailable.
Projects & Funding
Projects & funding information is unavailable.
Publications (4)
- AlignedServe: Orchestrating Prefix-aware Batching to Build a High-throughput and Computing-efficient LLM Serving System Save
- Efficient KV Cache Spillover Management on Memory-Constrained GPU for LLM Inference Save
- TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference Save
- Improving Computation and Memory Efficiency for Real-world Transformer Inference on GPUs Save