hankai's picture

3 4 8

hankai

hankaixyz

·

AI & ML interests

None yet

Recent Activity

authored a paper 11 days ago

Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

authored a paper 11 days ago

Revealing the Power of Post-Training for Small Language Models via Knowledge Distillation

authored a paper 11 days ago

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

View all activity

Organizations

None yet

upvoted a paper 11 days ago

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Paper • 2511.20626 • Published 13 days ago • 169

upvoted a paper 3 months ago

Benchmarking Optimizers for Large Language Model Pretraining

Paper • 2509.01440 • Published Sep 1 • 24

upvoted 2 papers over 1 year ago

Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Paper • 2404.18911 • Published Apr 29, 2024 • 30

DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models

Paper • 2403.00818 • Published Feb 26, 2024 • 19