hankai

hankaixyz's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 3 papers 11 days ago

Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Paper • 2404.18911 • Published Apr 29, 2024 • 30

Revealing the Power of Post-Training for Small Language Models via Knowledge Distillation

Paper • 2509.26497 • Published Sep 30

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Paper • 2511.20626 • Published 13 days ago • 169

upvoted a paper 11 days ago

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Paper • 2511.20626 • Published 13 days ago • 169

commented a paper 11 days ago

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Paper • 2511.20626 • Published 13 days ago • 169 •

4

liked a model about 1 month ago

Lpzhan/openPangu-embedded-gguf

1B • Updated Nov 6 • 43 • 2

New activity in facebook/MobileLLM-Pro about 2 months ago

Seems lagging behind Pangu-1B

🔥 👀 5

3

#4 opened about 2 months ago by

hankaixyz

upvoted a paper 3 months ago

Benchmarking Optimizers for Large Language Model Pretraining

Paper • 2509.01440 • Published Sep 1 • 24

liked a model 3 months ago

FreedomIntelligence/openPangu-Ultra-MoE-718B

734B • Updated Nov 4 • 5 • 1

liked 3 models 4 months ago

FreedomIntelligence/openPangu-Embedded-1B

Text Generation • 1B • Updated Aug 21 • 47 • 6

FreedomIntelligence/openPangu-Embedded-7B

Text Generation • 8B • Updated Aug 21 • 279 • 6

PIKA665/openPangu-Embedded-1B

1B • Updated Aug 4 • 18 • 1

liked a model 5 months ago

IntervitensInc/pangu-pro-moe-model

Text Generation • 72B • Updated Jul 9 • 20 • 45

upvoted 2 papers over 1 year ago

Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Paper • 2404.18911 • Published Apr 29, 2024 • 30

DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models

Paper • 2403.00818 • Published Feb 26, 2024 • 19

liked a model over 1 year ago

jamesHD2001/DenseMamba-1.3B

Updated Apr 11, 2024 • 4 • 1

authored 4 papers almost 2 years ago

Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets

Paper • 2010.14819 • Published Oct 28, 2020

GhostNet: More Features from Cheap Operations

Paper • 1911.11907 • Published Nov 27, 2019

Transformer in Transformer

Paper • 2103.00112 • Published Feb 27, 2021 • 1

GhostNetV2: Enhance Cheap Operation with Long-Range Attention

Paper • 2211.12905 • Published Nov 23, 2022