Code

Fix precision mla#413

Code

Merged

Atream merged 7 commits intomainkvcache-ai/ktransformers:mainfrom fix_precision_MLAkvcache-ai/ktransformers:fix_precision_MLACopy head branch name to clipboardFeb 18, 2025

+899-51

Commits

Commits on Feb 16, 2025

• support bf16 read

  Atream

  committed
  b845246

  Copy full SHA for b845246

Commits on Feb 17, 2025

• fix precision bug imported by position_ids in 0.2.0

  Atream

  committed
  038bc30

  Copy full SHA for 038bc30

• server mix mla

  ErvinXie

  committed
  c176e51

  Copy full SHA for c176e51

• update install.sh

  ErvinXie

  committed
  9f1da18

  Copy full SHA for 9f1da18

Commits on Feb 18, 2025

• fix server warmup

  ErvinXie

  committed
  f029588

  Copy full SHA for f029588

• ⚡ fix device and add test

  KMSorSMS

  committed
  07a0555

  Copy full SHA for 07a0555

• ⚡ add mmlu_pro test

  KMSorSMS

  committed
  592e13d

  Copy full SHA for 592e13d