Skip to content

[LLM:Feature] Add Segment Mode, Speed up metal llm for 30%-100%#4543

Open
jxt1234 wants to merge 1 commit into
alibaba:masterfrom
jxt1234:feature/llm_mini
Open

[LLM:Feature] Add Segment Mode, Speed up metal llm for 30%-100%#4543
jxt1234 wants to merge 1 commit into
alibaba:masterfrom
jxt1234:feature/llm_mini

Conversation

@jxt1234

@jxt1234 jxt1234 commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator

Description

Module

Type

  • Feature
  • Bugfix
  • Perf
  • Refact
  • Style
  • Doc
  • Test
  • Chore

Checklist

  • Commit message follows [Module:Type] Description format
  • Code compiles without errors
  • Tested on relevant platform(s)
  • No unrelated format or style changes included

@jxt1234 jxt1234 force-pushed the feature/llm_mini branch 2 times, most recently from 4418abe to bebbc9a Compare June 15, 2026 11:02
@wangzhaode wangzhaode self-assigned this Jun 15, 2026
@jxt1234 jxt1234 force-pushed the feature/llm_mini branch from bebbc9a to a58b9d6 Compare June 16, 2026 02:43
@jxt1234 jxt1234 changed the title [LLM:Feature] Support Segment Mode, currently only support metal backend [LLM:Feature] Add Segment Mode, Speed up metal llm for 30%-100% Jun 16, 2026
@jxt1234 jxt1234 force-pushed the feature/llm_mini branch from a58b9d6 to 13e553a Compare June 18, 2026 02:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants