Skip to content

Add tensor parallel and torch compile - #262

Open
nianniann wants to merge 1 commit into
v1from
add_tp
Open

Add tensor parallel and torch compile#262
nianniann wants to merge 1 commit into
v1from
add_tp

Conversation

@nianniann

Copy link
Copy Markdown
Collaborator

No description provided.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@qzzz95
qzzz95 requested a review from akaitsuki-ii July 28, 2026 06:32
return TensorSelection(slices=(TensorSlice(dim=dim, start=start, end=end),))


def derive_tp_tensor_selection_plan(model: nn.Module) -> TensorSelectionPlan:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@akaitsuki-ii @nianniann 名称确实和 torch tp plan 有点像,要不重点强调是 model weight 的 load plan,
def drive_tp_model_weight_load_plan

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

行!

@akaitsuki-ii akaitsuki-ii changed the title Add tp and torch compile Add tensor parallel and torch compile Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants