Skip to content

[Pytorch] Add support for row-wise quanted input for grouped gemm #3244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
vthumbe1503 merged 27 commits into from
Aug 7, 2026
Merged

[Pytorch] Add support for row-wise quanted input for grouped gemm #3244

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
11e9007
add support for row-wise quanted input for grouped gemm
YangFei1990 Jul 23, 2026
d234cd8
doc change
YangFei1990 Jul 25, 2026
376b94c
implement for backward
YangFei1990 Jul 26, 2026
782835c
merge from main
YangFei1990 Jul 26, 2026
855f480
allow scaled_bias + frozen weights in prequant path
YangFei1990 Jul 26, 2026
8ef7e7e
allow bias + frozen weight path in prequantized input
YangFei1990 Jul 26, 2026
6015c91
use .copy to create group tensor
YangFei1990 Jul 30, 2026
49ba134
merge from main
YangFei1990 Jul 30, 2026
12f1dbf
move the implementation to c++ layer
YangFei1990 Jul 30, 2026
14fedf0
Merge branch 'main' into mxfp8_input_groupedgemm
YangFei1990 Jul 30, 2026
e3990dd
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 30, 2026
c1e4663
bug fix for operation ordering
YangFei1990 Jul 31, 2026
a349d0d
add comprehensive tests
YangFei1990 Jul 31, 2026
a3219de
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 31, 2026
7c850ef
Merge branch 'main' into mxfp8_input_groupedgemm
YangFei1990 Jul 31, 2026
d8e8b1c
Merge branch 'main' into mxfp8_input_groupedgemm
YangFei1990 Aug 4, 2026
3bbf778
rename to group_requantize
YangFei1990 Aug 5, 2026
a677627
merge from main
YangFei1990 Aug 6, 2026
e890104
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 6, 2026
76662c2
rename func with inplace tag
YangFei1990 Aug 6, 2026
f2ff2fc
resolve merge
YangFei1990 Aug 6, 2026
a056c6d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 6, 2026
ce2e5a3
refactor the requantize function
YangFei1990 Aug 6, 2026
8a1c89f
merge from main
YangFei1990 Aug 6, 2026
226405d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 6, 2026
3032804
minor fix for test
YangFei1990 Aug 7, 2026
791abaa
Merge branch 'main' into mxfp8_input_groupedgemm
YangFei1990 Aug 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading