Skip to content

[BYOC][TRT] Fix weight conversion when first dim of weight shape is 1#7253

Merged
comaniac merged 1 commit intoapache:mainfrom
trevor-m:trt-weight-begin-with-1
Jan 12, 2021
Merged

[BYOC][TRT] Fix weight conversion when first dim of weight shape is 1#7253
comaniac merged 1 commit intoapache:mainfrom
trevor-m:trt-weight-begin-with-1

Conversation

@trevor-m
Copy link
Copy Markdown
Contributor

Fixes conversion of weight shape to work with TensorRT's implicit batch dimension.
Added test cases which failed before this change.
Before this PR, a conv2d or dense op which has a kernel weight beginning with 1 ([1, 32, 3, 3] or [1, 128] for example) would cause an error.

Also, there is an unrelated change to add conv2d_transpose to ConvertLayout list in partition_for_tensorrt.

Copy link
Copy Markdown
Contributor

@comaniac comaniac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@trevor-m
Copy link
Copy Markdown
Contributor Author

LGTM

@comaniac Thanks for the review!

@trevor-m trevor-m force-pushed the trt-weight-begin-with-1 branch from 398c069 to 089dbca Compare January 12, 2021 01:46
@comaniac comaniac merged commit ac684f9 into apache:main Jan 12, 2021
@comaniac
Copy link
Copy Markdown
Contributor

Thanks @trevor-m

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants