fix: Improve partitioning + lowering systems in torch.compile
path by gs-olive · Pull Request #1879 · pytorch/TensorRT (original) (raw)
Description
- Improve torch.compile Dynamo partitioning system by incorporating key arguments including
min_block_size
andtorch_executed_ops
, which are available for use in TorchScript - Improve torch.compile lowering system by adding key new decompositions to improve coverage and reduce the number of unique operators requiring implementation
- Update testing framework to use utilities, reducing code replication
- Add extensive testing of new partitioning system and lowering phases
Note: Not to be merged prior to release/1.4
branch finalization (features are experimental and evolving)
Fixes #1832
Type of change
- Bug fix (non-breaking change which fixes an issue)
Checklist:
- [ x ] My code follows the style guidelines of this project (You can use the linters)
- [ x ] I have performed a self-review of my own code
- [ x ] I have commented my code, particularly in hard-to-understand areas and hacks
- [ x ] I have made corresponding changes to the documentation
- [ x ] I have added tests to verify my fix or my feature
- [ x ] New and existing unit tests pass locally with my changes
- [ x ] I have added the relevant labels to my PR in so that relevant reviewers are notified
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
gs-olive changed the base branch from dynamo_changes to main
This was referenced
May 15, 2023
- Improve torch.compile Dynamo partitioning system by incorporating key
arguments including
min_block_size
andtorch_executed_ops
, which are available for use in TorchScript - Improve torch.compile lowering system by adding key new decompositions to improve coverage and reduce the number of unique operators requiring implementation
- Update testing framework to use utilities, reducing code replication
- Add extensive testing of new partitioning system and lowering phases
- Update default
min_block_size
gs-olive deleted the dynamo_partitoner_lowering branch
gs-olive added a commit that referenced this pull request
narendasan pushed a commit that referenced this pull request