[TE] Record primitives of Schedule for visualization

[chunit-quic]

• Make Stage link to its Schedule via attach_sch.
• Add two array attributes, primitive_record and schedule_record to Schedule.
• Create a new class, ScheduleContext, to record primitives.
• Register a pass config variable, keep_schedule_record to enable/disable the recording.
• Add test cases for TEDD, build_module and schedule ops.

[tvm-bot]

Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.

• cc @junrushao _{See #10317 for details}

_{Generated by tvm-bot}

[chunit-quic]

Hi community,

This is second part of TVM Explorer infrastructures. After this patch, user can backtrack what
(schedule) primitives have been applied to a schedule. Pair with the tool, TEDD, these changes can
be visualized beautifully.

To give you more context, we briefly describe what have been done below in this PR. Here is the
list of main modifications:

1. Make a Stage know which Schedule it belongs to.
2. Add two attributes, primitive_record and schedule_record to Schedule.
3. Create a new class, ScheduleContext, to record primitive in the RAII way.
4. Register a pass config variable, keep_schedule_record to enable/disable the recording.

Everytime a Stage being modified by a primitive, we will use ScheduleContext to record the optimized schedule and corresponding primitive. So that we can obtain the modification sequence later. You can reference to preRFC for more details. Thanks!

For your reference, here is the related links.
PreRFC in forum
apache/tvm-rfcs#92
#13116
@haowhsu-quic, @zack-ch

[Hzfengsy]

LGTM. But I'm not confident to explicitly approve it since I'm not an expert on TE

[chunit-quic]

Hi @Hzfengsy,

LGTM. But I'm not confident to explicitly approve it since I'm not an expert on TE

Thank you for reviewing! May I know is there any recommended person who could help to review this topic? :)

Hi @masahi,
Sorry to bother you, because I saw you dealt with some TE related PRs, and had checked the RFC of Explorer before. Would you mind to take a look at this PR and give us some feedbacks? Thank you. :D

[Hzfengsy]

Thanks, @chunit-quic for the PR. I explicitly approve this PR after another look. Let's merge it in 24h if there are no other objectives.

[chunit-quic]

Thanks, @chunit-quic for the PR. I explicitly approve this PR after another look. Let's merge it in 24h if there are no other objectives.

No problem. Thanks a lot for helping us! :D

[masahi]

Please fix basic grammar issues.

[chunit-quic]

Please fix basic grammar issues.

Hi @masahi,

Thank you very much for reviewing!
We're pretty sorry for basic issues of documentation.
We have rewritten those parts in comments. If there is still anything unclear we would try to reword them at once.

Thank you!