Skip to content

Add AMX with TensorFlow quick-start guides and AI use-case examples - #28

Merged
rsiyer-intel merged 8 commits into
intel:mainfrom
othakkar:amx_with_tensorflow
Apr 29, 2026
Merged

Add AMX with TensorFlow quick-start guides and AI use-case examples#28
rsiyer-intel merged 8 commits into
intel:mainfrom
othakkar:amx_with_tensorflow

Conversation

@othakkar

Copy link
Copy Markdown
Contributor

Adds documentation under software/tensorflow/ for leveraging Intel AMX acceleration with TensorFlow, including:

  • Quick-start guide (README.md) — environment setup, BF16 matrix multiplication benchmark, and AMX verification via oneDNN verbose logging.
  • NLP — BERT-Large (nlp-transformers-bert/) — sequence classification with Hugging Face Transformers, Keras mixed precision, TF Serving deployment, and REST client inference.
  • GNN — RGAT (graph-neural-networks-rgat/) — relational graph attention network inference using TF-GNN with GATv2Conv, TF Serving deployment, and REST client inference.
  • CV — ResNet50 v1.5 (computer-vision-resnet50/) — image classification with Keras built-in ResNet50, mixed precision, TF Serving deployment, and optional graph freezing.

Each guide covers Keras mixed_bfloat16 setup, model export, Docker-based TF Serving with --mixed_precision=bfloat16, client code, and AMX verification steps.

@rsiyer-intel
rsiyer-intel requested a review from harp-intel April 27, 2026 20:00
Comment thread software/tensorflow/README.md Outdated
Comment thread software/tensorflow/nlp-transformers-bert/README.md Outdated
Comment thread software/tensorflow/graph-neural-networks-rgat/README.md

@rsiyer-intel rsiyer-intel left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update main README - https://github.com/intel/optimization-zone/blob/main/README.md to include a link to your contribution on TensorFlow in the software section.

@harp-intel harp-intel left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good. A couple requests for your verification. Also, don't forget to add a link in the repo's root README.md to the software/tensorflow/README.md.

Comment thread software/tensorflow/computer-vision-resnet50/README.md Outdated
Comment thread software/tensorflow/nlp-transformers-bert/README.md Outdated
Comment thread software/tensorflow/graph-neural-networks-rgat/README.md Outdated
@lucasmelogithub

Copy link
Copy Markdown
Contributor

On the prerequisite for each README.md:

  1. Is there a specific version of python we need to call out?
  2. I suggest adding "docker" as a prerequisite

@othakkar

Copy link
Copy Markdown
Contributor Author

Thank you for the review comments, @rsiyer-intel, @harp-intel, and @lucasmelogithub! I've addressed most of them. Regarding the Python version specification, this is typically handled implicitly through TensorFlow's dependency requirements, as each TF version enforces compatibility with specific Python versions.

@rsiyer-intel rsiyer-intel left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Om! Looks good.

@harp-intel harp-intel left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @othakkar

@rsiyer-intel
rsiyer-intel merged commit 2a5e71a into intel:main Apr 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants