Skip to content

Add docker compose deployment for ROCm example#1054

Closed
astafevav wants to merge 6 commits into
opea-project:mainfrom
astafevav:add-docsum-rocm-docker-compose-example
Closed

Add docker compose deployment for ROCm example#1054
astafevav wants to merge 6 commits into
opea-project:mainfrom
astafevav:add-docsum-rocm-docker-compose-example

Conversation

@astafevav
Copy link
Copy Markdown

@astafevav astafevav commented Nov 1, 2024

Type of change

  • Added docker compose deployment example for AMD ROCm systems
  • Added Readme for compose deployment on AMD ROCm systems
  • Added tests for compose deployment on AMD ROCm systems

@chensuyue
Copy link
Copy Markdown
Collaborator

Please add a similar CI test like this, so we can trigger the test on amd gpu, https://github.com/opea-project/GenAIExamples/blob/ee87d75876b231a0f290a69d7e21d21aad74a16a/DocSum/tests/test_compose_on_gaudi.sh

@chensuyue
Copy link
Copy Markdown
Collaborator

And the node from AMD is offline, please check the connect status,
image

@chensuyue chensuyue added the WIP label Nov 4, 2024
@astafevav astafevav marked this pull request as draft November 5, 2024 12:24
@astafevav astafevav marked this pull request as ready for review November 5, 2024 13:22
@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from 0e08891 to 7ea3fa8 Compare November 6, 2024 06:03
@astafevav
Copy link
Copy Markdown
Author

Hi @chensuyue, thank you for review,

I've added test scripts for AMD Rocm for DocSum And FaqGen,

But still clarifying status for coresite-sv7-106-amd-mi300-19 with the team.

Comment thread DocSum/tests/test_compose_on_amd_rocm.sh
@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from 7ea3fa8 to 713cc1b Compare November 6, 2024 12:41
@@ -0,0 +1,87 @@
# Copyright (C) 2024 Intel Corporation
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you should add AMD copyright.

@@ -0,0 +1,184 @@
#!/bin/bash
# Copyright (C) 2024 Intel Corporation
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also here.

@chensuyue chensuyue modified the milestone: v1.1 Nov 7, 2024
Comment thread DocSum/docker_compose/amd/gpu/rocm/README.md Outdated
Comment thread DocSum/docker_compose/amd/gpu/rocm/README.md Outdated
Comment on lines +39 to +42
security_opt:
- seccomp:unconfined
cap_add:
- SYS_PTRACE
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this some development version not intended for production, or why it's disabling security measures instead of adding them?


stop_docker

if [[ "$IMAGE_REPO" == "opea" ]]; then build_docker_images; fi
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be good to make all scripts shellcheck clean (apt install shellscheck; shellcheck *.sh).

Comment thread DocSum/docker_compose/amd/gpu/rocm/README.md Outdated
Signed-off-by: astafevav <astafevav@sibedge.com>
@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from c96d387 to e7ae5d1 Compare November 8, 2024 10:30
@astafevav
Copy link
Copy Markdown
Author

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.

I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.

Still clarifying status for AMD copyright and will fix shellcheck warning for then too.

Sorry for inconvenience.

@chensuyue
Copy link
Copy Markdown
Collaborator

Please also fix the CI issue.

@chensuyue
Copy link
Copy Markdown
Collaborator

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.

I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.

Still clarifying status for AMD copyright and will fix shellcheck warning for then too.

Sorry for inconvenience.

Please put your new PR link here when you have it and close the old one.

@astafevav
Copy link
Copy Markdown
Author

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.
I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.
Still clarifying status for AMD copyright and will fix shellcheck warning for then too.
Sorry for inconvenience.

Please put your new PR link here when you have it and close the old one.

Re-submitted PR: #1125, I'm still working on test script, so status for new PR is still work in progress.

Closing this one.

@astafevav
Copy link
Copy Markdown
Author

Re-submitted PR: #1125

@astafevav astafevav closed this Nov 13, 2024
lkk12014402 pushed a commit that referenced this pull request Jan 17, 2025
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants