Skip to content

Adding files to deploy CodeGen application on ROCm vLLM#1544

Merged
chensuyue merged 102 commits into
opea-project:mainfrom
chyundunovDatamonsters:feature/Codegen_vLLM
Mar 24, 2025
Merged

Adding files to deploy CodeGen application on ROCm vLLM#1544
chensuyue merged 102 commits into
opea-project:mainfrom
chyundunovDatamonsters:feature/Codegen_vLLM

Conversation

@chyundunovDatamonsters
Copy link
Copy Markdown
Contributor

Description

Adding files to deploy CodeGen application on ROCm vLLM.

Issues

It is required to provide the ability to deploy the CodeGen application on ROCm vLLM

Type of change

  • [*] New feature (non-breaking change which adds new functionality)

Dependencies

Tests

Testing was performed manually and by running a script CodeGen/tests/test_compose_vllm_on_rocm.sh This script is similar to the script that runs CodeGen testing on an Intel CPU.

Chingis Yundunov added 21 commits February 12, 2025 10:25
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Feb 13, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

Comment thread CodeGen/Dockerfile-vllm-rocm Outdated
Copy link
Copy Markdown

@AlexHe99 AlexHe99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please refer to my review comments.

Comment thread CodeGen/Dockerfile-vllm-rocm Outdated
Comment thread CodeGen/Dockerfile-vllm-rocm Outdated
Comment thread CodeGen/docker_compose/amd/gpu/rocm/compose_vllm.yaml
Comment thread CodeGen/tests/test_compose_vllm_on_rocm.sh
Comment thread CodeGen/docker_compose/amd/gpu/rocm/set_env_vllm.sh
Chingis Yundunov added 4 commits February 17, 2025 11:12
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
pre-commit-ci Bot and others added 22 commits March 18, 2025 05:34
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
@chensuyue chensuyue merged commit 31b1d69 into opea-project:main Mar 24, 2025
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
…#1544)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
…#1544)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters added a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
…#1544)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
letonghan pushed a commit that referenced this pull request Sep 17, 2025
cogniware-devops pushed a commit to Cogniware-Inc/GenAIExamples that referenced this pull request Dec 19, 2025
…#1544)

Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: cogniware-devops <ambarish.desai@cogniware.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants