[Bug] Failed to load chat error

[JanithMCSCO]

Priority

Undecided

OS type

Ubuntu

Hardware type

Xeon-SPR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Kubernetes GMC
• Other

Running nodes

Single Node

What's the version?

?

Description

Hi. I saw that Arun had this issue previously but that ticket was closed.

I pulled the images off github today and followed the steps in the getting started guide (https://opea-project.github.io/latest/getting-started/README.html)

All my containers are up but when I try to put in some text in the chat window/browser, I get an error stating "Failed to load chat content"

I'm running this on an AWS m7i.4XL instance.

Reproduce steps

https://opea-project.github.io/latest/getting-started/README.html

Raw log

Attachments

No response

[louie-tsai]

@JanithMCSCO
Have you checked your LLM service ready or not first before you put some prompt on UI?
Here are related comments to check vllm service.
docker logs vllm-service | grep Connected
this is for TGI.
docker logs tgi-service | grep Connected

regards
Louie

[JanithMCSCO]

@JanithMCSCO Have you checked your LLM service ready or not first before you put some prompt on UI? Here are related comments to check vllm service. docker logs vllm-service | grep Connected this is for TGI. docker logs tgi-service | grep Connected

regards Louie

Thanks Louie. I had not accepted the Meta T&C on HF so the VLLM service was failing. It's working now.