From a84524ada8612e5e93f27facfa93c5dc2b820f32 Mon Sep 17 00:00:00 2001 From: hshen14 Date: Thu, 21 Mar 2024 13:49:20 +0800 Subject: [PATCH 1/5] Update ChatQnA --- README.md | 56 +++++++++++++++++++++++++++++++++++++++++++++++-------- 1 file changed, 48 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index aa5c52ca23..f9954ea6a5 100644 --- a/README.md +++ b/README.md @@ -1,15 +1,55 @@ -# GenerativeAIExamples -Generative AI (GenAI) Examples is a collection of GenAI examples such as ChatQnA, Copilot, which heavily reused ecosystem-based components plus Intel optimizations. +# Intel Generative AI Examples -# ChatQnA -[ChatQnA](./ChatQnA/README.md) is a chatbot for question and answering through retrieval argumented generation (RAG). The example is developed with Langchain API and Redis as vector store, and deployed on Gaudi with Xeon through Hugging Face text generation inference (TGI) serving. +## Introduction -# CodeGen +This project provides a collective list of Generative AI (GenAI) examples such as chatbot with question and answering (ChatQnA), code generation, document summary, etc. The examples are developed by leveraging the ecosystem components with Intel optimizations, therefore delivering the high perforamnce on Intel platforms. + +## GenAI Examples + +### ChatQnA + +[ChatQnA](./ChatQnA/README.md) is an example of chatbot with question and answering through retrieval argumented generation (RAG). + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
FrameworkLLMEmbeddingVector DatabaseServingHWDescription
[angChain](https://www.langchain.com/)[NeuralChat-v3](https://huggingface.co/Intel/neural-chat-7b-v3-1)[BGE-Base](https://huggingface.co/BAAI/bge-base-en)[Redis](https://redis.io/)[TGI-Habana](https://github.com/huggingface/tgi-gaudi)Gaudi2Chatbot
[angChain](https://www.langchain.com/)[NeuralChat-v3](https://huggingface.co/Intel/neural-chat-7b-v3-1)[BGE-Base](https://huggingface.co/BAAI/bge-base-en)[Chroma](https://www.trychroma.com/)[TGI-Habana](https://github.com/huggingface/tgi-gaudi)Gaudi2Chatbot
+ + +### CodeGen [CodeGen](./CodeGen/README.md) is a copilot application designed for code generation use case. We offer a VS Code plugin for easy usage. In this example, we demonstrate how code generation can be efficiently executed on the Intel Gaudi2 platform. -# DocSum +### DocSum [DocSum](./DocSum/README.md) is a chatbot for summarizing the content of your documents or reports. The example is developed with Langchain API and deployed on Gaudi through Hugging Face text generation inference (TGI) serving. -# VisualQnA -[VisualQnA](./VisualQnA/README.md) is a chatbot for visual question and answering task. This example guides you through how to deploy a [LLaVA](https://llava-vl.github.io/) (Large Language and Vision Assistant) model on Intel Gaudi2. \ No newline at end of file +### VisualQnA +[VisualQnA](./VisualQnA/README.md) is a chatbot for visual question and answering task. This example guides you through how to deploy a [LLaVA](https://llava-vl.github.io/) (Large Language and Vision Assistant) model on Intel Gaudi2. From 16874c236bf490a67979ca907753875cf57b5eec Mon Sep 17 00:00:00 2001 From: hshen14 Date: Thu, 21 Mar 2024 13:59:13 +0800 Subject: [PATCH 2/5] Format table --- README.md | 34 +++++++++++++++++----------------- 1 file changed, 17 insertions(+), 17 deletions(-) diff --git a/README.md b/README.md index f9954ea6a5..c17d46ebc9 100644 --- a/README.md +++ b/README.md @@ -14,29 +14,29 @@ This project provides a collective list of Generative AI (GenAI) examples such a - - - - - - - + + + + + + + - - - - - + + + + + - - - - - + + + + + From b904b3974e6da235a831d82aab05d581d4e02898 Mon Sep 17 00:00:00 2001 From: hshen14 Date: Thu, 21 Mar 2024 14:16:48 +0800 Subject: [PATCH 3/5] Format table --- README.md | 77 +++++++++++++++++++++++++++++++++++++++++++++++++++++-- 1 file changed, 75 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index c17d46ebc9..f049a21146 100644 --- a/README.md +++ b/README.md @@ -24,7 +24,7 @@ This project provides a collective list of Generative AI (GenAI) examples such a - + @@ -33,13 +33,22 @@ This project provides a collective list of Generative AI (GenAI) examples such a - + + + + + + + + + +
FrameworkLLMEmbeddingVector DatabaseServingHWDescriptionFrameworkLLMEmbeddingVector DatabaseServingHWDescription
[angChain](https://www.langchain.com/)[NeuralChat-v3](https://huggingface.co/Intel/neural-chat-7b-v3-1)[BGE-Base](https://huggingface.co/BAAI/bge-base-en)[Redis](https://redis.io/)[TGI-Habana](https://github.com/huggingface/tgi-gaudi)LangChainNeuralChat-v3BGE-BaseRedisTGI-Habana Gaudi2 Chatbot
[angChain](https://www.langchain.com/)[NeuralChat-v3](https://huggingface.co/Intel/neural-chat-7b-v3-1)[BGE-Base](https://huggingface.co/BAAI/bge-base-en)[Chroma](https://www.trychroma.com/)[TGI-Habana](https://github.com/huggingface/tgi-gaudi)LangChainNeuralChat-v3BGE-BaseChromaTGI-Habana Gaudi2 Chatbot
LangChainNeuralChat-v3NeuralChat-7B BGE-Base Redis TGI-Habana
LangChainNeuralChat-v3NeuralChat-7B BGE-Base Chroma TGI-Habana Gaudi2 Chatbot
LangChainMistral-7BBGE-BaseRedisTGI-HabanaGaudi2Chatbot
@@ -47,9 +56,73 @@ This project provides a collective list of Generative AI (GenAI) examples such a ### CodeGen [CodeGen](./CodeGen/README.md) is a copilot application designed for code generation use case. We offer a VS Code plugin for easy usage. In this example, we demonstrate how code generation can be efficiently executed on the Intel Gaudi2 platform. + + + + + + + + + + + + + + + + + +
FrameworkLLMServingHWDescription
LangChainDeepseek-Coder-33BTGI-HabanaGaudi2Chatbot
+ ### DocSum [DocSum](./DocSum/README.md) is a chatbot for summarizing the content of your documents or reports. The example is developed with Langchain API and deployed on Gaudi through Hugging Face text generation inference (TGI) serving. + + + + + + + + + + + + + + + + + + + + + + + + +
FrameworkLLMServingHWDescription
LangChainNeuralChat-7BTGI-HabanaGaudi2Chatbot
LangChainMistral-7BTGI-HabanaGaudi2Chatbot
+ ### VisualQnA [VisualQnA](./VisualQnA/README.md) is a chatbot for visual question and answering task. This example guides you through how to deploy a [LLaVA](https://llava-vl.github.io/) (Large Language and Vision Assistant) model on Intel Gaudi2. + + + + + + + + + + + + + + + + + + +
FrameworkLLMServingHWDescription
LangChainLLaVA-1.5-7BTGI-HabanaGaudi2Chatbot
From 2b9a3a3d465bbe323a3bd93481494df0095a2d3b Mon Sep 17 00:00:00 2001 From: hshen14 Date: Thu, 21 Mar 2024 14:50:31 +0800 Subject: [PATCH 4/5] Refine the readme --- README.md | 19 ++++++++++++------- 1 file changed, 12 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index f049a21146..5745a9936e 100644 --- a/README.md +++ b/README.md @@ -2,13 +2,19 @@ ## Introduction -This project provides a collective list of Generative AI (GenAI) examples such as chatbot with question and answering (ChatQnA), code generation, document summary, etc. The examples are developed by leveraging the ecosystem components with Intel optimizations, therefore delivering the high perforamnce on Intel platforms. +This project provides a collective list of Generative AI (GenAI) examples such as chatbot with question and answering (ChatQnA), code generation, document summary, etc. The examples are developed by leveraging the ecosystem components such as LangChain with Intel optimizations, therefore delivering the high performance for your deployment on Intel platforms. ## GenAI Examples +All the examples are well-validated on Intel platforms withe below features: -### ChatQnA +* Easy to use. Use ecosystem-compliant APIs to build the end-to-end GenAI examples. + +* Easy to customize. Customize the example using different framework, LLM, embedding, serving. -[ChatQnA](./ChatQnA/README.md) is an example of chatbot with question and answering through retrieval argumented generation (RAG). +* Easy to deploy. Deploy the GenAI examples with performance on Intel platforms. + +### ChatQnA +[ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval argumented generation (RAG). @@ -52,9 +58,8 @@ This project provides a collective list of Generative AI (GenAI) examples such a
- ### CodeGen -[CodeGen](./CodeGen/README.md) is a copilot application designed for code generation use case. We offer a VS Code plugin for easy usage. In this example, we demonstrate how code generation can be efficiently executed on the Intel Gaudi2 platform. +[CodeGen](./CodeGen/README.md) is an example of copilot designed for code generation in Visual Studio Code. @@ -77,7 +82,7 @@ This project provides a collective list of Generative AI (GenAI) examples such a ### DocSum -[DocSum](./DocSum/README.md) is a chatbot for summarizing the content of your documents or reports. The example is developed with Langchain API and deployed on Gaudi through Hugging Face text generation inference (TGI) serving. +[DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of your documents or reports.
@@ -106,7 +111,7 @@ This project provides a collective list of Generative AI (GenAI) examples such a
### VisualQnA -[VisualQnA](./VisualQnA/README.md) is a chatbot for visual question and answering task. This example guides you through how to deploy a [LLaVA](https://llava-vl.github.io/) (Large Language and Vision Assistant) model on Intel Gaudi2. +[VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on images. From a90f86e6e20005f59234d24e06e57a0fe4b6ed96 Mon Sep 17 00:00:00 2001 From: hshen14 Date: Thu, 21 Mar 2024 14:53:21 +0800 Subject: [PATCH 5/5] Refine the readme --- README.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 5745a9936e..1a5b87eed7 100644 --- a/README.md +++ b/README.md @@ -7,11 +7,11 @@ This project provides a collective list of Generative AI (GenAI) examples such a ## GenAI Examples All the examples are well-validated on Intel platforms withe below features: -* Easy to use. Use ecosystem-compliant APIs to build the end-to-end GenAI examples. +* Easy to use. Use ecosystem-compliant APIs to build the end-to-end GenAI examples -* Easy to customize. Customize the example using different framework, LLM, embedding, serving. +* Easy to customize. Customize the example using different framework, LLM, embedding, serving -* Easy to deploy. Deploy the GenAI examples with performance on Intel platforms. +* Easy to deploy. Deploy the GenAI examples with performance on Intel platforms ### ChatQnA [ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval argumented generation (RAG). @@ -75,14 +75,14 @@ All the examples are well-validated on Intel platforms withe below features: - +
Deepseek-Coder-33B TGI-Habana Gaudi2ChatbotCopilot
### DocSum -[DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of your documents or reports. +[DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of documents or reports. @@ -111,7 +111,7 @@ All the examples are well-validated on Intel platforms withe below features:
### VisualQnA -[VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on images. +[VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on the images.