ChatGPT Agent

[Future-Outlier]

Tracking issue

flyteorg/flyte#3936

Why are the changes needed?

We want to support chatgpt agent and provide example for users to develop sync agent.

What changes were proposed in this pull request?

• add openai-chatgpt plugin

How was this patch tested?

Setup process

0. Set up my local single binary environment. (use pyflyte serve agent)
1. Build a docker image with sync agent proto and chatgpt agent's gitsha.
2. Test the chatgpt task in both local and remote scenarios.

tasks:
  task-plugins:
    enabled-plugins:
      - container
      - sidecar
      - K8S-ARRAY
      - agent-service
      
    default-for-task-types:
      chatgpt: agent-service
      custom_task: agent-service
      container: container
      container_array: K8S-ARRAY

plugins:
  agent-service:
    supportedTaskTypes:
      - sensor
      - spark
      - default_task
      - custom_task
      - chatgpt
      - sensor
      - airflow
    defaultAgent:
      endpoint: "dns:///localhost:8000"
      insecure: true
      timeouts:
        GetTask: 100s
      defaultTimeout: 100s

FROM python:3.9-slim-buster
USER root
WORKDIR /root
ENV PYTHONPATH /root
RUN apt-get update && apt-get install build-essential -y
RUN apt-get install git -y

RUN pip install -U git+https://github.com/flyteorg/flytekit.git@c9972bf023d10bef3aefa9fa6763c6b35aec5693
RUN pip install -U git+https://github.com/flyteorg/flytekit.git@c9972bf023d10bef3aefa9fa6763c6b35aec5693#subdirectory=plugins/flytekit-openai

from flytekit import task, workflow
from flytekitplugins.chatgpt import ChatGPTTask

chatgpt_new_job = ChatGPTTask(
            name="chatgpt",
            # openai_organization="org-NayNG68kGnVXMJ8Ak4PMgQv7",
            openai_organization="xxx",
            chatgpt_config={
                    "model": "gpt-3.5-turbo",
                    "temperature": 0.7,
            },
        )

@workflow
def wf() -> str:
    message = chatgpt_new_job(message="Hi")
    return t1(s=message)

@task
def t1(s: str) -> str:
    s = "Repsonse: " + s
    return s

if __name__ == "__main__":
    print(wf())

Screenshots

Local Scenario

python chatgpt_chain.py

Remote Scenario

pyflyte run --remote --image futureoutlier/flytekit:chatgpt-0301 chatgpt_chain.py wf --message hi

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

#1822
#2085

Docs link

[codecov]

Codecov Report

Attention: Patch coverage is 97.19626% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 85.98%. Comparing base (f66fa66) to head (5af7404).
Report is 1 commits behind head on master.

Files	Patch %	Lines
flytekit/extend/backend/base_agent.py	66.66%	2 Missing ⚠️
...ns/flytekit-openai/flytekitplugins/chatgpt/task.py	93.75%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2226      +/-   ##
==========================================
+ Coverage   83.28%   85.98%   +2.69%     
==========================================
  Files         178      320     +142     
  Lines       17689    24246    +6557     
  Branches     3666     3666              
==========================================
+ Hits        14732    20847    +6115     
- Misses       2305     2747     +442     
  Partials      652      652              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Future-Outlier]

local failure case

remote failure case