Skip to content

Agent Get Pending Message#1834

Merged
pingsutw merged 30 commits into
flyteorg:masterfrom
Future-Outlier:agent-service-get-message
Nov 21, 2023
Merged

Agent Get Pending Message#1834
pingsutw merged 30 commits into
flyteorg:masterfrom
Future-Outlier:agent-service-get-message

Conversation

@Future-Outlier

@Future-Outlier Future-Outlier commented Sep 14, 2023

Copy link
Copy Markdown
Member

TL;DR

Relay detailed messages to the Flyte console to keep users informed of "Pending" status.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

ScreenShots

The test will pass in base_agent.py and plugins/flytekit-spark/tests/test_agent.py::test_databricks_agent

image

Complete description

Two months ago, I introduced the Databricks agent service.
Currently, job statuses progress from "pending" to "running" to "succeeded".
To enhance user experience, @pingsutw, @kumare3, and I propose enriching the "pending" status with additional information for Databricks API and future implementations.
This update will relay detailed messages to the Flyte console to keep users informed.

Follow-up issue

flyteorg/flyte#4115
flyteorg/flyte#4106
flyteorg/flyte#3936

Signed-off-by: Future Outlier <eric901201@gmai.com>
@codecov

codecov Bot commented Sep 15, 2023

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (c275011) 62.54% compared to head (fcaa2a3) 85.80%.
Report is 7 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff             @@
##           master    #1834       +/-   ##
===========================================
+ Coverage   62.54%   85.80%   +23.26%     
===========================================
  Files         313      313               
  Lines       23249    23284       +35     
  Branches     3526     3526               
===========================================
+ Hits        14540    19979     +5439     
+ Misses       8286     2702     -5584     
- Partials      423      603      +180     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Future Outlier added 2 commits November 5, 2023 20:55
Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Future Outlier <eric901201@gmai.com>
@Future-Outlier Future-Outlier changed the title Agent service get message Agent Get Pending Message Nov 6, 2023
Future Outlier added 2 commits November 6, 2023 20:19
Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Future Outlier <eric901201@gmai.com>
Comment thread plugins/flytekit-spark/flytekitplugins/spark/agent.py Outdated
Co-authored-by: Kevin Su <pingsutw@gmail.com>
Signed-off-by: Future Outlier <eric901201@gmai.com>
@Future-Outlier Future-Outlier force-pushed the agent-service-get-message branch from dad3e3d to 539bad1 Compare November 7, 2023 01:51
Future Outlier added 2 commits November 7, 2023 09:56
Signed-off-by: Future Outlier <eric901201@gmai.com>
…nto agent-service-get-message

Signed-off-by: Future Outlier <eric901201@gmai.com>
Future Outlier and others added 3 commits November 21, 2023 09:08
…nto agent-service-get-message

Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
@pingsutw pingsutw merged commit 34eeb46 into flyteorg:master Nov 21, 2023
ringohoffman pushed a commit to ringohoffman/flytekit that referenced this pull request Nov 24, 2023
Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Future Outlier <eric901201@gmai.com>
Co-authored-by: Kevin Su <pingsutw@gmail.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
RRap0so pushed a commit to RRap0so/flytekit that referenced this pull request Dec 15, 2023
Signed-off-by: Future Outlier <eric901201@gmai.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Future Outlier <eric901201@gmai.com>
Co-authored-by: Kevin Su <pingsutw@gmail.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Rafael Raposo <rafaelraposo@spotify.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants