Skip to content

Pass verify flag to all authenticators#1641

Merged
wild-endeavor merged 5 commits into
flyteorg:masterfrom
ByronHsu:verify-arg
May 19, 2023
Merged

Pass verify flag to all authenticators#1641
wild-endeavor merged 5 commits into
flyteorg:masterfrom
ByronHsu:verify-arg

Conversation

@ByronHsu

Copy link
Copy Markdown
Collaborator

TL;DR

Pass verify flag to all authenticators

Type

  • Bug Fix
  • Feature
  • Plugin

byhsu added 3 commits May 15, 2023 22:35
Signed-off-by: byhsu <byhsu@linkedin.com>
Signed-off-by: byhsu <byhsu@linkedin.com>
Signed-off-by: byhsu <byhsu@linkedin.com>
Signed-off-by: byhsu <byhsu@linkedin.com>
@codecov

codecov Bot commented May 16, 2023

Copy link
Copy Markdown

Codecov Report

Merging #1641 (5c644a2) into master (c65397d) will decrease coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1641      +/-   ##
==========================================
- Coverage   71.04%   71.04%   -0.01%     
==========================================
  Files         335      335              
  Lines       30661    30661              
  Branches     5558     5558              
==========================================
- Hits        21783    21782       -1     
+ Misses       8336     8328       -8     
- Partials      542      551       +9     
Impacted Files Coverage Δ
flytekit/clients/auth/authenticator.py 52.03% <100.00%> (ø)
flytekit/clients/auth/token_client.py 52.50% <100.00%> (ø)
flytekit/clients/auth_helper.py 45.20% <100.00%> (ø)
...s/flytekit/unit/clients/auth/test_authenticator.py 100.00% <100.00%> (ø)
...ts/flytekit/unit/clients/auth/test_token_client.py 100.00% <100.00%> (ø)

... and 6 files with indirect coverage changes

Signed-off-by: byhsu <byhsu@linkedin.com>
Comment thread flytekit/clients/auth/authenticator.py
Comment thread flytekit/clients/auth_helper.py
@wild-endeavor wild-endeavor merged commit 47be974 into flyteorg:master May 19, 2023
@ByronHsu ByronHsu deleted the verify-arg branch May 29, 2023 01:10
eapolinario pushed a commit that referenced this pull request Jun 29, 2023
Signed-off-by: byhsu <byhsu@linkedin.com>
eapolinario added a commit that referenced this pull request Jun 30, 2023
* FLYTECTL_CONFIG env var higher precedence, config flag respected in pyflyte package (#1662)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Change flytekit Pytorch, TFJob and MPI plugins to use new kubeflow config (#1627)

* upgrade tensorflow plugin to v1

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* minor fix

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* fix tests and lints

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* move models file into task make backward compatible

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* add code example in README

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* bump flyteidl

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* add pytorch

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* add mpi and fix requirements.txt

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* lint and fmt

Signed-off-by: Yubo Wang <yubwang@linkedin.com>

* Regenerate requirements files using python 3.8

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

---------

Signed-off-by: Yubo Wang <yubwang@linkedin.com>
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Yubo Wang <yubwang@linkedin.com>
Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Root cert should be byte string when loading from caCertFilePath (#1669)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Explicitly set the content type for flyte deck (#1658)

* Set content type for flyte deck

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Use protos of new kubeflow.pytorch plugin instead of legacy pytorch plugin (#1678)

Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>

* More time info for time line deck (#1680)

* more visualization

Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>

* more visualization

Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>

---------

Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>

* Add http_proxy to client & Fix deviceflow (#1611)

* Add http_proxy to client & Fix deviceflow

RB=3890720

Signed-off-by: byhsu <byhsu@linkedin.com>

* nit

Signed-off-by: byhsu <byhsu@linkedin.com>

* lint!

Signed-off-by: byhsu <byhsu@linkedin.com>

---------

Signed-off-by: byhsu <byhsu@linkedin.com>
Co-authored-by: byhsu <byhsu@linkedin.com>

* Pass verify flag to all authenticators (#1641)

Signed-off-by: byhsu <byhsu@linkedin.com>

* feat: Add Auth0/audience support for ClientCredentials flow (#1639)

* feat: Add Auth0/audience support for ClientCredentials flow

Signed-off-by: tnam <tommy.nam@aiq-index.com>

* refactor: Remove unneeded variables & condense code

Signed-off-by: tnam <tommy.nam@aiq-index.com>

* refactor: Reduce verbosity of code

Signed-off-by: tnam <tommy.nam@aiq-index.com>

* refactor(chore): Remove unused commented code

Signed-off-by: tnam <tommy.nam@aiq-index.com>

* fix: Missing comma in input args - authenticator.py 213

Signed-off-by: tnam <tommy.nam@aiq-index.com>

* style: Run pre-commit against all files

Signed-off-by: tnam <tommy.nam@aiq-index.com>

---------

Signed-off-by: tnam <tommy.nam@aiq-index.com>
Co-authored-by: tnam <tommy.nam@aiq-index.com>

* pyflyte run remote file (#1670)

Signed-off-by: ChungYujoyce <joyce.bhps@gmail.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Kevin Su <pingsutw@apache.org>

* upload deck.html only with deck enable (#1693)

Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>

* Add dask plugin #patch (#1366)

* Add dummy task type to test backend plugin

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add docs page

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add dask models

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add function to convert resources

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add tests to `dask` task

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Remove namespace

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update setup.py

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add dask to `plugin/README.md`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Add README.md for `dask`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Top level export of `JopPodSpec` and `DaskCluster`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update docs for images

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update README.md

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update models after `flyteidl` change

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update task after `flyteidl` change

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Raise error when less than 1 worker

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update flyteidl to >= 1.3.2

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update doc requirements

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Update doc-requirements.txt

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Re-lock dependencies on linux

Signed-off-by: Bernhard Stadlbauer <bernhard@pachama.com>

* Update dask API docs

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Fix documentation links

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Default optional model constructor arguments to `None`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Refactor `convert_resources_to_resource_model` to `core.resources`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Use `convert_resources_to_resource_model` in `core.node`

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* Incorporate review feedback

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Lint

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>
Signed-off-by: Bernhard Stadlbauer <bernhard@pachama.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <653394+eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Do not bring dask changes

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Remove readthedocs

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Linting

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Force scipy<1.11.0 is on windows

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

---------

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: Yubo Wang <yubwang@linkedin.com>
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>
Signed-off-by: byhsu <byhsu@linkedin.com>
Signed-off-by: tnam <tommy.nam@aiq-index.com>
Signed-off-by: ChungYujoyce <joyce.bhps@gmail.com>
Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>
Signed-off-by: Bernhard Stadlbauer <bernhard@pachama.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
Co-authored-by: Yubo Wang <yubwang@linkedin.com>
Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Fabio M. Graetz, Ph.D <fabiograetz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Yicheng-Lu-llll <51814063+Yicheng-Lu-llll@users.noreply.github.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
Co-authored-by: byhsu <byhsu@linkedin.com>
Co-authored-by: TomNam <92072956+PudgyPigeon@users.noreply.github.com>
Co-authored-by: tnam <tommy.nam@aiq-index.com>
Co-authored-by: ChungYujoyce <46030368+ChungYujoyce@users.noreply.github.com>
Co-authored-by: bstadlbauer <11799671+bstadlbauer@users.noreply.github.com>
eapolinario pushed a commit that referenced this pull request Jul 10, 2023
Signed-off-by: byhsu <byhsu@linkedin.com>
eapolinario added a commit that referenced this pull request Jul 12, 2023
* Multi arch imageSpec (#1630)

Multi arch imageSpec (#1630)

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add executor_path and applications_path to spark config (#1634)

* Add executor_path and applications_path to spark config

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add support for env vars to pyflyte run (#1617)

* Add support for env vars to pyflyte run

Signed-off-by: Kevin Su <pingsutw@apache.org>

* bump idl

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update doc

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Fetch task executions in dynamic  (#1636)

* fetch task executions in dynamic

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* lint

Signed-off-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Added metrics command to pyflyte (#1513)

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Add http_proxy to client & Fix deviceflow (#1611)

* Add http_proxy to client & Fix deviceflow

RB=3890720

Signed-off-by: byhsu <byhsu@linkedin.com>

* nit

Signed-off-by: byhsu <byhsu@linkedin.com>

* lint!

Signed-off-by: byhsu <byhsu@linkedin.com>

---------

Signed-off-by: byhsu <byhsu@linkedin.com>
Co-authored-by: byhsu <byhsu@linkedin.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Improve variable names (#1642)

Signed-off-by: byhsu <byhsu@linkedin.com>
Co-authored-by: byhsu <byhsu@linkedin.com>

* Address resolution (#1567)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* pyflyte run supports pickle (#1646)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Wait for the pod plugin instead of flytekit (#1647)

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Beautify deviceflow prompt (#1625)

* Beautify deviceflow prompt

Signed-off-by: byhsu <byhsu@linkedin.com>

* lint!

Signed-off-by: byhsu <byhsu@linkedin.com>

* lint

Signed-off-by: byhsu <byhsu@linkedin.com>

---------

Signed-off-by: byhsu <byhsu@linkedin.com>
Co-authored-by: byhsu <byhsu@linkedin.com>

* Improve flytekit register (#1643)

* Fix pyflyte register

Signed-off-by: byhsu <byhsu@linkedin.com>

* revert

Signed-off-by: byhsu <byhsu@linkedin.com>

* lint

Signed-off-by: byhsu <byhsu@linkedin.com>

---------

Signed-off-by: byhsu <byhsu@linkedin.com>
Co-authored-by: byhsu <byhsu@linkedin.com>

* Pass verify flag to all authenticators (#1641)

Signed-off-by: byhsu <byhsu@linkedin.com>

* Allow annotated FlyteFile as task input argument (#1632)

* fix: Allow annotated FlyteFile as task input argument

Using an annotated FlyteFile type as an input to a task was previously impossible due
to an exception being raised in `FlyteFilePathTransformer.to_python_value`.

This commit applies the fix previously used in `FlyteFilePathTransformer.to_literal`
to permit using annotated FlyteFiles as either inputs and outputs of a task.

Issue: #3424
Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>

* refactor: Unified handling of annotated types in type engine

Issue: #3424
Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>

* fix: Use py3.8-compatible types in type engine tests

Issue: #3424
Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>

---------

Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>

* Use logger instead of print statement in sqlalchemy plugin (#1651)

* use logging info instead of print

Signed-off-by: wirthual <wirthra@gmail.com>

* isorted files

Signed-off-by: wirthual <wirthra@gmail.com>

* import root logger from flytekit

Signed-off-by: wirthual <wirthra@gmail.com>

---------

Signed-off-by: wirthual <wirthra@gmail.com>

* Map over notebook task (#1650)

* map over notebook

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add a flag

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* lint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fix tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* lint

Signed-off-by: Kevin Su <pingsutw@apache.org>

---------

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Support single literals in tiny url (#1654)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Add support overriding image (#1652)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fix ability to pass None to task with Optional kwarg, add test (#1657)

Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>

* Regenerate plugins requirements

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Regenerate plugins requirements and linting

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

* Regenerate whylogs requirements

Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>

---------

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Daniel Rammer <daniel@union.ai>
Signed-off-by: byhsu <byhsu@linkedin.com>
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>
Signed-off-by: wirthual <wirthra@gmail.com>
Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Dan Rammer <daniel@union.ai>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
Co-authored-by: byhsu <byhsu@linkedin.com>
Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Adrian Rumpold <a.rumpold@gmail.com>
Co-authored-by: wirthual <wirthra@gmail.com>
Co-authored-by: Fabio M. Graetz, Ph.D <fabiograetz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants