Add Raw AWS Batch Task

[pingsutw]

Signed-off-by: Kevin Su pingsutw@apache.org

TL;DR

Run regular tasks on AWS batch service
check example in flyteorg/flytekit#782

Type

• Bug Fix
• Feature
• Plugin

Are all requirements met?

• Code completed
• Smoke tested
• Unit tests added
• Code documentation added
• Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

flyteorg/flyte#1792
flyteorg/flytekit#782

Follow-up issue

NA

[codecov]

Codecov Report

Merging #228 (1b8cecb) into master (973a51a) will increase coverage by 0.16%.
The diff coverage is 79.62%.

@@            Coverage Diff             @@
##           master     #228      +/-   ##
==========================================
+ Coverage   62.30%   62.47%   +0.16%     
==========================================
  Files         141      142       +1     
  Lines        8807     8868      +61     
==========================================
+ Hits         5487     5540      +53     
- Misses       2821     2822       +1     
- Partials      499      506       +7     

Flag	Coverage Δ
unittests	62.07% <80.76%> (+0.16%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...plugins/array/awsbatch/definition/job_def_cache.go	0.00% <0.00%> (ø)
go/tasks/plugins/array/awsbatch/transformer.go	77.39% <75.00%> (-1.48%)	⬇️
go/tasks/plugins/array/outputs.go	72.18% <75.00%> (-0.99%)	⬇️
go/tasks/plugins/array/awsbatch/client.go	64.06% <100.00%> (+0.57%)	⬆️
go/tasks/plugins/array/awsbatch/executor.go	40.56% <100.00%> (ø)
go/tasks/plugins/array/awsbatch/job_definition.go	69.23% <100.00%> (+2.56%)	⬆️
go/tasks/plugins/array/catalog.go	48.58% <100.00%> (+1.69%)	⬆️
go/tasks/plugins/array/inputs.go	83.33% <100.00%> (ø)
go/tasks/plugins/array/awsbatch/launcher.go	57.89% <0.00%> (-1.73%)	⬇️
go/tasks/plugins/webapi/athena/plugin.go	17.85% <0.00%> (-1.45%)	⬇️
... and 17 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 973a51a...1b8cecb. Read the comment docs.

[kumare3]

mostly looks good to me, but, looks a little more complicated because of the array case

[hamersaw]

Few questions regarding implementation and a couple nits. I think it looks great!

[EngHabu]

Thanks @pingsutw almost there... I've a couple more comments!

[EngHabu]

Thank you @pingsutw