Pod Sweeper: should allow configuring pod states to sweep

[prein]

Tell us about the problem you're trying to solve

While trying to understand why pod sweeper doesn't work for us at the moment, I tried running the kubectl command found in get_worker_pods in https://github.com/airbytehq/airbyte/blob/master/kube/resources/pod-sweeper.yaml#L10 and noticed that it returns pods in any phase other than Running including pods in Pending phase. Then in

airbyte/kube/resources/pod-sweeper.yaml

Line 34 in 838ce14

if [ "$POD_STATUS" = "Succeeded" ]; then

Succeeded status is handled differently from other statuses.
I would like to have only the pods in phases Failed and Succeeded to be garbage collected.

Describe the solution you’d like

A variable with list of phase names maybe and if not in the list then ignore? Or a var to toggle Pending pods deletion.

Are you willing to submit a PR?

Sure