[Merged by Bors] - Add pull policy

[adwk67]

Description

Added two optional fields to the custom resource to govern pull policy and secrets to be used when accessing images.
Closes #69.

Review Checklist

• Code contains useful comments
• (Integration-)Test cases added (or not applicable)
• Documentation added (or not applicable)
• Changelog updated (or not applicable)
• Cargo.toml only contains references to git tags (not specific commits or branches)
• Helm chart can be installed and deployed operator works (or not applicable)

Once the review is done, comment bors r+ (or bors merge) to merge. Further information

[razvan]

The image pull policy should also be added to the driver and executor pod templates.

[adwk67]

Isn't it the same image, though? The Job pod pulls the image (or not), and then this image is the same one used for the driver/executors (the pull policy only applies to the spark image, intentionally).

[razvan]

Isn't it the same image, though? The Job pod pulls the image (or not), and then this image is the same one used for the driver/executors (the pull policy only applies to the spark image, intentionally).

Yes, but the Job starts one pod on one node, and in a production cluster there will be more nodes for running the actual spark cluster.

[razvan]

The tests still work and there is one small thing but it LGTM otherwise.

[adwk67]

bors merge

[bors]

Pull request successfully merged into main.

Build succeeded:

• All tests passed