A data engineer has a Job with multiple tasks that runs nightly. One of the tasks unexpectedly fails during 10 percent of the runs.
Which of the following actions can the data engineer perform to ensure the Job completes each night while minimizing compute costs?
a) Increase the cluster size to ensure sufficient resources for all tasks.
b) Implement retry logic for the failed task with exponential backoff.
c) Use dynamic allocation to optimize resource utilization based on workload.
d) Decrease the parallelism of the job to reduce the likelihood of failures.