[Dataproc] Add instance_flexibility_policy with provisioning_model_mix to secondary_worker_config in google_dataproc_workflow_template - #18948
Conversation
…_dataproc_workflow_template
…_dataproc_workflow_template
…x to secondary_worker_config in google_dataproc_workflow_template
|
Googlers: For automatic test runs see go/terraform-auto-test-runs. @SirGitsalot, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look. You can help make sure that review is quick by doing a self-review and by running impacted tests locally. |
|
Hi there, I'm the Modular magician. I've detected the following information about your changes for commit 9129add: Diff reportYour PR generated the following diffs in downstream repositories:
Test reportAnalytics
Affected Service Packages
Step 1: Replaying Mode Action takenFound 2 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
View the replaying VCR build log Step 2: Recording Mode
🟢 All tests passed! View the recording VCR build log or the debug logs folder for detailed results. @realdev12, @SirGitsalot VCR tests complete for 9129add! |
|
@SirGitsalot This PR has been waiting for review for 3 weekdays. Please take a look! Use the label |
Purpose
Add support for Dataproc Flexible VMs (
instance_flexibility_policy) andprovisioning_model_mixtosecondary_worker_configingoogle_dataproc_workflow_template. This enables secondary/preemptible worker groups to combine multiple machine shapes with mixed Standard and Spot/Preemptible VM capacities.Implementation Scope & Design Decisions
To maintain parity with the existing
google_dataproc_clusterresource and keep this PR reviewable and well-scoped:provisioning_model_mix(standard_capacity_base,standard_capacity_percent_above_base) is supported exclusively onsecondary_worker_config, adhering to Dataproc API requirements where provisioning model mixing applies only to secondary/preemptible workers.dataproc-flex-vm-master). Base branch is set todataproc-flex-vm-master.Tests & Verification
betaandgaproviders.TestAccDataprocWorkflowTemplate_instanceFlexibilityPolicyexercisingsecondary_worker_config.instance_flexibility_policyalong withprovisioning_model_mixassertions.