Skip to content

Commit 3a1fb2b

Browse files
k-routhushubham-pathak-03rbtrjpayne3506
authored
ci: [Service Tags] add public ips with service tags for LBs during cluster creation (#3277)
* Create an outbound public ip for LB/Cilium cluster * create and attach public ip for cilium e2e cluster * Test cluster independent ip creation * Test outbound public ip creation * Test outbound public ip creation * Test outbound public ip creation with azcli creds * Test outbound public ip creation with azcli creds * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add lb ip creation alias call for clusters in makefile * Add managed identity to public ip/load balancer * Add managed identity to public ip/load balancer * Test wo managed identity * Test wo managed identity * Add Public ip to one cluster * Add public to all cluster creations * Add public ip * Fix spacing * Fix spacing * Add LB to win cni v1 cluster * Add LB to win cni v1 cluster * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * Add ip-tag variable to makefile * updated service tag to 'DelegatedNetworkControllerTest' * create public IP as target * add ipv6 public ips to dualstack * updated v6 ip * remove space * added public ip for nodesubnet-byocni-nokubeproxy-up resource * addressed comments on PR * parameterize ip v4 & v6 Co-authored-by: Evan Baker <[email protected]> Signed-off-by: Keerthana Routhu <[email protected]> * address comments * address PR comments * Update hack/aks/Makefile Co-authored-by: John Payne <[email protected]> Signed-off-by: Keerthana Routhu <[email protected]> * test * test * test --------- Signed-off-by: Keerthana Routhu <[email protected]> Co-authored-by: shubham-pathak-03 <[email protected]> Co-authored-by: Evan Baker <[email protected]> Co-authored-by: John Payne <[email protected]>
1 parent d093bfd commit 3a1fb2b

File tree

1 file changed

+62
-24
lines changed

1 file changed

+62
-24
lines changed

Diff for: hack/aks/Makefile

+62-24
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,11 @@ OS_SKU_WIN ?= Windows2022
1919
REGION ?= westus2
2020
VM_SIZE ?= Standard_B2s
2121
VM_SIZE_WIN ?= Standard_B2s
22+
IP_TAG ?= FirstPartyUsage=/DelegatedNetworkControllerTest
23+
IP_PREFIX ?= serviceTaggedIp
24+
PUBLIC_IP_ID ?= /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/publicIPAddresses
25+
PUBLIC_IPv4 ?= $(PUBLIC_IP_ID)/$(IP_PREFIX)-$(CLUSTER)-v4
26+
PUBLIC_IPv6 ?= $(PUBLIC_IP_ID)/$(IP_PREFIX)-$(CLUSTER)-v6
2227
KUBE_PROXY_JSON_PATH ?= ./kube-proxy.json
2328

2429
# overrideable variables
@@ -43,6 +48,23 @@ azcfg: ## Set the $AZCLI to use aks-preview
4348
@$(AZCLI) extension add --name aks-preview --yes
4449
@$(AZCLI) extension update --name aks-preview
4550

51+
ip:
52+
$(AZCLI) network public-ip create --name $(IP_PREFIX)-$(CLUSTER)-$(IPVERSION) \
53+
--resource-group $(GROUP) \
54+
--allocation-method Static \
55+
--ip-tags $(IP_TAG) \
56+
--location $(REGION) \
57+
--sku Standard \
58+
--tier Regional \
59+
--version IP$(IPVERSION)
60+
61+
ipv4:
62+
@$(MAKE) ip IPVERSION=v4
63+
64+
ipv6:
65+
@$(MAKE) ip IPVERSION=v6
66+
67+
4668
set-kubeconf: ## Adds the kubeconf for $CLUSTER
4769
$(AZCLI) aks get-credentials -n $(CLUSTER) -g $(GROUP)
4870

@@ -90,23 +112,22 @@ overlay-net-up: ## Create vnet, nodenet subnets
90112
$(AZCLI) network vnet create -g $(GROUP) -l $(REGION) --name $(VNET) --address-prefixes 10.0.0.0/8 -o none
91113
$(AZCLI) network vnet subnet create -g $(GROUP) --vnet-name $(VNET) --name nodenet --address-prefix 10.10.0.0/16 -o none
92114

93-
94115
##@ AKS Clusters
95116

96117
byocni-up: swift-byocni-up ## Alias to swift-byocni-up
97118
cilium-up: swift-cilium-up ## Alias to swift-cilium-up
98119
up: swift-up ## Alias to swift-up
99120

100121

101-
nodesubnet-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an NodeSubnet BYO CNI cluster without kube-proxy
122+
nodesubnet-byocni-nokubeproxy-up: rg-up ipv4 overlay-net-up ## Brings up an NodeSubnet BYO CNI cluster without kube-proxy
102123
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
103124
--auto-upgrade-channel $(AUTOUPGRADE) \
104125
--node-os-upgrade-channel $(NODEUPGRADE) \
105126
--kubernetes-version $(K8S_VER) \
106127
--node-count $(NODE_COUNT) \
107128
--node-vm-size $(VM_SIZE) \
108-
--load-balancer-sku standard \
109129
--max-pods 250 \
130+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
110131
--network-plugin none \
111132
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
112133
--os-sku $(OS_SKU) \
@@ -115,14 +136,14 @@ nodesubnet-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an NodeSubne
115136
--yes
116137
@$(MAKE) set-kubeconf
117138

118-
overlay-byocni-up: rg-up overlay-net-up ## Brings up a Linux Overlay BYO CNI cluster
139+
overlay-byocni-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay BYO CNI cluster
119140
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
120141
--auto-upgrade-channel $(AUTOUPGRADE) \
121142
--node-os-upgrade-channel $(NODEUPGRADE) \
122143
--kubernetes-version $(K8S_VER) \
123144
--node-count $(NODE_COUNT) \
124145
--node-vm-size $(VM_SIZE) \
125-
--load-balancer-sku standard \
146+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
126147
--network-plugin none \
127148
--network-plugin-mode overlay \
128149
--pod-cidr 192.168.0.0/16 \
@@ -135,13 +156,14 @@ ifeq ($(OS),windows)
135156
$(MAKE) windows-nodepool-up
136157
endif
137158

138-
overlay-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an Overlay BYO CNI cluster without kube-proxy
159+
overlay-byocni-nokubeproxy-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay BYO CNI cluster without kube-proxy
139160
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
140161
--auto-upgrade-channel $(AUTOUPGRADE) \
141162
--node-os-upgrade-channel $(NODEUPGRADE) \
142163
--kubernetes-version $(K8S_VER) \
143164
--node-count $(NODE_COUNT) \
144165
--node-vm-size $(VM_SIZE) \
166+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
145167
--network-plugin none \
146168
--network-plugin-mode overlay \
147169
--pod-cidr 192.168.0.0/16 \
@@ -151,13 +173,14 @@ overlay-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up an Overlay BYO
151173
--yes
152174
@$(MAKE) set-kubeconf
153175

154-
overlay-cilium-up: rg-up overlay-net-up ## Brings up an Overlay Cilium cluster
176+
overlay-cilium-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay Cilium cluster
155177
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
156178
--auto-upgrade-channel $(AUTOUPGRADE) \
157179
--node-os-upgrade-channel $(NODEUPGRADE) \
158180
--kubernetes-version $(K8S_VER) \
159181
--node-count $(NODE_COUNT) \
160182
--node-vm-size $(VM_SIZE) \
183+
--load-balancer-outbound-ips (PUBLIC_IPv4) \
161184
--network-plugin azure \
162185
--network-dataplane cilium \
163186
--network-plugin-mode overlay \
@@ -167,13 +190,14 @@ overlay-cilium-up: rg-up overlay-net-up ## Brings up an Overlay Cilium cluster
167190
--yes
168191
@$(MAKE) set-kubeconf
169192

170-
overlay-up: rg-up overlay-net-up ## Brings up an Overlay AzCNI cluster
193+
overlay-up: rg-up ipv4 overlay-net-up ## Brings up an Overlay AzCNI cluster
171194
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
172195
--auto-upgrade-channel $(AUTOUPGRADE) \
173196
--node-os-upgrade-channel $(NODEUPGRADE) \
174197
--kubernetes-version $(K8S_VER) \
175198
--node-count $(NODE_COUNT) \
176199
--node-vm-size $(VM_SIZE) \
200+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
177201
--network-plugin azure \
178202
--network-plugin-mode overlay \
179203
--pod-cidr 192.168.0.0/16 \
@@ -182,14 +206,14 @@ overlay-up: rg-up overlay-net-up ## Brings up an Overlay AzCNI cluster
182206
--yes
183207
@$(MAKE) set-kubeconf
184208

185-
swift-byocni-up: rg-up swift-net-up ## Bring up a SWIFT (Podsubnet) BYO CNI cluster
209+
swift-byocni-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT BYO CNI cluster
186210
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
187211
--auto-upgrade-channel $(AUTOUPGRADE) \
188212
--node-os-upgrade-channel $(NODEUPGRADE) \
189213
--kubernetes-version $(K8S_VER) \
190214
--node-count $(NODE_COUNT) \
191215
--node-vm-size $(VM_SIZE) \
192-
--load-balancer-sku standard \
216+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
193217
--network-plugin none \
194218
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
195219
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -201,13 +225,14 @@ ifeq ($(OS),windows)
201225
endif
202226
@$(MAKE) set-kubeconf
203227

204-
swift-byocni-nokubeproxy-up: rg-up swift-net-up ## Bring up a SWIFT (Podsubnet) BYO CNI cluster without kube-proxy
228+
swift-byocni-nokubeproxy-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT BYO CNI cluster without kube-proxy, add managed identity and public ip
205229
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
206230
--auto-upgrade-channel $(AUTOUPGRADE) \
207231
--node-os-upgrade-channel $(NODEUPGRADE) \
208232
--kubernetes-version $(K8S_VER) \
209233
--node-count $(NODE_COUNT) \
210234
--node-vm-size $(VM_SIZE) \
235+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
211236
--network-plugin none \
212237
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
213238
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -217,13 +242,14 @@ swift-byocni-nokubeproxy-up: rg-up swift-net-up ## Bring up a SWIFT (Podsubnet)
217242
--yes
218243
@$(MAKE) set-kubeconf
219244

220-
swift-cilium-up: rg-up swift-net-up ## Bring up a SWIFT Cilium cluster
245+
swift-cilium-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT Cilium cluster
221246
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
222247
--auto-upgrade-channel $(AUTOUPGRADE) \
223248
--node-os-upgrade-channel $(NODEUPGRADE) \
224249
--kubernetes-version $(K8S_VER) \
225250
--node-count $(NODE_COUNT) \
226251
--node-vm-size $(VM_SIZE) \
252+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
227253
--network-plugin azure \
228254
--network-dataplane cilium \
229255
--aks-custom-headers AKSHTTPCustomFeatures=Microsoft.ContainerService/CiliumDataplanePreview \
@@ -233,52 +259,56 @@ swift-cilium-up: rg-up swift-net-up ## Bring up a SWIFT Cilium cluster
233259
--yes
234260
@$(MAKE) set-kubeconf
235261

236-
swift-up: rg-up swift-net-up ## Bring up a SWIFT AzCNI cluster
262+
swift-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT AzCNI cluster
237263
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
238264
--auto-upgrade-channel $(AUTOUPGRADE) \
239265
--node-os-upgrade-channel $(NODEUPGRADE) \
240266
--kubernetes-version $(K8S_VER) \
241267
--node-count $(NODE_COUNT) \
242268
--node-vm-size $(VM_SIZE) \
269+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
243270
--network-plugin azure \
244271
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
245272
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
246273
--no-ssh-key \
247274
--yes
248275
@$(MAKE) set-kubeconf
249276

250-
swiftv2-multitenancy-cluster-up: rg-up
277+
swiftv2-multitenancy-cluster-up: rg-up ipv4
251278
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
252279
--network-plugin azure \
253280
--network-plugin-mode overlay \
254281
--kubernetes-version $(K8S_VER) \
255282
--nodepool-name "mtapool" \
256283
--node-vm-size $(VM_SIZE) \
257284
--node-count 2 \
285+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
258286
--nodepool-tags fastpathenabled=true \
259287
--no-ssh-key \
260288
--yes
261289
@$(MAKE) set-kubeconf
262290

263-
swiftv2-dummy-cluster-up: rg-up swift-net-up ## Bring up a SWIFT AzCNI cluster
291+
swiftv2-dummy-cluster-up: rg-up ipv4 swift-net-up ## Bring up a SWIFT AzCNI cluster
264292
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
265293
--network-plugin azure \
266294
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
267295
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
296+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
268297
--no-ssh-key \
269298
--yes
270299
@$(MAKE) set-kubeconf
271300

272301
# The below Vnet Scale clusters are currently only in private preview and available with Kubernetes 1.28
273302
# These AKS clusters can only be created in a limited subscription listed here:
274303
# https://dev.azure.com/msazure/CloudNativeCompute/_git/aks-rp?path=/resourceprovider/server/microsoft.com/containerservice/flags/network_flags.go&version=GBmaster&line=134&lineEnd=135&lineStartColumn=1&lineEndColumn=1&lineStyle=plain&_a=contents
275-
vnetscale-swift-byocni-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster
304+
vnetscale-swift-byocni-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster
276305
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
277306
--auto-upgrade-channel $(AUTOUPGRADE) \
278307
--node-os-upgrade-channel $(NODEUPGRADE) \
279308
--kubernetes-version $(K8S_VER) \
280309
--node-count $(NODE_COUNT) \
281310
--node-vm-size $(VM_SIZE) \
311+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
282312
--network-plugin none \
283313
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
284314
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -288,13 +318,14 @@ vnetscale-swift-byocni-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale
288318
--yes
289319
@$(MAKE) set-kubeconf
290320

291-
vnetscale-swift-byocni-nokubeproxy-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT (Podsubnet) BYO CNI cluster without kube-proxy
321+
vnetscale-swift-byocni-nokubeproxy-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT BYO CNI cluster without kube-proxy
292322
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
293323
--auto-upgrade-channel $(AUTOUPGRADE) \
294324
--node-os-upgrade-channel $(NODEUPGRADE) \
295325
--kubernetes-version $(K8S_VER) \
296326
--node-count $(NODE_COUNT) \
297327
--node-vm-size $(VM_SIZE) \
328+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
298329
--network-plugin none \
299330
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
300331
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -305,13 +336,14 @@ vnetscale-swift-byocni-nokubeproxy-up: rg-up vnetscale-swift-net-up ## Bring up
305336
--yes
306337
@$(MAKE) set-kubeconf
307338

308-
vnetscale-swift-cilium-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT Cilium cluster
339+
vnetscale-swift-cilium-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT Cilium cluster
309340
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
310341
--auto-upgrade-channel $(AUTOUPGRADE) \
311342
--node-os-upgrade-channel $(NODEUPGRADE) \
312343
--kubernetes-version $(K8S_VER) \
313344
--node-count $(NODE_COUNT) \
314345
--node-vm-size $(VM_SIZE) \
346+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
315347
--network-plugin azure \
316348
--network-dataplane cilium \
317349
--aks-custom-headers AKSHTTPCustomFeatures=Microsoft.ContainerService/CiliumDataplanePreview \
@@ -322,13 +354,14 @@ vnetscale-swift-cilium-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale
322354
--yes
323355
@$(MAKE) set-kubeconf
324356

325-
vnetscale-swift-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT AzCNI cluster
357+
vnetscale-swift-up: rg-up ipv4 vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT AzCNI cluster
326358
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
327359
--auto-upgrade-channel $(AUTOUPGRADE) \
328360
--node-os-upgrade-channel $(NODEUPGRADE) \
329361
--kubernetes-version $(K8S_VER) \
330362
--node-count $(NODE_COUNT) \
331363
--node-vm-size $(VM_SIZE) \
364+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
332365
--network-plugin azure \
333366
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
334367
--pod-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/podnet \
@@ -337,13 +370,14 @@ vnetscale-swift-up: rg-up vnetscale-swift-net-up ## Bring up a Vnet Scale SWIFT
337370
--yes
338371
@$(MAKE) set-kubeconf
339372

340-
cniv1-up: rg-up overlay-net-up ## Bring up a CNIv1 cluster
373+
cniv1-up: rg-up ipv4 overlay-net-up ## Bring up a CNIv1 cluster
341374
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
342375
--auto-upgrade-channel $(AUTOUPGRADE) \
343376
--node-os-upgrade-channel $(NODEUPGRADE) \
344377
--kubernetes-version $(K8S_VER) \
345378
--node-count $(NODE_COUNT) \
346379
--node-vm-size $(VM_SIZE) \
380+
--load-balancer-outbound-ips $(PUBLIC_IPv4) \
347381
--max-pods 250 \
348382
--network-plugin azure \
349383
--vnet-subnet-id /subscriptions/$(SUB)/resourceGroups/$(GROUP)/providers/Microsoft.Network/virtualNetworks/$(VNET)/subnets/nodenet \
@@ -355,13 +389,14 @@ ifeq ($(OS),windows)
355389
$(MAKE) windows-nodepool-up
356390
endif
357391

358-
dualstack-overlay-up: rg-up overlay-net-up ## Brings up an dualstack Overlay cluster with Linux node only
392+
dualstack-overlay-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up an dualstack Overlay cluster with Linux node only
359393
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
360394
--auto-upgrade-channel $(AUTOUPGRADE) \
361395
--node-os-upgrade-channel $(NODEUPGRADE) \
362396
--kubernetes-version $(K8S_VER) \
363397
--node-count $(NODE_COUNT) \
364398
--node-vm-size $(VM_SIZE) \
399+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
365400
--network-plugin azure \
366401
--network-plugin-mode overlay \
367402
--subscription $(SUB) \
@@ -371,13 +406,14 @@ dualstack-overlay-up: rg-up overlay-net-up ## Brings up an dualstack Overlay clu
371406
--yes
372407
@$(MAKE) set-kubeconf
373408

374-
dualstack-overlay-byocni-up: rg-up overlay-net-up ## Brings up an dualstack Overlay BYO CNI cluster
409+
dualstack-overlay-byocni-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up an dualstack Overlay BYO CNI cluster
375410
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
376411
--auto-upgrade-channel $(AUTOUPGRADE) \
377412
--node-os-upgrade-channel $(NODEUPGRADE) \
378413
--kubernetes-version $(K8S_VER) \
379414
--node-count $(NODE_COUNT) \
380415
--node-vm-size $(VM_SIZE) \
416+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
381417
--network-plugin none \
382418
--network-plugin-mode overlay \
383419
--subscription $(SUB) \
@@ -390,13 +426,14 @@ ifeq ($(OS),windows)
390426
$(MAKE) windows-nodepool-up
391427
endif
392428

393-
cilium-dualstack-up: rg-up overlay-net-up ## Brings up a Cilium Dualstack Overlay cluster with Linux node only
429+
cilium-dualstack-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up a Cilium Dualstack Overlay cluster with Linux node only
394430
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
395431
--auto-upgrade-channel $(AUTOUPGRADE) \
396432
--node-os-upgrade-channel $(NODEUPGRADE) \
397433
--kubernetes-version $(K8S_VER) \
398434
--node-count $(NODE_COUNT) \
399435
--node-vm-size $(VM_SIZE) \
436+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
400437
--network-plugin azure \
401438
--network-plugin-mode overlay \
402439
--network-dataplane cilium \
@@ -407,13 +444,14 @@ cilium-dualstack-up: rg-up overlay-net-up ## Brings up a Cilium Dualstack Overla
407444
--yes
408445
@$(MAKE) set-kubeconf
409446

410-
dualstack-byocni-nokubeproxy-up: rg-up overlay-net-up ## Brings up a Dualstack overlay BYOCNI cluster with Linux node only and no kube-proxy
447+
dualstack-byocni-nokubeproxy-up: rg-up ipv4 ipv6 overlay-net-up ## Brings up a Dualstack overlay BYOCNI cluster with Linux node only and no kube-proxy
411448
$(AZCLI) aks create -n $(CLUSTER) -g $(GROUP) -l $(REGION) \
412449
--auto-upgrade-channel $(AUTOUPGRADE) \
413450
--node-os-upgrade-channel $(NODEUPGRADE) \
414451
--kubernetes-version $(K8S_VER) \
415452
--node-count $(NODE_COUNT) \
416453
--node-vm-size $(VM_SIZE) \
454+
--load-balancer-outbound-ips $(PUBLIC_IPv4),$(PUBLIC_IPv6) \
417455
--network-plugin none \
418456
--network-plugin-mode overlay \
419457
--subscription $(SUB) \

0 commit comments

Comments
 (0)