This text describes the most effective practices for connectivity, visitors flows, and excessive availability of dual-region Azure VMware Answer when utilizing Azure Safe Digital WAN with Routing Intent. You be taught the design particulars of utilizing Safe Digital WAN with Routing-Intent, with out World Attain. This text breaks down Digital WAN with Routing Intent topology from the angle of Azure VMware Answer personal clouds, on-premises websites, and Azure native. The implementation and configuration of Safe Digital WAN with Routing Intent are past the scope and are not mentioned on this doc.
In areas with out World Attain help or with a safety requirement to examine visitors between Azure VMware Answer and on-premises on the hub firewall, a help ticket have to be opened to allow ExpressRoute to ExpressRoute transitivity for each regional hubs. ExpressRoute to ExpressRoute transitivity is not supported by default with Digital WAN. – see Transit connectivity between ExpressRoute circuits with routing intent
Safe Digital WAN with Routing Intent is simply supported with Digital WAN Commonplace SKU. Safe Digital WAN with Routing Intent supplies the aptitude to ship all Web visitors and Personal community visitors to a safety resolution like Azure Firewall, a third-party Community Digital Equipment (NVA), or SaaS resolution. Within the situation, now we have a community topology that spans two areas. There’s one Digital WAN with two Hubs, Hub1 and Hub2. Hub1 is in Area 1, and Hub2 is in Area 2. Every Hub has its personal occasion of Azure Firewall deployed(Hub 1 Firewall, Hub 2 Firewall), primarily making them every Safe Digital WAN Hubs. Having Safe Digital WAN hubs is a technical prerequisite to Routing Intent. Safe Digital WAN Hub1 and Hub2 have Routing Intent enabled.
Every area additionally has an Azure VMware Answer Personal Cloud and an Azure Digital Community. There’s additionally an on-premises web site connecting to each areas, which we evaluation in additional element later on this doc.
Observe
For those who’re utilizing non-RFC1918 prefixes in your linked on-premises, Digital Networks or Azure VMware Answer, be sure to have specified these prefixes within the “Personal Visitors Prefixes” textual content field for Routing Intent. Take into account that you need to all the time enter summarized routes solely within the “Personal Visitors Prefixes” part to cowl your vary. Don’t enter the precise vary that’s being marketed to Digital WAN as this will result in routing points. For instance, if the ExpressRoute Circuit is promoting 40.0.0.0/24 from on-premises, put a /23 CIDR vary or bigger within the Personal Visitors Prefix textual content field (instance: 40.0.0.0/23). – see Configure routing intent and insurance policies by Digital WAN portal
Observe
When configuring Azure VMware Answer with Safe Digital WAN Hubs, guarantee optimum routing outcomes on the hub by setting the Hub Routing Choice choice to “AS Path.” – see Digital hub routing desire
Understanding Topology Connectivity
Connection | Description |
---|---|
Connections (D) | Azure VMware Answer personal cloud connection to its native regional hub. |
Connections (E) | on-premises connectivity by way of ExpressRoute to each regional hubs. |
Inter-Hub | Inter-Hub logical connection between two hubs which are deployed underneath the identical Digital WAN. |
The next sections cowl visitors flows and connectivity for Azure VMware Answer, on-premises, Azure Digital Networks, and the Web.
This part focuses on solely the Azure VMware Answer personal clouds in each areas. Every Azure VMware Answer personal cloud has an ExpressRoute connection to the hub (connections labeled as “D”).
With ExpressRoute to ExpressRoute transitivity enabled on the Safe Hub and Routing-Intent enabled, the Safe Hub sends the default RFC 1918 addresses (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) to each Azure VMware Answer personal clouds over connection “D”. Along with the default RFC 1918 addresses, each Azure VMware Answer personal clouds be taught extra particular routes from Azure Digital Networks and Networks (S2S VPN, P2S VPN, SDWAN) which are linked to each Hub 1 and Hub 2. Each Azure VMware Answer personal clouds do not be taught particular routes from on-premises networks. For routing visitors again to on-premises networks, it makes use of the default RFC 1918 addresses that it realized by way of connection “D” from its native regional hub. This visitors transits by the native regional Hub firewall, as proven within the diagram. The Hub firewall has the precise routes for on-premises networks and routes visitors towards the vacation spot over connection “E”. Visitors from each Azure VMware Answer personal clouds, heading in direction of Digital Networks, will transit the Hub firewall. For extra info, see the visitors move part.
The diagram illustrates visitors flows from the angle of the Azure VMware Answer Personal Cloud Area 1 and Azure VMware Answer Personal Cloud Area 2.
Visitors Circulation Chart
Visitors Circulation Quantity | Supply | Route | Vacation spot | Visitors Inspected on Safe Digital WAN Hub firewall? |
---|---|---|---|---|
1 | Azure VMware Answer Cloud Area 1 | → | Digital Community 1 | Sure, visitors is inspected on the Hub 1 firewall |
2 | Azure VMware Answer Cloud Area 1 | → | On-premises | Sure, visitors is inspected on the Hub 1 firewall |
3 | Azure VMware Answer Cloud Area 1 | → | Digital Community 2 | Sure, visitors is inspected on the Hub 1 firewall, then Hub 2 firewall. |
4 | Azure VMware Answer Cloud Area 1 | → | Azure VMware Answer Cloud Area 2 | Sure, visitors is inspected on the Hub 1 firewall, then Hub 2 firewall. |
5 | Azure VMware Answer Cloud Area 2 | → | Digital Community 1 | Sure, visitors is inspected on the Hub 2 firewall, then Hub 1 firewall. |
6 | Azure VMware Answer Cloud Area 2 | → | Digital Community 2 | Sure, visitors is inspected on the Hub 2 firewall. |
7 | Azure VMware Answer Cloud Area 2 | → | On-premises | Sure, visitors is inspected on the Hub 2 firewall. |
This part focuses solely on the on-premises web site. As proven within the diagram, the on-premises web site has an ExpressRoute connection to each Hub 1 and Hub 2 (connection labeled as “E”).
With ExpressRoute to ExpressRoute transitivity enabled on each Safe Hubs and Routing-Intent enabled, every Safe Hub sends the default RFC 1918 addresses (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) to on-premises over connection “E”. Along with the default RFC 1918 addresses, on-premises learns extra particular routes from Azure Digital Networks and Department Networks (S2S VPN, P2S VPN, SDWAN) which are linked to each Hub 1 and Hub 2.
By default, on-premises doesn’t be taught the precise routes for each Azure VMware Answer Personal Clouds. As an alternative, it routes to each Azure VMware Answer Personal Clouds utilizing the default RFC 1918 addresses it learns over connection “E”. On-premises will be taught the default RFC 1918 addresses from each Hub 1 and Hub 2 by way of connection “E”.
Observe
It’s extraordinarily essential so as to add particular routes on each hubs. For those who don’t add particular routes on the hubs, it results in suboptimal routing as a result of on-premises makes use of Equal Price multi-path (ECMP) between the “E” connections for visitors destined to any Azure VMware Answer Personal Cloud. In consequence, visitors between on-premises and any Azure VMware Answer Personal Cloud could expertise latency, efficiency points, or packet drops.
To promote a extra particular route right down to on-premises, it must be achieved from the “Personal Visitors Prefixes” field inside Routing Intent. – see Configure routing intent and insurance policies by Digital WAN portal. You’ll want to add a summarized route that encompasses each your Azure VMware Answer /22 block and your Azure VMware Answer subnets. For those who add the identical actual prefix or a extra particular prefix as a substitute of a abstract route, you introduce routing points inside the Azure atmosphere. Due to this fact, it’s essential to keep in mind that any prefixes added to the “Personal Visitors Prefixes” field have to be summarized routes.
As illustrated within the diagram, Azure VMware Answer Personal Cloud 1 consists of workload subnets from 10.10.0.0/24 to 10.10.7.0/24. On Hub 1, the abstract route 10.10.0.0/21 is added to “Personal Visitors Prefixes” as a result of it encompasses all eight subnets. Moreover, on Hub 1, the abstract route 10.150.0.0/22 is added to “Personal Visitors Prefixes” to cowl the Azure VMware Answer administration block. Abstract routes 10.10.0.0/21 and 10.150.0.0/22 are then marketed right down to on-premises by way of connection “E”, offering on-premises with a extra particular route than 10.0.0.0/8.
Azure VMware Answer Personal Cloud 2 consists of workload subnets from 10.20.0.0/24 to 10.20.7.0/24. On Hub 2, the abstract route 10.20.0.0/21 is added to “Personal Visitors Prefixes” as a result of it encompasses all eight subnets. Moreover, on Hub 2, the abstract route 10.250.0.0/22 is added to “Personal Visitors Prefixes.” This covers the Azure VMware Answer administration block. Abstract routes 10.20.0.0/21 and 10.250.0.0/22 are then marketed right down to on-premises by way of connection “E.” This supplies on-premises with a extra particular route than 10.0.0.0/8.
There’s no subject in including the complete Azure VMware Answer Administration /22 block underneath “Personal Visitors Prefixes” as a result of Azure VMware Answer doesn’t promote the precise /22 block again to Azure; it all the time advertises extra particular routes.
As talked about earlier, while you allow ExpressRoute to ExpressRoute transitivity on the Hub, it sends the default RFC 1918 addresses (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) to your on-premises community. Due to this fact, you should not promote the precise RFC 1918 prefixes (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) again to Azure. Promoting the identical actual routes creates routing issues inside Azure. As an alternative, you need to promote extra particular routes again to Azure to your on-premises networks.
Observe
For those who’re at the moment promoting the default RFC 1918 addresses from on-premises to Azure and want to proceed this apply, it’s essential to cut up every RFC 1918 vary into two equal sub-ranges and promote these sub-ranges again to Azure. The sub-ranges are 10.0.0.0/9, 10.128.0.0/9, 172.16.0.0/13, 172.24.0.0/13, 192.168.0.0/17, and 192.168.128.0/17.
The diagram illustrates visitors flows from the angle of on-premises.
Visitors Circulation Chart
Visitors Circulation Quantity | Supply | Route | Vacation spot | Visitors Inspected on Safe Digital WAN Hub firewall? |
---|---|---|---|---|
2 | on-premises | → | Azure VMware Answer Cloud Area 1 | Sure, visitors is inspected on the Hub 1 firewall |
7 | on-premises | → | Azure VMware Answer Cloud Area 2 | Sure, visitors is inspected on the Hub 2 firewall |
8 | on-premises | → | Digital Community 1 | Sure, visitors is inspected on the Hub 1 firewall |
9 | on-premises | → | Digital Community 2 | Sure, visitors is inspected on the Hub 2 firewall |
This part focuses solely on connectivity from the Azure Digital Networks perspective. As depicted within the diagram, every Digital Community has a Digital Community peering on to its regional hub.
The diagram illustrates how all Azure native sources in each Digital Networks be taught routes underneath their “Efficient Routes”. With Routing Intent enabled, Hub 1 and Hub 2 all the time ship the default RFC 1918 addresses (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) to their peered Digital Networks. Azure native sources within the Digital Networks don’t be taught particular routes from outdoors their Digital Community. With Routing Intent enabled, all sources within the Digital Community at the moment be taught the default RFC 1918 deal with and use their regional hub firewall as the following hop. Azure VMware Answer Personal Clouds talk with one another by way of connection “D” to their native regional hub firewall. From there, they traverse the Digital WAN inter-hub and bear inspection on the cross-regional hub firewall. Moreover, Azure VMware Answer personal clouds talk with on-premises by way of connection “D” over their native regional hub firewall. All visitors ingressing and egressing the Digital Networks will all the time transit their regional hub firewalls. For extra info, see the visitors move part.
The diagram illustrates visitors flows from the Azure Digital Networks perspective.
Visitors Circulation Chart
Visitors Circulation Quantity | Supply | Route | Vacation spot | Visitors Inspected on Safe Digital WAN Hub firewall? |
---|---|---|---|---|
1 | Digital Community 1 | → | Azure VMware Answer Cloud Area 1 | Sure, visitors is inspected on the Hub 1 firewall |
3 | Digital Community 2 | → | Azure VMware Answer Cloud Area 1 | Sure, visitors is inspected at Hub 2 firewall then Hub firewall 1 |
5 | Digital Community 1 | → | Azure VMware Answer Cloud Area 2 | Sure, visitors is inspected at Hub 1 firewall then Hub firewall 2 |
6 | Digital Community 2 | → | Azure VMware Answer Cloud Area 2 | Sure, visitors is inspected on the Hub 2 firewall |
8 | Digital Community 1 | → | On-premises | Sure, visitors is inspected on the Hub 1 firewall |
9 | Digital Community 2 | → | On-premises | Sure, visitors is inspected on the Hub 2 firewall |
10 | Digital Community 1 | → | Digital Community 2 | Sure, visitors is inspected on the Hub 1 firewall then Hub 2 firewall |
10 | Digital Community 2 | → | Digital Community 1 | Sure, visitors is inspected on the Hub 2 firewall then Hub 1 firewall |
This part focuses solely on how web connectivity is supplied for Azure native sources in Digital Networks and Azure VMware Answer Personal Clouds with twin area. There are a number of choices to offer web connectivity to Azure VMware Answer. – see Web Entry Ideas for Azure VMware Answer
Possibility 1: Web Service hosted in Azure
Possibility 2: VMware Answer Managed SNAT
Possibility 3: Azure Public IPv4 deal with to NSX-T Knowledge Middle Edge
Though you need to use all three choices with Twin Area Safe Digital WAN with Routing Intent, “Possibility 1: Web Service hosted in Azure” is the most suitable choice when utilizing Safe Digital WAN with Routing Intent and is the choice that’s used to offer web connectivity within the situation. The explanation why “Possibility 1” is taken into account the most suitable choice with Safe Digital WAN is because of its ease of safety inspection, deployment, and manageability.
As talked about earlier, while you allow Routing Intent on each Safe Hubs, it advertises RFC 1918 to all immediately peered Digital Networks. Nonetheless, you may also promote a default route 0.0.0.0/0 for web connectivity to downstream sources. With Routing Intent, you’ll be able to select to generate a default route from each hub firewalls. This default route is marketed to its immediately peered Digital Networks and to its immediately linked Azure VMware Answer. This part is damaged into two sections, one which explains web connectivity from each regional Azure VMware Answer perspective and one other from the Digital Networks perspective.
When Routing Intent is enabled for web visitors, the default conduct of the Safe Digital WAN Hub is to not promote the default route throughout ExpressRoute circuits. To make sure the default route is propagated to its immediately linked Azure VMware Answer from the Azure Digital WAN, you have to allow default route propagation in your Azure VMware Answer ExpressRoute circuits – see To promote default route 0.0.0.0/0 to endpoints. As soon as modifications are full, the default route 0.0.0.0/0 is then marketed by way of connection “D” from the hub. It’s essential to notice that this setting should not be enabled for on-premises ExpressRoute circuits. As a finest apply, it’s advisable to implement a BGP Filter in your on-premises gear. A BGP Filter in place prevents the inadvertent studying of the default route, provides an additional layer of precaution, and ensures that on-premises web connectivity is not impacted.
If you allow Routing Intent for web entry, it mechanically generates a default route from each regional hubs and advertises it to their hub-peered Digital Community connections. You will discover underneath Efficient Routes for the Digital Machines’ NICs within the Digital Community that the 0.0.0.0/0 subsequent hop is the regional hub firewall. The default route isn’t marketed throughout regional hubs over the ‘inter-hub’ hyperlink. Due to this fact, Digital Networks use their native regional hub for web entry and don’t have any backup web connectivity to the cross-regional hub.
For extra info, see the visitors move part.
The diagram illustrates visitors flows from the Digital Networks and Azure VMware Answer Personal Clouds perspective.
Visitors Circulation Chart
Visitors Circulation Quantity | Supply | Route | Vacation spot | Visitors Inspected on Safe Digital WAN hub firewall? |
---|---|---|---|---|
11 | Azure VMware Answer Cloud Area 1 | → | Web | Sure, visitors is inspected on the Hub 1 firewall |
12 | Digital Community 2 | → | Web | Sure, visitors is inspected on the Hub 2 firewall |
13 | Digital Community 1 | → | Web | Sure, visitors is inspected on the Hub 1 firewall |
14 | Azure VMware Answer Cloud Area 2 | → | Web | Sure, visitors is inspected on the Hub 2 firewall |
With Azure VMware Answer utilizing the Twin-Area with out World Attain design, you don’t have outbound web connectivity redundancy as a result of every Azure VMware Answer personal cloud learns the default route from each its native regional hub and isn’t immediately linked to its cross-regional hub. If a regional outage that impacts the native regional hub, you could have two choices with a view to obtain web redundancy which are handbook configurations.
Possibility 1: For Outbound Web Entry Solely
Throughout a neighborhood regional outage, if you happen to want outbound web entry to your Azure VMware Answer workload, you’ll be able to go for VMware Answer Managed SNAT. It’s an easy resolution that shortly supplies the entry you want. – see Activate Managed SNAT for Azure VMware Answer workloads
Possibility 2: For Inbound and Outbound Web Entry
Throughout a neighborhood regional outage, if you happen to want each inbound and outbound web entry to your Azure VMware Answer cloud, begin by eradicating the “D” connection to your native regional hub. Take away the Authorization Key created for the “D” connection from the Azure VMware Answer blade within the Azure portal. Then, create a brand new connection to the cross-regional hub. For dealing with inbound visitors, think about using Azure Entrance Door or Visitors Supervisor to take care of regional excessive availability.
HCX Mobility Optimized Networking (MON) is an non-obligatory function to allow when utilizing HCX Community Extensions (NE). Mobility Optimized Networking (MON) supplies optimum visitors routing underneath sure eventualities to forestall community tromboning between the on-premises-based and cloud-based sources on prolonged networks.
Enabling Mobility Optimized Networking (MON) for a particular prolonged community and a digital machine modifications the visitors move. For Mobility Optimized Networking (MON), egress visitors from that digital machine does not trombone again to on-premises. As an alternative, it bypasses the Community Extensions (NE) IPSEC tunnel. Visitors for that digital machine will now egress out of the Azure VMware Answer NSX-T Tier-1 Gateway> NSX-T Tier-0 Gateway>Azure Digital WAN.
Enabling Mobility Optimized Networking (MON) for a particular prolonged community and a digital machine ends in a change. From Azure VMware Answer NSX-T, it injects a /32 host route again to Azure Digital WAN. Azure Digital WAN advertises this /32 route again to on-premises, Digital Networks, and Department Networks (S2S VPN, P2S VPN, SDWAN). The aim of this /32 host route is to make sure that visitors from on-premises, Digital Networks, and Department Networks (S2S VPN, P2S VPN, SDWAN) does not use the Community Extensions (NE) IPSEC tunnel when destined for the Mobility Optimized Networking (MON) enabled Digital Machine. Visitors from supply networks is directed straight to the Mobility Optimized Networking (MON) enabled Digital Machine as a result of /32 route that’s realized.
With ExpressRoute to ExpressRoute transitivity enabled on the Safe Hub and Routing-Intent enabled, the Safe Hub sends the default RFC 1918 addresses (10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16) to each the on-premises and Azure VMware Answer. Along with the default RFC 1918 addresses, each on-premises and Azure VMware Answer be taught extra particular routes from Azure Digital Networks and Department Networks (S2S VPN, P2S VPN, SDWAN) which are linked to the hub. Nonetheless, on-premises networks do not be taught any particular routes from the Azure VMware Answer, nor does the reverse happen. As an alternative, each environments depend on the default RFC 1918 addresses to facilitate routing again to at least one one other by way of their native regional Hub firewall. Because of this extra particular routes, corresponding to HCX Mobility Optimized Networking (MON) Host Routes, aren’t marketed from the Azure VMware Answer ExpressRoute to the on-premises-based ExpressRoute circuit and vice-versa. The lack to be taught particular routes introduces uneven visitors flows. Visitors egresses Azure VMware Answer by way of the NSX-T Tier-0 gateway, however returning visitors from on-premises returns over the Community Extensions (NE) IPSEC tunnel.
To appropriate any visitors asymmetry, it’s essential to alter the HCX Mobility Optimized Networking (MON) Coverage Routes. Mobility Optimized Networking (MON) coverage routes decide which visitors goes again to the on-premises Gateway by way of an L2 extension. Additionally they resolve which visitors is routed by the Azure VMware Answer NSX Tier-0 Gateway.
If a vacation spot IP matches and is ready to “enable” within the Mobility Optimized Networking (MON) coverage configuration, then two actions happen. First, the packet is recognized. Second, its despatched to the on-premises gateway by the HCX Community Extension equipment.
If a vacation spot IP does not match or is ready to “deny” within the Mobility Optimized Networking (MON) coverage, the system sends the packet to the Azure VMware Answer Tier-0 for routing.
HCX Coverage Routes
Community | Redirect to Peer | Observe |
---|---|---|
Azure Digital Community Tackle House | Deny | Please guarantee to explicitly embrace the deal with ranges for all of your Digital Networks. Visitors meant for Azure is directed out by way of the Azure VMware Answer and does not return to the on-premises community. |
Default RFC 1918 Tackle Areas | Permit | Add within the default RFC 1918 addresses 10.0.0.0/8, 172.16.0.0/12, and 192.168.0.0/16. This configuration ensures that any visitors not matching the above standards is rerouted again to the on-premises community. In case your on-premises setup makes use of addresses that are not a part of RFC 1918, you have to explicitly embrace these ranges. |
0.0.0.0/0 | Deny | For addresses that aren’t lined by RFC 1918, corresponding to Web-routable IPs, or any visitors that doesn’t match the desired entries above, exits immediately by the Azure VMware Answer and is not redirected again to the on-premises community. |