PacketLab
VXLAN · Overlay foundations

Data Center Fabric Evolution

Compare bridged redundancy, Layer 2 fabrics and routed leaf–spine transport before choosing the overlay design.

From a hierarchy to a fabric

Access, aggregation and core roles organize a traditional data-center hierarchy. A server-to-server flow crossing access blocks may travel through several aggregation stages. A leaf–spine fabric instead connects each leaf to every spine in its fabric: hosts attach to leaves and spines provide transit. The common different-leaf path is leaf → spine → leaf, with one transit spine, not a promise that every possible fabric has only two IP hops.

Two leaves, two routed transit choicesIllustrative topology
Two spine switches each connect by physical routed links to both leaf switches, with hosts below the leaves.
Solid lines are physical links. Crossed paths are separate cables, not junctions. Each leaf has a routed path through either spine; host-facing access links are separate.

Bridged redundancy and spanning tree

A bridged topology can loop frames because Ethernet has no IP-style hop limit. Spanning tree selects a loop-free active topology; a redundant physical path may be blocked for an instance. RSTP improves the transition process and MSTP groups VLANs into instances. Different instances can use different links, but that does not make every path active for one instance.

STP is still useful on access networks. A routed fabric changes the transit forwarding model rather than proving that no loop protection is needed anywhere. Broadcast containment, storm control and endpoint attachment remain operational concerns.

Use more links without building a new overlay

ApproachWhat it combinesBoundary
Link aggregationParallel links between compatible logical endpointsA flow hash usually selects one member; one flow does not gain the sum of all member speeds.
Chassis virtualizationPhysical devices with a coordinated logical-switch viewControl-plane and failure behavior depend on the implementation.
Multi-chassis aggregationA LAG attached across cooperating devicesPeer consistency and split-brain handling are critical; it does not remove all VLAN or flooding limits.

These approaches improve access redundancy and bandwidth. They do not by themselves provide a 24-bit tenant identifier or transform a bridged core into an IP underlay.

Layer 2 fabrics: a different forwarding model

TechnologyConceptual direction
TRILLLink-state routing with RBridge encapsulation and a hop count for Ethernet transport.
FabricPathA platform-specific routed Layer 2 fabric architecture.
Shortest Path BridgingIEEE link-state Ethernet bridging, including MAC-in-MAC service models.

These are distinct technologies, not different names for VXLAN. Deployment footprint and support vary. Treat older fabrics as architecture context and verify the actual platform lifecycle rather than assuming every implementation has disappeared.

IP fabric with an edge overlay

One Ethernet segment across an IP fabricIllustrative topology
H1 connects to VTEP1, two routed underlay paths connect VTEP1 to VTEP2, and VTEP2 connects to H2. A dashed arc denotes the logical VNI 5012 overlay.
Solid lines: physical links. Dashed blue arc: logical VXLAN overlay, not another cable. H1 and H2 share the example tenant subnet; transit devices forward outer IP packets.

Move transport reachability to routed links, then terminate tenant services at the edges. Transit routers need routes to VTEP addresses; they do not need every tenant MAC. VXLAN supplies the Ethernet-in-UDP data plane. An IP underlay can use ECMP when routes and platform support permit it, while the overlay preserves a chosen tenant segment.

Adding a leaf adds endpoint capacity and consumes spine ports. Adding a spine can add aggregate transport capacity, subject to link speeds, radix and cabling. Oversubscription still depends on host-facing demand versus uplink capacity; a leaf–spine drawing alone proves no throughput guarantee.

Learning and EVPN are separate choices

Flood-and-learn VXLAN learns endpoint locations from traffic and needs BUM replication, historically using multicast and also implementable with ingress replication. EVPN can advertise MAC/IP reachability through BGP and add mobility and multihoming procedures. EVPN does not eliminate every broadcast or unknown destination, so replication policy still matters.

The implementation lessons follow this progression: static ingress replication, multicast learning, EVPN Layer 2, then routed tenant services and ARP suppression. Underlay protocol examples follow as separate deployments. This introduction does not require a specific platform configuration.

Choose by evidence, not only by diagram

CheckUseful evidence
RedundancyWithdraw one path and inspect actual convergence and loss.
CapacityCompare uplink and server demand; test the forwarding hash with multiple flows.
IsolationVerify tenant/segment membership and unwanted reachability tests.
OperationsTrace access frame → overlay lookup → routed transport → remote delivery.

Record platform support, software release, failure domain and recovery procedure before deployment. All topologies and forwarding descriptions here are illustrative architecture examples, not measured throughput or recovery results.

Further reading

Key Takeaways

  • A leaf–spine fabric offers predictable transit choices between leaves.
  • Spanning tree, LAG and multi-chassis aggregation solve different redundancy problems.
  • TRILL, FabricPath and SPB are distinct Layer 2 fabric approaches.
  • VXLAN places tenant service at edges while routed transit carries VTEP packets.
  • EVPN distributes reachability but does not remove the need to plan BUM handling.

Data Center Fabric Evolution Quiz

Six questions · four options each · select one answer per question. Submit all answers to see your score and explanations.

1. In a conventional two-tier leaf–spine fabric, where do servers normally attach?
2. Does one flow always use the sum of all LAG member speeds?
3. Which problem does spanning tree address?
4. Are TRILL and VXLAN the same encapsulation?
5. Does an EVPN fabric eliminate all BUM traffic?
6. What proves the behavior of a redundant transport path?