Metropolitan Area Network (MAN) – Technologies, Topologies & Design
1. What Is a MAN?
A Metropolitan Area Network (MAN) is a network that interconnects multiple Local Area Networks (LANs) within a defined metropolitan region — typically a city, cluster of suburbs, or group of buildings spread across a wider area than a single campus. MANs bridge the gap between the small geographic reach of a LAN and the global span of a Wide Area Network (WAN).
Geographically, a MAN typically spans between 5 and 50 kilometres in diameter. The boundary is not rigid — a MAN is defined more by its purpose (connecting city-scale sites) and ownership model than by a precise distance.
Metropolitan Area Network — conceptual view:
┌──────────────────────────────────────────────────────────────┐
│ CITY │
│ │
│ ┌─────────┐ Fiber Ring (MAN) ┌─────────────────────┐ │
│ │ Campus A├──────────────────────── ┤ Campus B │ │
│ │(LAN) │ │ (LAN) │ │
│ └────┬────┘ └──────────┬──────────┘ │
│ │ │ │
│ │ ┌──────────────────┐ │ │
│ └──────────┤ City Hall ├───────────┘ │
│ │ (LAN) │ │
│ └──────────────────┘ │
│ │
│ All sites share the same MAN infrastructure │
│ Managed by city/ISP; connected via fibre or leased links │
└──────────────────────────────────────────────────────────────┘
Related pages: VLANs/LAN | WAN | Fiber vs Copper
2. LAN vs MAN vs WAN — Full Comparison
| Feature | LAN | MAN | WAN |
|---|---|---|---|
| Geographic scope | Room, building, campus — up to ~1 km | City, metro area — 5–50 km | Country, continent, global — 50 km to worldwide |
| Ownership | Single private entity | Single entity or service provider | Carrier/ISP; leased infrastructure |
| Typical speed | 1–10 Gbps (copper); up to 100 Gbps (fibre) | 100 Mbps – 10 Gbps (Metro Ethernet); higher with DWDM | Variable — 1 Mbps to 100 Gbps; latency varies by distance |
| Latency | Sub-millisecond | ~1–10 ms (fibre across city) | 10–100+ ms (national); 100–300+ ms (intercontinental) |
| Key technologies | Ethernet 802.3, Wi-Fi 802.11 | Metro Ethernet, SONET/SDH, MPLS, DWDM, dark fibre | MPLS, BGP, SD-WAN, IPsec VPN, satellite, leased lines |
| Layer 2 or Layer 3 | Primarily Layer 2 (switching) | Layer 2 (Metro Ethernet) or Layer 3 (MPLS/routed) | Primarily Layer 3 (routing) |
| Broadcast domain | Single or per-VLAN | Separate per VLAN/E-LAN service | No broadcast — routed |
| Typical cost | Low — own infrastructure | Medium — fibre lease or ownership; carrier services | High — carrier-provided; per-Mbps pricing |
| Management | Self-managed | Self-managed or carrier-managed | Usually carrier-managed (SLA) |
3. MAN Technologies
Metro Ethernet (MEF / IEEE 802.3)
Metro Ethernet extends familiar Ethernet technology to metro distances. The Metro Ethernet Forum (MEF) defines standardised service types that carriers offer over their fibre infrastructure:
| MEF Service | Also Called | Description | Typical Use |
|---|---|---|---|
| E-Line | Ethernet Private Line (EPL) | Point-to-point Layer 2 circuit between exactly two sites — like a dedicated leased line but using Ethernet framing | Connecting two offices with a private, dedicated Ethernet pipe; replacing TDM leased lines |
| E-LAN | Ethernet Private LAN (EPLAN) | Multipoint-to-multipoint service — all connected sites share a common Ethernet broadcast domain (like a giant virtual switch) | Connecting 5 hospitals in a city so they all appear on the same Layer 2 network; university multi-campus |
| E-Tree | Ethernet Tree | Hub-and-spoke — one root site communicates with multiple leaf sites; leaf sites cannot communicate directly with each other | ISP providing internet access to multiple customers (root = ISP; leaves = customers); FTTH/FTTB architectures |
SONET/SDH — Synchronous Optical Networking
SONET (North America) and SDH (international equivalent) are carrier-grade optical transport standards that have formed the backbone of metro and long-haul networks since the late 1980s. They provide extremely reliable, synchronised, high-capacity transport over fibre with built-in protection switching.
| SONET Level | SDH Equivalent | Bit Rate | Common Name |
|---|---|---|---|
| OC-1 | STM-0 | 51.84 Mbps | Base SONET rate |
| OC-3 | STM-1 | 155.52 Mbps | Legacy metro backbone |
| OC-12 | STM-4 | 622.08 Mbps | Common metro ring |
| OC-48 | STM-16 | 2.488 Gbps | High-capacity metro/regional |
| OC-192 | STM-64 | 9.953 Gbps | Core/backbone |
SONET/SDH rings use Automatic Protection Switching (APS) — if a fibre cut occurs, traffic is rerouted on the backup path of the ring within 50 milliseconds. This carrier-grade resilience is why SONET/SDH remained dominant in critical infrastructure for decades.
MPLS in Metro Networks
MPLS (Multiprotocol Label Switching) is widely used in metro networks by service providers to offer managed Layer 2 and Layer 3 VPN services. MPLS labels allow traffic to be forwarded along pre-determined Label Switched Paths (LSPs) without per-hop IP routing lookups, providing consistent latency and enabling traffic engineering.
- MPLS L2VPN (VPLS): Virtual Private LAN Service — carrier provides a multipoint Ethernet service over MPLS; customers see it as an E-LAN service
- MPLS L3VPN: Carrier routes between customer sites; customer gets a fully routed VPN with route separation per customer (VRF)
- Traffic engineering (MPLS-TE): Routes can be explicitly steered around congestion or failures, unlike hop-by-hop IP routing
DWDM — Dense Wavelength Division Multiplexing
DWDM dramatically multiplies the capacity of a single fibre pair by transmitting dozens or hundreds of independent optical wavelengths (channels) simultaneously. Each wavelength is effectively a separate high-speed circuit.
- A single fibre pair with 96 DWDM channels at 100 Gbps each = 9.6 Tbps of capacity
- Used in metro core rings and inter-city links where raw capacity is the priority
- Enables spectrum leasing — a carrier can lease individual wavelengths to customers (Wavelength Services)
Dark Fibre
Dark fibre refers to installed but unused (unlit) fibre optic cable that an organisation leases or purchases from a carrier or city authority. The lessee provides their own optical transceivers and networking equipment at each end — effectively owning the network layer while leasing the physical medium.
- Advantage: Complete control over capacity, protocol, and upgrades; no per-Mbps carrier pricing; can run DWDM for massive capacity
- Disadvantage: Requires significant technical expertise; responsible for all equipment and maintenance; higher upfront cost
- Common users: Large universities, city governments, data centre operators, financial institutions
4. MAN Topologies
The choice of topology for a MAN directly impacts redundancy, cost, and how quickly the network recovers from a fibre cut or node failure.
Ring Topology (Most Common for MANs)
Dual-fibre ring:
Site A
/ \
Site E -- -- Site B
\ /
Site D --- Site C
Normal: Traffic flows clockwise (primary ring)
Failure: Fibre cut between A and B
↓
APS (50ms): Traffic reroutes counter-clockwise via E→D→C→B
All sites remain connected; no manual intervention required
- Each site connects to two neighbours — provides one path of redundancy
- SONET/SDH rings use APS protection switching — 50 ms recovery
- Metro Ethernet rings use Spanning Tree (STP/RSTP) or G.8032 Ethernet Ring Protection Switching (ERPS) for faster failover
- Most common MAN topology — balances redundancy, cost, and simplicity
Mesh Topology
Partial mesh — each site has 2+ diverse paths:
Site A ------- Site B
| \ / |
| Site E |
| / \ |
Site C ------- Site D
Multiple diverse fibre paths between all sites
Any single (or multiple) link failures: traffic reroutes automatically
- Highest redundancy — can survive multiple simultaneous failures
- Highest cost — requires more fibre and more CPE ports
- MPLS-TE or dynamic routing (OSPF/IS-IS) manages path selection
- Used in critical infrastructure: financial networks, emergency services, data centre interconnects
Star (Hub-and-Spoke) Topology
Hub (central site — e.g., data centre):
Site A
/
Hub ------- Site B
\
Site C
All traffic between sites flows through Hub.
Single point of failure: if Hub fails, ALL sites lose connectivity.
- Simplest to design and operate
- Lowest redundancy — hub is a single point of failure; each spoke has only one path
- Often improved with dual-homed spokes (each spoke connects to two hubs) for resilience
- Common in enterprise WANs and smaller MANs where redundancy is less critical
Hybrid Topology
Most real-world MANs use a hybrid: a redundant ring or mesh at the core (connecting aggregation nodes) with star-connected spokes at the edges (connecting individual sites to the nearest aggregation node).
Real-world hybrid MAN:
Core ring (fibre ring between 3 PoPs):
PoP1 ───── PoP2
│ \ / │
│ PoP3 │
│ │
Access layer (star from each PoP):
PoP1 ─── School A
─── Library B
─── Fire Station C
PoP2 ─── Hospital D
─── City Hall E
PoP3 ─── University F
5. MAN Protocols and Standards
| Protocol/Standard | Layer | Role in MAN | Key Characteristic |
|---|---|---|---|
| IEEE 802.3 (Ethernet) | Layer 2 | Metro Ethernet framing — the same Ethernet frames used in LANs extended across metro distances | Uses 802.1Q VLAN tags and 802.1ad Q-in-Q (double tagging) to separate customer traffic on shared infrastructure |
| 802.1Q VLAN Tagging | Layer 2 | Tags Ethernet frames with a 12-bit VLAN ID — separates customer VLANs over shared Metro Ethernet links | See VLAN Tagging for full details |
| 802.1ad (Q-in-Q) | Layer 2 | Double-tags Ethernet frames — carrier's S-VLAN wraps the customer's C-VLAN; allows multiple customers each to use their own full 4096 VLAN space on the same metro infrastructure | Outer tag = Service Provider VLAN (S-tag); Inner tag = Customer VLAN (C-tag) |
| SONET/SDH | Layer 1 | Synchronised optical transport; encapsulates Ethernet, ATM, and TDM payloads for transport over fibre rings | 50ms APS ring protection; carrier-grade 99.999% availability |
| MPLS | Layer 2.5 | Label-based forwarding for L2VPN (VPLS) and L3VPN services; traffic engineering; fast reroute (FRR) | Labels inserted between Layer 2 and Layer 3 headers; enables per-customer traffic separation without per-hop routing |
| G.8032 ERPS | Layer 2 | Ethernet Ring Protection Switching — purpose-built Ethernet ring protection standard; faster than STP for ring topologies | Sub-50ms failover on Ethernet rings; no STP convergence delays |
| OSPF / IS-IS | Layer 3 | Link-state routing protocols used in routed MAN cores; fast convergence after failures | See OSPF Configuration for full details |
6. Q-in-Q (Double Tagging) — How Carriers Serve Multiple Customers
When a carrier provides Metro Ethernet to multiple customers, each customer may use the same VLAN IDs internally (e.g., every customer has a VLAN 10 for data). Q-in-Q (IEEE 802.1ad) solves the collision problem by adding a second outer VLAN tag at the customer-facing port of the carrier equipment.
Customer A sends: [Ethernet | C-VLAN 10 tag | IP payload]
↑ Customer tag (C-tag)
At carrier ingress port:
Carrier adds outer S-tag:
[Ethernet | S-VLAN 100 tag | C-VLAN 10 tag | IP payload]
↑ Service tag ↑ Customer tag preserved inside
Customer B also uses VLAN 10 but gets S-VLAN 200:
[Ethernet | S-VLAN 200 tag | C-VLAN 10 tag | IP payload]
On carrier metro ring:
Carrier switches only on S-tag (100 or 200)
Customer's C-tags (including VLAN 10) are transparent to carrier
Both customers get full 4096-VLAN space without collision
7. MAN Use Cases and Real-World Applications
| Sector | MAN Application | Technology Used | Benefit |
|---|---|---|---|
| University | Connecting 4–6 dispersed campuses across a city to a central data centre and internet exchange | Dark fibre or Metro Ethernet E-LAN; OSPF routing | Single IP addressing plan; shared services (DHCP, DNS, AD); seamless Wi-Fi roaming between campuses |
| City Government | Connecting city hall, courts, police stations, fire stations, libraries, and schools | SONET ring or Metro Ethernet ring; MPLS L3VPN per department | Traffic isolation between departments (police vs schools); centralised internet and security inspection; VoIP across all sites |
| Healthcare | Connecting hospitals, clinics, and GP surgeries for real-time sharing of medical imaging (DICOM) and electronic health records | Dark fibre ring; 10 Gbps Metro Ethernet | Low latency for radiology image transfer; single patient record system; telehealth between sites |
| Smart City / IoT | Traffic management sensors, CCTV, smart street lighting, air quality monitoring, public Wi-Fi infrastructure | Metro Ethernet + 5G small cells; SDN for programmable control | Centralised traffic control; real-time incident response; data aggregation for city analytics |
| ISP / Carrier | Providing business broadband, Ethernet services (E-Line), and FTTH/FTTB to residential and commercial customers | GPON / XGS-PON fibre access; MPLS metro core; DWDM backbone | Scalable last-mile delivery; centralised subscriber management; QoS enforcement per customer |
| Financial / Trading | Ultra-low-latency connectivity between exchanges, data centres, and trading firms within a financial district | Dark fibre; specialised low-latency optical switches | Sub-microsecond latency for high-frequency trading algorithms; dedicated capacity; no shared congestion |
8. Design Considerations for MANs
| Factor | Requirement | Design Approach |
|---|---|---|
| Bandwidth | Must support the aggregate traffic from all connected LANs — including future growth | Use DWDM or high-speed fibre uplinks; over-provision by 2–3× expected peak; monitor utilisation trends |
| Latency | Critical for real-time applications: VoIP (<150ms one-way), video conferencing, trading (<1ms) | Minimise fibre path length; use direct fibre rather than routed paths; implement QoS to prioritise real-time traffic; see NTP Synchronisation for timing |
| Redundancy | Failure of any single link or node must not isolate a site | Ring or partial mesh topology; SONET APS or G.8032 ERPS; dual-homed sites; diverse physical paths (different ducts/routes) |
| Scalability | Adding new sites and increasing speeds without redesigning the network | DWDM allows wavelength-by-wavelength capacity addition; MPLS enables adding new VPNs without physical changes |
| Security | Traffic between sites must be protected from eavesdropping and tampering; different customer/department traffic must be isolated | MPLS VRF isolation; 802.1Q/Q-in-Q VLAN separation; IPsec encryption over untrusted segments (see IPsec Basics); IDS/IPS monitoring |
| QoS | Voice, video, and critical data must be prioritised over bulk transfers | DSCP marking at LAN edge; MPLS EXP (TC) bits for traffic class in metro core; strict priority queuing for voice/video traffic classes |
| Management | Centralised visibility and control across all MAN nodes | SNMP (see SNMP/Syslog); Syslog centralisation (see Syslog Configuration Lab); NetFlow for traffic analysis (see NetFlow Configuration Lab) |
9. Security in MANs
A MAN carries traffic between sites over infrastructure that may traverse public rights-of-way, carrier exchange points, and shared physical plant. Security is therefore a primary concern, not an afterthought.
| Threat | Description | Mitigation |
|---|---|---|
| Physical fibre tap | An attacker bends or splices the fibre to passively intercept optical signals | Optical power monitoring (OTDR/power meters detect tap-induced loss); Layer 2 encryption (MACsec — IEEE 802.1AE) on metro links; IPsec for Layer 3 encryption |
| VLAN hopping | Attacker injects double-tagged frames to access a VLAN they should not reach | Configure explicit allowed VLANs on all trunk ports; disable DTP auto-negotiation; use native VLAN other than VLAN 1 |
| Customer traffic leakage | Misconfiguration allows one customer's traffic to reach another's VLAN on shared metro infrastructure | Q-in-Q double tagging isolates customer VLANs; MPLS VRF provides Layer 3 isolation; rigorous change management |
| DoS / DDoS | Flood of traffic targeting a site or the metro core exhausts bandwidth or CPU | Traffic policing at ingress; scrubbing centres; RTBH (Remotely Triggered Black Hole) routing; rate-limiting at CE ports |
| Unauthorised access | Rogue devices connected to metro access ports | IEEE 802.1X port authentication (see 802.1X Port Authentication); MAC address filtering; physical security of CPE and distribution points |
10. Emerging Trends in MANs
5G Wireless Backhaul
5G is increasingly used as a wireless alternative to fibre for MAN backhaul — particularly useful for connecting sites where trenching fibre is expensive or impractical (historic buildings, temporary sites, rapid expansion). 5G NR mmWave links can deliver multi-gigabit wireless connections over distances of hundreds of metres to a few kilometres. For longer links, licensed microwave and millimetre-wave point-to-point radios (40–80 GHz bands) provide fibre-equivalent capacity over 1–10 km.
- 5G FWA (Fixed Wireless Access): Provides last-mile connectivity to buildings using 5G mmWave or sub-6 GHz — an ISP alternative to running a physical fibre to every building
- 5G small cells as MAN nodes: Dense urban 5G deployments use metro fibre as the transport network connecting hundreds of small cells back to the core
SDN in Metro Networks
Software-Defined Networking (SDN) separates the control plane (deciding where traffic goes) from the data plane (forwarding traffic), moving control to a centralised software controller. In MANs this enables:
- Rapid provisioning of new circuits and VLANs without touching individual devices
- Dynamic traffic engineering — reroute traffic away from congested paths in real time
- Programmable APIs for automated network management (NetConf, RESTCONF, YANG) — see Northbound and Southbound APIs
- Network slicing — create multiple virtual MANs on the same physical infrastructure, each with guaranteed bandwidth and isolation (critical for 5G core)
FTTH / FTTB — Fibre to the Home/Building
Modern MAN deployments increasingly use GPON (Gigabit Passive Optical Network) and XGS-PON to deliver multi-gigabit fibre connectivity directly to homes and buildings, replacing copper DSL entirely. PON uses a single fibre strand from the OLT (Optical Line Terminal at the ISP) that splits passively to serve up to 128 ONTs (Optical Network Terminals at the customer). These PON access trees connect to the metro Ethernet/MPLS core.
11. Challenges in MAN Deployment
| Challenge | Detail | How It Is Addressed |
|---|---|---|
| Physical infrastructure cost | Trenching, conduit, fibre installation through urban streets is very expensive — often £100–500 per metre for urban civil works | Dark fibre leasing from existing carriers; shared infrastructure with utilities; micro-trenching and micro-duct systems; aerial fibre on utility poles |
| Rights-of-way and permits | Running cables beneath streets requires permits from city councils, transport authorities, and utility companies; multi-party coordination can take months or years | Early stakeholder engagement; use of existing utility corridors; working with carriers who already have route licences |
| Regulatory compliance | Public networks may require Ofcom (UK), FCC (US), or other national regulator licences; data protection regulations (GDPR) apply to traffic traversing city infrastructure | Legal review before deployment; carrier-grade equipment that meets regulatory standards; encryption for GDPR-sensitive data |
| Multi-vendor interoperability | MAN equipment from different vendors must interoperate — proprietary protocols can create integration problems | Use open standards (MEF, IEEE 802.3, MPLS RFC); test interoperability in lab before deployment; leverage SDN for abstraction |
| Fibre cuts and physical damage | Urban construction, accidents, and vandalism regularly cut underground fibre — metro networks must survive these events | Redundant ring or mesh topology; physically diverse routes (different streets/conduits); rapid repair SLAs with carriers; aerial fibre as temporary bypass |
12. Hybrid Network Architecture — LAN + MAN + WAN
Large organisations rarely rely on a single network type. The layered model combines all three: LAN at each site, MAN connecting city-wide sites, and WAN connecting cities and countries.
Layered network architecture:
Workstations / Servers
│
┌──────┴──────┐
│ LAN │ ← Ethernet switches, Wi-Fi APs, VLANs within each building
│ (site) │
└──────┬──────┘
│
┌──────┴──────────────────────────────┐
│ MAN │ ← Metro Ethernet ring connecting all city sites
│ Hospital A ─ Hospital B ─ Hospital C│
│ Clinic D ─ Clinic E │
└──────┬──────────────────────────────┘
│
┌──────┴──────┐
│ WAN │ ← MPLS or SD-WAN connecting cities / countries / cloud
│ (national) │
└─────────────┘
See also:
• LAN: lan.html
• WAN: wan.html
• MPLS fundamentals: StepbyStepTut/mpls-fundamentals.html
• SD-WAN: StepbyStepTut/cisco-sdwan-viptela-overview.html
Related tutorials: MPLS Fundamentals | Cisco SD-WAN / Viptela Overview | GRE Tunnel Configuration | Site-to-Site IPsec VPN
13. MAN vs WAN — Detailed Comparison
| Dimension | MAN | WAN |
|---|---|---|
| Geographic scope | City / metropolitan area (5–50 km) | Regional / national / global (50 km to worldwide) |
| Latency | 1–10 ms (fibre propagation across city) | 10–300+ ms (depends on distance and routing) |
| Bandwidth | 100 Mbps – 10 Gbps typical; Tbps with DWDM | Variable — carrier-determined; per-Mbps billing common |
| Layer | Often Layer 2 (Metro Ethernet) or Layer 2.5 (MPLS) | Primarily Layer 3 (IP routing, BGP) |
| Ownership | Can be privately owned (dark fibre) or carrier-provided | Always carrier-provided; leased circuits or internet transit |
| Resilience | Ring topology with APS/ERPS gives 50ms failover | BGP convergence typically seconds to minutes after failure |
| Security model | VLAN separation, Q-in-Q, MACsec, or IPsec | IPsec VPN, MPLS L3VPN, or SD-WAN encryption |
| Broadcast | Possible at Layer 2 (Metro Ethernet E-LAN) — controlled by VLANs | No broadcasts — routed network; each site is a separate subnet |
14. Key Points & Exam Tips
- MAN = metropolitan area network; spans a city (5–50 km); larger than LAN, smaller than WAN; owned by single entity or carrier.
- Primary MAN technologies: Metro Ethernet (E-Line point-to-point, E-LAN multipoint, E-Tree hub-and-spoke), SONET/SDH (carrier-grade optical rings, 50ms APS protection), MPLS (L2VPN/L3VPN over metro core), DWDM (multi-Tbps capacity on single fibre pair), dark fibre (leased unlit fibre).
- Ring topology = most common MAN choice — each site connects to two neighbours; single fibre cut reroutes in 50ms (APS) or with G.8032 ERPS.
- Q-in-Q (802.1ad) = double VLAN tagging — Service Provider S-tag wraps Customer C-tag; allows multiple customers to use full VLAN space on shared metro infrastructure.
- SONET ring speeds: OC-3=155Mbps, OC-12=622Mbps, OC-48=2.5Gbps, OC-192=10Gbps.
- MPLS in MAN: VPLS = Layer 2 multipoint service; L3VPN = routed VPN with VRF per customer; TE = traffic engineering.
- Emerging trends: 5G wireless backhaul (replaces fibre where trenching is impractical); SDN (centralised programmable control, rapid service provisioning, northbound/southbound APIs); GPON/XGS-PON for FTTH/FTTB.
- MAN challenges: fibre installation cost, rights-of-way permits, regulatory compliance, physical fibre cuts.
- MAN security: VLAN isolation, Q-in-Q separation, IPsec or MACsec encryption, 802.1X port authentication, OTDR monitoring for fibre taps.
- Hybrid architecture: LAN (site) → MAN (city) → WAN (national/global) — each layer uses appropriate technology for its scale.
Related pages: VLANs/LAN | WAN | Fiber vs Copper | VLAN Tagging | IPsec Basics | MPLS Fundamentals