211 lines
14 KiB
Markdown
211 lines
14 KiB
Markdown
# ⚡ 10GbE Backbone Network
|
|
|
|
## Overview
|
|
|
|
The Concord primary location features a high-speed 10 Gigabit Ethernet backbone connecting the NAS cluster and primary workstations, enabling fast file transfers, media streaming, and backup operations.
|
|
|
|
---
|
|
|
|
## 🔌 10GbE Topology (Mermaid)
|
|
|
|
```mermaid
|
|
graph LR
|
|
subgraph Internet["☁️ Internet (25Gbps Fiber)"]
|
|
ISP["Sonic Fiber<br/>25Gbps ↑↓"]
|
|
end
|
|
|
|
subgraph Router["🌐 TP-Link Archer BE800"]
|
|
TPLINK["TP-Link Archer BE800<br/>Tri-Band WiFi 7<br/>10G + SFP+ + 4x2.5G"]
|
|
end
|
|
|
|
subgraph Switch["⚡ 10GbE Switch"]
|
|
TLSX["TP-Link TL-SX1008<br/>8-Port 10GbE<br/>Unmanaged Switch"]
|
|
end
|
|
|
|
subgraph HighSpeed["⚡ 10GbE Devices"]
|
|
ATL["🗄️ Atlantis<br/>DS1823xs+<br/>10GbE via E10M20-T1<br/>192.168.0.200"]
|
|
CAL["🗄️ Calypso<br/>DS723+<br/>10GbE via E10G22-T1-Mini<br/>192.168.0.250"]
|
|
GUA["💻 Guava<br/>TrueNAS Scale<br/>Mellanox ConnectX-5<br/>192.168.0.100"]
|
|
DSK["🖥️ Shinku-Ryuu<br/>i7-14700K + RTX 4080<br/>Mellanox ConnectX-5<br/>192.168.0.3"]
|
|
end
|
|
|
|
subgraph GigE["🔌 1GbE / Other Devices"]
|
|
PROX["🖥️ Proxmox<br/>VM Host"]
|
|
PI_V["📡 RPi 5 Vish"]
|
|
GL_MT["📡 GL-MT3000<br/>HA Router"]
|
|
GL_BE["📡 GL-BE3600<br/>Exit Node Router"]
|
|
end
|
|
|
|
ISP -->|"25Gbps"| TPLINK
|
|
TPLINK -->|"10GbE"| TLSX
|
|
|
|
TLSX -->|"10GbE"| ATL
|
|
TLSX -->|"10GbE"| CAL
|
|
TLSX -->|"10GbE"| GUA
|
|
TLSX -->|"10GbE"| DSK
|
|
|
|
TPLINK -->|"1GbE"| PROX
|
|
TPLINK -->|"1GbE"| PI_V
|
|
TPLINK -->|"1GbE"| GL_MT
|
|
TPLINK -->|"1GbE"| GL_BE
|
|
|
|
classDef switch fill:#f39c12,stroke:#333,stroke-width:2px,color:#fff
|
|
classDef nas fill:#3498db,stroke:#333,stroke-width:2px,color:#fff
|
|
classDef compute fill:#9b59b6,stroke:#333,stroke-width:2px,color:#fff
|
|
classDef router fill:#2ecc71,stroke:#333,stroke-width:2px,color:#fff
|
|
|
|
class TLSX switch
|
|
class ATL,CAL nas
|
|
class GUA,DSK,PROX,ANUB,PI_V compute
|
|
class TPLINK router
|
|
```
|
|
|
|
---
|
|
|
|
## 📝 ASCII 10GbE Layout
|
|
|
|
```
|
|
╔══════════════════════════════════════════════════════════════════════════════════════════╗
|
|
║ 10 GIGABIT ETHERNET BACKBONE ║
|
|
║ Concord, CA • 25Gbps Internet • High-Speed LAN ║
|
|
╚══════════════════════════════════════════════════════════════════════════════════════════╝
|
|
|
|
┌─────────────────────────┐
|
|
│ ☁️ INTERNET │
|
|
│ Sonic 25Gbps Fiber │
|
|
│ 25,000 Mbps ↑↓ │
|
|
└───────────┬─────────────┘
|
|
│
|
|
│ 25Gbps
|
|
▼
|
|
┌─────────────────────────┐
|
|
│ 🌐 TP-Link Archer BE800 │
|
|
│ ═══════════════════════ │
|
|
│ WiFi 7 Tri-Band Router │
|
|
│ • 1x 10Gbps RJ45 Port │
|
|
│ • 1x 10Gbps SFP+ Port │
|
|
│ • 4x 2.5Gbps LAN Ports │
|
|
└─────┬─────────┬─────────┘
|
|
│ │
|
|
10GbE │ │ 2.5GbE
|
|
│ │
|
|
┌───────────────┘ └───────────────────────────┐
|
|
│ │
|
|
▼ ▼
|
|
┌───────────────────────────────┐ ┌─────────────────────────────────┐
|
|
│ ⚡ TP-Link TL-SX1008 │ │ 🔌 1GbE / ROUTER DEVICES │
|
|
│ ═══════════════════════════ │ │ ═══════════════════════════ │
|
|
│ 8-Port 10GbE Unmanaged │ │ │
|
|
│ • All ports 10GBASE-T │ │ ┌─────────┐ ┌─────────┐ │
|
|
│ • 160Gbps switching capacity │ │ │ Proxmox │ │RPi 5 │ │
|
|
│ • Fanless, silent operation │ │ │ VM Host │ │ Vish │ │
|
|
│ │ │ │ 1GbE │ │ 1GbE │ │
|
|
│ Port Layout: │ │ └─────────┘ └─────────┘ │
|
|
│ ┌───┬───┬───┬───┬───┬───┬───┬───┐ │ │
|
|
│ │ 1 │ 2 │ 3 │ 4 │ 5 │ 6 │ 7 │ 8 │ │ ┌─────────┐ ┌─────────┐ │
|
|
│ └─┬─┴─┬─┴─┬─┴─┬─┴───┴───┴───┴───┘ │ │GL-BE3600│ │GL-MT3000│ │
|
|
│ │ │ │ │ (unused) │ │exit node│ │HA subnet│ │
|
|
└────┼───┼───┼───┼──────────────────┘ │ └─────────┘ └─────────┘ │
|
|
│ │ │ │ └─────────────────────────────────┘
|
|
│ │ │ │
|
|
10GbE│ │ │ │10GbE
|
|
│ │ │ │
|
|
▼ ▼ ▼ ▼
|
|
┌────────────────────────────────────────────────────────────────────┐
|
|
│ ⚡ 10GbE CONNECTED DEVICES │
|
|
│ ══════════════════════════════════════════════════════════════ │
|
|
│ │
|
|
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
|
|
│ │ ATLANTIS │ │ CALYPSO │ │ GUAVA │ │
|
|
│ │ ═════════════ │ │ ═════════════ │ │ ═════════════ │ │
|
|
│ │ 192.168.0.200 │ │ 192.168.0.250 │ │ 192.168.0.100 │ │
|
|
│ │ │ │ │ │ │ │
|
|
│ │ DS1823xs+ │ │ DS723+ │ │ TrueNAS Scale │ │
|
|
│ │ 8-Bay NAS │ │ 2-Bay NAS │ │ Ryzen 5 8600G │ │
|
|
│ │ │ │ │ │ │ │
|
|
│ │ 8x 16TB HDDs │ │ 2x 12TB HDDs │ │ 2x 4TB SSD │ │
|
|
│ │ = 128TB Raw │ │ = 24TB Raw │ │ = 8TB Raw │ │
|
|
│ │ │ │ │ │ │ │
|
|
│ │ ┌───────────┐ │ │ ┌───────────┐ │ │ ┌───────────┐ │ │
|
|
│ │ │ E10M20-T1 │ │ │ │E10G22-T1 │ │ │ │ Mellanox │ │ │
|
|
│ │ │ 10GbE+M.2 │ │ │ │ -Mini │ │ │ │ConnectX-5 │ │ │
|
|
│ │ │ PCIe │ │ │ │ 10GbE │ │ │ │ 10/25GbE │ │ │
|
|
│ │ └───────────┘ │ │ └───────────┘ │ │ └───────────┘ │ │
|
|
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
|
|
│ │
|
|
│ ┌─────────────────┐ │
|
|
│ │ SHINKU-RYUU │ │
|
|
│ │ ═════════════ │ │
|
|
│ │ 192.168.0.3 │ │
|
|
│ │ │ │
|
|
│ │ i7-14700K │ │
|
|
│ │ RTX 4080 16GB │ │
|
|
│ │ 96GB DDR5 │ │
|
|
│ │ ┌───────────┐ │ │
|
|
│ │ │ Mellanox │ │ │
|
|
│ │ │ConnectX-5 │ │ │
|
|
│ │ │ 10/25GbE │ │ │
|
|
│ │ └───────────┘ │ │
|
|
│ └─────────────────┘ │
|
|
│ │
|
|
└────────────────────────────────────────────────────────────────────┘
|
|
|
|
╔════════════════════════════════════════════════════════════════════════════════════════╗
|
|
║ PERFORMANCE BENCHMARKS ║
|
|
║ ═════════════════════ ║
|
|
║ ║
|
|
║ • NAS-to-NAS Transfer (Atlantis ↔ Calypso): ~1.1 GB/s (8.8 Gbps) ║
|
|
║ • Desktop → Atlantis Sequential Write: ~1.0 GB/s (8.0 Gbps) ║
|
|
║ • Atlantis → Desktop Sequential Read: ~1.1 GB/s (8.8 Gbps) ║
|
|
║ • 4K Video Stream (single): ~100 Mbps (0.1 Gbps) ║
|
|
║ • 4K Video Streams (concurrent, theoretical): ~80 streams ║
|
|
║ ║
|
|
║ Bottlenecks: ║
|
|
║ • None for 10GbE devices - full speed to switch via router's 10G uplink ║
|
|
║ • 1GbE devices: Proxmox host, RPi 5, GL routers connected via router's GbE ports ║
|
|
╚════════════════════════════════════════════════════════════════════════════════════════╝
|
|
```
|
|
|
|
---
|
|
|
|
## 📊 Hardware Specifications
|
|
|
|
### TP-Link TL-SX1008 (10GbE Switch)
|
|
| Specification | Value |
|
|
|---------------|-------|
|
|
| Ports | 8x 10GBASE-T (RJ45) |
|
|
| Switching Capacity | 160 Gbps |
|
|
| Forwarding Rate | 119.04 Mpps |
|
|
| Management | Unmanaged |
|
|
| Cooling | Fanless (silent) |
|
|
| Power | ~15W typical |
|
|
|
|
### 10GbE Network Cards
|
|
|
|
| Device | NIC Model | Interface | Notes |
|
|
|--------|-----------|-----------|-------|
|
|
| Atlantis | Synology E10M20-T1 | PCIe 3.0 x8 | Combo 10GbE + M.2 slot |
|
|
| Calypso | Synology E10G22-T1-Mini | PCIe 3.0 | Official Synology 10GbE (Intel X550-AT) |
|
|
| Guava | Mellanox ConnectX-5 (MT27800) | PCIe | 2-port; 10/25GbE capable; running at 10Gbps |
|
|
| Shinku-Ryuu | Mellanox ConnectX-5 (2-port) | PCIe | 10/25GbE capable; running at 10Gbps |
|
|
|
|
---
|
|
|
|
## 🔧 Cable Requirements
|
|
|
|
All 10GbE connections use **Cat6a or Cat7** cables for reliable 10Gbps performance:
|
|
|
|
| Connection | Cable Type | Length | Notes |
|
|
|------------|------------|--------|-------|
|
|
| Switch → Atlantis | Cat6a | ~2m | Shielded recommended |
|
|
| Switch → Calypso | Cat6a | ~2m | Shielded recommended |
|
|
| Switch → Guava | Cat6a | ~3m | |
|
|
| Switch → Desktop | Cat6a | ~5m | |
|
|
| Router → Switch | Cat6a | ~1m | 2.5GbE link |
|
|
|
|
---
|
|
|
|
## 🔗 Related Diagrams
|
|
- [Network Topology](network-topology.md) - Complete network overview
|
|
- [Storage Topology](storage-topology.md) - NAS storage configuration
|