8:30

- 9:00

Introduccin Canales

9:00 9:30

ODA - Oracle Database Appliance

9:30 - 10:30

Private Compute Appliance (PCA) & Netra Modular System (NMS)

10:30 -11:00

Break

11:00 - 12:30

Breakthrough Processor M7 and System Design

12:30 - 14:00

Almuerzo

14:00 - 15:15

Technical Deep Drive T7 & M7 Servers.

15:15 15:40

Break

15:40 - 16:30

Technical Deep Drive SuperCluster M7

Copyright 2015, Oracle and/or its aliates. All rights reserved. | Oracle Conden@al Internal

Technical Deep Drive T7 & M7 Servers

Jorge Cordoba Suaza

Senior Sales Consultant



Dec 10, 2015

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direc@on. It is intended for
informa@on purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or func@onality, and should not be relied upon
in making purchasing decisions. The development, release, and @ming of any features or
func@onality described for Oracles products remains at the sole discre@on of Oracle.

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Agenda
1

Systems Overview

T7-1

T7-2

T7-4

M7-8 & M7-16

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7 and M7 Systems

T7-1

T7-2

T7-4

M7-8

M7-16

Processors

2 or 4

Up to 8 1

Up to 16 2

Max Cores

32

64

128

256

512

Max Threads

256

512

1,024

2,048

4,096

Max Memory 3

.5 TB

1 TB

2 TB

4 TB

8 TB

2U

3U

5U

Rack / 10U

Rack

LDOMs

LDOMs

LDOMs

LDOMs, PDOMs 1

LDOMs, PDOMs 2

Form Factor
Domaining

(1)Factory congured with one (up to 8 processors) or two (up to 4 processors each) sta9c physical domains
(2)1, 2, 3 or 4 recongurable physical domains
(3) Maximum memory capacity is based on 32 GB DIMMs


Copyright 2015, Oracle and/or its aliates. All rights reserved. |

T7 Family:
T7-4
T7-1

T7-2

Familiar on the outside

All new on the inside
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Server

System Details

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Server Overview

2U chassis, ts into (900 mm deep rack)
One SPARC M7 Processor (32 Cores / 256 Threads)
Up to 512 GB of Memory
8 or 16 DIMMs, 16 GB or 32 GB each
Eight Hot-Swap 2.5 SFF Disk Drive Bays
Up to 8 SAS HDDs/SSDs
Up to 4 NVMe SSDs
Mixing SAS and NVMe drives supported
One on-board SAS-3 HBA (HW RAID 0/1/10/1E)
One op@onal NVMe PCIe Switch Card (Factory Installed)
Four 10GBASE-T ports (Two on-board dual port NICs)
6 Low Prole PCIe 3.0 x8 Slots, or 2 x16 + 2 x8 Slots (Four PCIe Buses)
Front load DVD drive
Local (front and rear USB, rear Video) and remote KVMS
Four Hot-plug Redundant Fan Modules (Top Loading)
Two 1,000 W Hot-plug Power Supplies (1+1 )
Maximum total power 1,306 Waks
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 vs. SPARC T5-2 (1P) & SPARC T4-1

Feature
Form Factor
Processor
Memory
Integrated Network Ports
Internal Storage
Removable Media
Management Ports
USB Ports
PCI Express Slots
Fans
Hot-Swappable Power Supplies
Maximum Power Consump@on

SPARC T7-1

SPARC T5-2 (1P)

SPARC T4-1

2U, 737mm / 29 deep

1x 4.13 GHz SPARC M7, 32-cores,
(32 cores, 256 threads)
DDR4-2133, 16x Slots,
Max. 512GB w/ 32 GB DIMMs
4x 10GBASE-T
8x 2.5 Hot-Plug SFF Bays
8x SAS 3.0 HDD and/or SSD, 4x NVMe SSDs
DVD Drive
1x Serial (RJ-45), 1x 100BASE-T,
1x VGA (HD-15)
2xUSB 2.0, 2x USB 3.0
6x PCIe 3.0 (x8) Low Prole slots,
or 4x PCIe 3.0 slots, 2 (x16) and 2 (x8)
4x Redundant Hot-Swap Dual Fan Modules
2x 1000 Wak AC, 1+1
1,306 W

3U, 732mm / 28.8 deep

1x 3.6 GHz SPARC T5, 16-cores,
(16 cores, 128 threads)
DDR3-1066, 16x Slots,
Max. 512GB w/ 32 GB DIMMs
4x 10GBASE-T
6x 2.5 Hot-Plug SFF Bays
6x SAS 3.0 HDD or SSD
DVD Drive
1x Serial (RJ-45), 1x 100BASE-T,
1x VGA (HD-15)
2xUSB 2.0, 2x USB 3.0

2U, 715mm / 28.1 deep

1x 2.85 GHz SPARC T4, 8 cores
(8 cores, 64 threads)
DDR3-1066, 16x Slots,
Max. 512GB w/ 32 GB DIMMs
4x 1000BASE-T
8x 2.5 Hot-Plug SFF Bays
8x SAS 2.0 HDD or SSD
DVD Drive
1x Serial (RJ-45), 1x 100BASE-T,
1x VGA (HD-15)
4xUSB 2.0

8x PCIe 3.0 (x8) Low Prole slots

6x PCIe 2.0 Low Prole slots

6 x Redundant Hot-Swap Fans

2 x 2000 Wak AC, 1+1
912 W

6x Redundant Hot-Swap Dual Fan Modules

2 x 1200 Wak AC, 1+1
713 W

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Front View

Locator Front System
LED/Bukon Indicators
4x NVMe Capable
Drive Bays

Power
Bukon

DVD

SAS1

SAS3/NVMe1

SAS5/NVMe3

SAS0

SAS2/NVMe0

SAS4/NVMe2

SAS6

RFID/Serial
Number

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

2x USB 2.0

SAS7

Status
LEDs


NVM Express Technology (NVMe)
NVMe = Non-Vola@le Memory host controller interface for PCIe bus
NVMe is a high performance interface for Solid State Drives (SSDs)
Eliminates the SAS Host-Bus Adapter by connec@ng directly into PCIe bus
Improves both random and sequen@al performance
Reduced latency, increased parallelism, and streamlined command set

NVMe uses PCI-Express signaling

8GB/sec, x4 interface per drive. (Four @mes the wire-count vs. SAS)

Same connector as the 2.5 SFF SAS HDDs/SSDs (more pin out used)
NVMe drives also exist in other form factors (e.g. PCIe and M.2 cards)
Copyright 2015, Oracle and/or its aliates. All rights reserved. |


NVMe Technology
Oered with SPARC T7 and M7 Servers

Flash Accelerator F160 PCIe Card with 1.6 TB NVMe memory

Bootable device, supported in all SPARC T7 and M7 servers

Internal 2.5 SFF NVMe Drives in SPARC T7-1, T7-2 and T7-4
SPARC T7-1: Up to 4 NVMe SFF Drives (requires one PCIe switch card)
SPARC T7-2: Up to 4 NVMe SFF Drives (requires one or two PCIe switch card)
SPARC T7-4: Up to 8 NVMe SFF Drives (requires two PCIe switch cards)

PCIe Switch Card supports up to 4 NVMe Drives

SPARC T7-1 and T7-2: Factory congured op@on only

Mixing of SAS and NVMe SFF drives is supported

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

NVM Express Bandwidth Breakthrough

Bandwidth to Each SSD Increased by 2.6x
Conven]onal SSDs
Flash data is rst
transformed to SAS
protocol
Bandwidth to each SSD
limited by SAS3 bandwidth

NVM Express SSDs

Eliminates the protocol
transforma@on to SAS
Interfaces with root
complex over a 4-lane PCIe
Gen3 interface

Memory

PCIe
Gen3

PCIe
Root
Complex

PCIe
SAS

Controller

12 Gb/sec
SAS3

SAS3

to Flash
Controller

Flash

Flash

Flash

Flash

Flash

Flash

Flash

Flash

Standard SSD

Memory

PCIe
Root
Complex

32 Gb/sec
PCIe Gen3

PCIe

to Flash
Controller

Flash

Flash

Flash

Flash

Flash

Flash

Flash

Flash

NVM Express SSD

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

T7-1
NVMe Cabling

One NVMe
Switch Card
Must be installed in Slot3

NVMe Cable Folded

In cable tray
Note: 0/1/2/3 on card
NVMe 2/3 on DBP
NVMe 0/1 on DBP

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Hot-Swappable, High-Bandwidth Flash

2.5-Inch Small Form Factor NVMe SSD Drives in SPARC T7 Servers
Using same 2.5-inch
SFF drive bays as the
SAS HDDs and SSDs

For example: Four drive bays

SPARC T7-1 are designated as
NVMe-capable*

Oracle-unique design connects the disk backplane to an op@onal PCIe

switch that bypasses the SAS controller
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Rear View

AC0

AC1
Rear System
Indicators

4x 10GBASE-T

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

2x USB 3.0

PCIe 6

PCIe 5

SP Network 100BASE-T

PCIe 4

PCIe 2

SP Serial

PCIe 3

HD-15 VGA

PSU1

PCIe 1

PSU0

SPARC T7-1 Top View

2x Buer on Board (BOB)
Memory Riser 0

4x Memory DIMMs
SAS HBA
IO Controller ASIC

SPARC M7 Processor
CPU Module (CM)

PCIe Slots #4-#6

Service Processor (SP)
System Congura@on PROM

DVD Drive and

8x Disk Bays
(Front Access)

PCIe Slots #1-#3

Embedded USB
(eUSB)
Fan Module Cover
4x Dual-Fan Modules
(Top Loading)

Power Supplies
(Rear Access)

Memory Riser 1
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Congura@on Policy

Memory

Half-populated system memory is supported (8x DIMMs on Motherboard)

Fully-populated is supported (8x DIMMs on MB and 8x DIMMS on Memory Risers)
Both X- and ATO op@ons will require all DIMM sizes to be the same, either all 16GB, or all 32GB

Fans

System will con@nue to operate with fan failure(s) unless an over temperature occurs
System will power on with one failed fan in any of the fan modules
System will not power on with a missing fan module

Power Supply Units (PSUs)

Base package includes 1+1 redundant hot-swappable power supplies

System con@nues to operate and powers on with one failed or missing power supply
System warns if an AC cord is not akached
Requires 200-240 VAC, 50/60 Hz

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-1 Server - CRUs and FRUs

Hot-service CRUs

Cold Service FRUs

Fan Modules
Power Supplies
2.5 SAS HDDs/SSDs
2.5 NVMe SSDs

Motherboard
Disk Backplane Cage
DVD Drive
LED Indicator Modules

Cold Service CRUs

Memory Riser
Memory DIMMs
PCIe Cards
Service Processor Module (SPM)
System Congura@on PROM
System Bakery
Embedded USB ash memory (eUSB)
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server

System Details

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server Overview

3U chassis, ts into (900 mm deep rack)
Two SPARC M7 Processors (64 Cores / 512 Threads)
Up to 1 TB GB of Memory
16 or 32 DIMMs, 16 GB or 32 GB each
Six Hot-Swap 2.5 SFF Disk Drive Bays
Up to 6 SAS HDDs/SSDs
Up to 4 NVMe SSDs
Mixing SAS and NVMe drives supported
Dual on-board SAS-3 HBAs (HW RAID 0/1/10/1E)
One or two op@onal NVMe PCIe Switch Cards (Factory Installed)
Four 10GBASE-T ports (Two on-board dual port NICs)
8 Low Prole PCIe 3.0 Slots, 4 x16 + 4 x8 (Eight PCIe Buses)
Front load DVD drive
Local (front and rear USB, rear Video) and remote KVMS
Six Hot-plug Redundant Fan Modules (Top Loading)
Two 2,000 W Hot-plug Power Supplies (1+1)
Maximum total power 2,639 Waks

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 vs. SPARC T5-2

Feature
Form Factor
Processor
Memory
Integrated Network Ports
Internal Storage
Removable Media
Management Ports
USB Ports
PCI Express Slots
Fans
Hot-Swappable Power Supplies
Maximum Power Consump@on

SPARC T7-2

SPARC T5-2

3U, 753mm / 29.6 deep

2x 4.13 GHz SPARC M7, 32-cores,
(64 cores, 512 threads)

3U, 753mm / 29.6 deep

2x 3.6 GHz SPARC T5, 16-cores,
(32 cores, 256 threads)

DDR4-2133, 32x Slots,

Max. 1TB w/ 32 GB DIMMs
4x 10GBASE-T
6x 2.5 Hot-Plug SFF Bays
6x SAS 3.0 HDD or SSD, 4x NVMe SSDs
DVD Drive
1x Serial (RJ-45), 1x 100BASE-T, 2x VGA (HD-15)
2xUSB 2.0, 2x USB 3.0
8x PCIe 3.0 Low Prole slots, 4 (x16) and 4 (x8)
6x Redundant Hot-Swap Fans
2x 2000 Wak AC, 1+1
2,639 W

DDR3-1066, 32x Slots,

Max. 1TB w/ 32 GB DIMMs
4x 10GBASE-T
6x 2.5 Hot-Plug SFF Bays
6x SAS 3.0 HDD or SSD
DVD Drive
1x Serial (RJ-45), 1x 100BASE-T, 2x VGA (HD-15)
2xUSB 2.0, 2x USB 3.0
8x PCIe 3.0 (x8) Low Prole slots
6 x Redundant Hot-Swap Fans
2 x 2000 Wak AC, 1+1
1,941 W

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - Front View

Front System
Indicators

Power
Bukon
Status LEDs

4x NVMe Capable
Drive Bays

SAS5/NVMe3
SAS4/NVMe2
SAS3/NVMe1
SAS2/NVMe0
SAS1
SAS0

RFID/Serial
Number

2x USB 2.0
Ports

HD-15 VGA
Port

DVD

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - Rear View

AC0

AC1

Rear System
Indicators

PCIe 5
4x 10GBASE-T

2x USB 3.0

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

PCIe 8

SP Network 100BASE-T

PCIe 7

SP Serial

PCIe 4

PCIe 3

PCIe 2

HD-15 VGA

PCIe 6

PSU1

PCIe 1

PSU0

SPARC T7-2 Server - Top View

2x M7 Processors
CPU Module (CM)
8x Memory Risers

2x IO Controller ASICs

PCIe Slots #5-#8

6x Fans
(Top Loading)

Service
Processor

PCIe Slots #1-#4

System Congura@on
PROM
DVD Drive and
6x Disk Bays
(Front Access)

2x Power Supplies
(Rear Access)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - Congura@on Policy

Memory

Half-populated is supported (2 DIMMs per Memory Riser)

ATO op@ons : Total of 16 or 32 DIMMs, all DIMMs of same size
Mixing of X-Op@on DIMM sizes is supported, all DIMMs associated with a CPU must be same size

Example 1: 4x 32G DIMMs on [Memory Risers 0-0, 0-1, 0-2, 0-3] + 4x 16G DIMMs on [Memory Risers 1-0, 1-1, 1-2, 1-3]
Example 2: 2x 32G DIMMs on [Memory Risers 0-0, 0-1, 0-2, 0-3] + 4x 16G DIMMs on [Memory Risers 1-0, 1-1, 1-2, 1-3]

Fans

System will con@nue to operate with a single fan failure (any 1 of the 6 failed) unless an over
temperature occurs
System will power on if 5 of the 6 fan modules are present , any single one can be missing

Power Supply Units (PSUs)

Base package includes 1+1 redundant hot-swappable power supplies

System con@nues to operate and powers on with one failed PSU
Requires 200-240 VAC , 50/60 Hz

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - PCIe Switch Card and NVMe Cables

First PCIe Switch Card in Slot #1

NVMe Cables (Factory Installed only)

DBP NVMe Connectors

Second PCIe Switch Card in Slot #2

One PCIe Switch Card

PCIe Switch Card in Slot #1
Supports NVMe Bays 0, 1, 2, 3*

Two PCIe Switch Cards

PCIe Switch Card in Slot #1
Supports NVMe Bays 0, 1*

PCIe Switch Card in Slot #2
Supports NVMe Bays 2, 3*

Note that NVMe and SAS drive bay numbering are dierent

Copyright 2015, Oracle and/or its aliates. All rights reserved. |



SPARC T7-2 Server - NVMe 2.5 SFF Drives
Device Nomenclature and path names
NVMe
Bay

Shared
One PCIe Switch Card (PCIe Slot 1)
SAS Bay

NVMe0

HDD2

/pci@306/pci@1/pci@0/pci@4/nvme@0/disk@1

NVMe1

HDD3

/pci@306/pci@1/pci@0/pci@5/nvme@0/disk@1

NVMe2

HDD4

/pci@306/pci@1/pci@0/pci@6/nvme@0/disk@1

NVMe3

HDD5

/pci@306/pci@1/pci@0/pci@7/nvme@0/disk@1

SAS5/NVMe3
SAS4/NVMe2
SAS3/NVMe1
SAS2/NVMe0

NVMe
Bay

Shared
Two PCIe Switch Cards (PCIe Slots 1,2)
SAS Bay

NVMe0

HDD2

/pci@306/pci@1/pci@0/pci@6/nvme@0/disk@1

NVMe1

HDD3

/pci@306/pci@1/pci@0/pci@7/nvme@0/disk@1

NVMe2

HDD4

/pci@307/pci@1/pci@0/pci@6/nvme@0/disk@1

NVMe3

HDD5

/pci@307/pci@1/pci@0/pci@7/nvme@0/disk@1

SAS1
SAS0

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - Memory Riser

DIMM (BOB0/Channel0)

populated Memory Risers:

- Channel0 populated (black handle)
- Channel1 empty (light handle)

DIMM (BOB0/Channel1)

DIMM (BOB1/Channel0)

DIMM (BOB1/Channel1)
BOB0
BOB1

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-2 Server - CRUs and FRUs

Hot-service CRUs

Cold Service FRUs

Fan Modules
Power Supplies
2.5 SAS HDDs/SSDs
2.5 NVMe SSDs

Cold Service CRUs

Motherboard
Service Processor (SP)
Disk Backplane Cage
Power Supply Backplane
Fan Board

Memory Riser
Memory DIMMs
PCIe Cards
DVD Drive
System Congura@on PROM
System Bakery
Embedded USB ash memory (eUSB)
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server

System Details

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server Overview

5 RU chassis, ts into (1000 mm deep rack)
Two or four SPARC M7 Processors (up to 128 Cores / 1024 Threads)
Up to 2 TB of Memory
32 or 64 DIMMs, 16 GB or 32 GB each
Eight Hot-Swap 2.5 SFF Disk Drive Bays
Up to 8 SAS HDDs/SSDs and/or NVMe SSDs
Mixing SAS and NVMe drives supported
Dual on-board SAS-3 HBA (HW RAID 0/1/10/1E)
One or two op@onal NVMe PCIe Switch Cards*
Four 10GBASE-T ports (Two on-board dual port NICs)
16 Low Prole PCIe 3.0 Slots, 8 x16 + 8 x8 (Twelve PCIe Buses)**
Local (front and rear USB, rear Video) and remote KVMS
Five Hot-plug Redundant Fan Modules (Rear Loading)
Four 3,000 W Hot-plug Power Supplies (N+N )
Maximum total power 4,548 Waks

* Factory congured or eld add-on

** Plus two internal slots for NVMe PCIe switch cards

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 vs. SPARC T5-4

Feature
Form Factor
CPU
Memory
Integrated Network Ports
Internal Storage
Removable Media
Management Ports
USB Ports
PCI Express Slots
Fans
Hot-Swappable Power Supplies
Maximum Power Consump@on

SPARC T7-4

SPARC T5-4

5RU, 31.5 deep

4x SPARC M7
4.13 GHz (1024 threads)
DDR4-2133, 64x Slots,
Max. 2TB w/ 32 GB DIMMs
4x 10GBASE-T
8x 2.5 Hot-Plug SFF Bays
8x SAS 3.0 HDD or SSD, 8x NVMe SSDs
via rKVMS
1x Serial (RJ-45), 1x 100BASE-T, 2x VGA (HD-15)
4x USB 3.0
16x PCIe 3.0 slots, 8 (x16) and 8 (x8)
Hot-Plug Low Prole slots with Card Carrier
5 x Redundant Hot-Swap Dual Fan Modules
4 x 3000 Wak AC, N+N
4,548 W

5RU, 31.5 deep

4x SPARC T5
3.6 GHz (512 threads)
DDR3-1066, 64x Slots,
Max. 2TB w/ 32 GB DIMMs
4x 10GBASE-T
8x 2.5 Hot-Plug SFF Bays
8 x 2.5 SAS 3.0 HDD or SSD
via rKVMS
1x Serial (RJ-45), 1x 100BASE-T, 2x VGA (HD-15)
4x USB 3.0
16x PCIe 3.0 (x8) slots
Hot-Plug Low Prole slots with Card Carrier
5 x Redundant Hot-Swap Dual Fan Modules
2 x 3000 Wak AC, 1+1
3,292 W

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server - Front View

PROCESSOR MEMORY MODULE 1

Locator
LED/Bukon
Front System
Indicators

PROCESSOR MEMORY MODULE 0

Power Bukon
Status LEDs

SAS1/NVMe1

SAS3/NVMe3

SAS5/NVMe5

SAS7/NVMe7

HD-15 VGA

SAS0/NVMe0

SAS2/NVMe2

SAS4/NVMe4

SAS6/NVMe6

SP Serial
2x USB 2.0
RFID/Serial
Number

Power Supply 0

Power Supply 1

Power Supply 2

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Power Supply 3

SPARC T7-4 Server - Rear View

AC0

AC1

Rear System
HD-15 VGA
4x 10GBASE-T
Indicators SP Serial
2x USB 3.0
SP Network 100BASE-T
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

AC2

PCIe 16

PCIe 15

Fan Module 4

PCIe 14

PCIe 13

PCIe 12

PCIe 11

Fan Module 3

PCIe 10

PCIe 9

PCIe 8

Fan Module 2

PCIe 7

PCIe 6

PCIe 5

Fan Module 1

PCIe 4

PCIe 3

PCIe 2

Rear I/O Module (RIO)

PCIe 1

Fan Module 0

AC3

SPARC T7-4 Server - Congura@on Policy

Memory

Ini@al server order must have only one type of DIMMs, either half or fully populated
Half-populated - 16 DIMMs per Processor Module (PM), 1 DIMM per BoB
Fully-populated - 32 DIMMs per PM

Memory congura@on on one PM0 can be dierent from PM1 via X-Op@ons
Both ATO and X-op@ons: All DIMMs on a PM must be of same type and capacity

Fans

Base package includes ve N+1 redundant hot-swappable Dual Fan Modules

System will con@nue to operate with fan failure(s) unless an over temperature occurs
System will power on with one failed fan
System will not power on with a missing fan module

Power Supply Units (PSUs)

Base package includes 2+2 redundant hot-swappable power supplies

Two PSUs must be present and powered, requires 200-240 VAC , 50/60 Hz
System con@nues to operate with two failed PSUs, or a failed grid
System powers on with two failed PSUs, or a failed grid
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server - Main Module Top View

Internal PCIe Slot (SFF0)
4x I/O Controller

Service Processor
Module (SPM)
SAS Controller (SAS1)

Internal PCIe Slot (SFF1)

SAS Controller (SAS0)

Front I/O Module

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server - Processor Module Top View

DIMM Sockets (16x2)
Buer on Board (16x)

SPARC M7 Processor
(CPU1 or CPU3)

SPARC M7 Processor
(CPU0 or CPU2)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7-4 Server - CRUs and FRUs

Hot-service CRUs

Fan Modules
Power Supplies
2.5 SAS HDDs/SSDs
2.5 NVMe SSDs
PCIe Cards in the carrier

Cold Service CRUs

Cold Service FRUs

Service Processor Module (SPM)

System Congura@on PROM
System Bakery
Rear I/O Module (RIO)
Embedded USB ash memory (eUSB)
Rear Chassis Subassembly

Main Module (MM)

Processor Module (PM)
Memory DIMMs
Front I/O Assembly
Internal PCIe Cards (no carrier)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC T7 Servers - Availability Features

SDRAM error protec@on, message
retry in hardware, lane re@re in
hardware, cyclic redundancy check
(CRC), and DIMM sparing

Power On Self Test

Redundant, hot-swap
cooling fans
Hot plug I/O adapters
(T7-4)

H/W RAID 0, 1, 10, 1E

integrated in disk controller

Redundant I/O controllers

with MPxIO for storage devices
and IPMP for network devices

ZFS with S/W RAID 5, 6 and

10 for le system resilience

Mul@ple PCIe Root Complexes

for isolated I/O virtualiza@on

Front and rear system

indicator LEDs
Mul@ple integrated SAS HBAs
or NVMe PCIe switches for
drive isola@on (T7-2 and T7-4)

Independent power domains

on Processor Modules (T7-4)

Hot plug disk drives

Redundant, hot-swap
power supplies
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Agenda
1

Systems Overview

T7-1

T7-2

T7-4

M7-8 & M7-16

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-8 Server

System Details

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-8 Overview

Two Factory Congured Op]ons:

One Sta@c Physical Domains with up to 8 processors

Two Sta@c Physical Domains, each up to 4 processors

2 to 8 SPARC M7 Processors (up to 256 Cores and 2048 Threads)

Up to 4 TB of Memory
8 or 16 DIMMs per Processor (16 GB or 32 GB DIMMs)
Up to 24 PCIe 3.0 (x16) Slots
3 PCIe Slots per Processor, Dedicated PCIe Buses per Slot
Redundant hot-swappable SPs with automa]c fail-over
Redundant System Clocks
Eight Hot-plug Redundant Fan Modules
Six 3,000 W Hot-plug Power Supplies (N+N)
Power input: 3-phase PDUs, or 1-phase direct
Maximum total power 8,923 Waks
Factory mounted in a system rack (Sun Rack II 1242)
Op@onally: Standalone 10 RU chassis (1200 mm deep rack)
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-8 vs. SPARC T5-8

Feature

SPARC M7-8

SPARC T5-8

System Rack: 600mm wide, 1200 mm deep, 2m / 78 2/3 high

Standalone: 10RU, 813 mm / 32 deep chassis, Min. 1200 mm deep rack
1 or 2
SPARC M7, 32-cores, 4.13 GHz
8 / 256/ 2048

8RU, 800 mm / 31.5 deep

Min. 1000 mm deep rack
1
SPARC T5, 16-cores, 3.6 GHz
8 / 64 / 1024

DDR4-2133, 128x Slots, Max. 4TB w/ 32 GB DIMMs

DDR3-1066, 128x Slots, Max. 4TB w/ 32 GB DIMMs

Integrated Network Ports

Internal Storage
Removable Media

PCIe NIC Cards

Up to 16 x Flash Accelerator F160 PCIe Card, hot plug
via rKVMS

4x 10GBASE-T
Up to 8 x 2.5 SAS 3.0 HDD or SSD, hot-plug
via rKVMS

Management Ports

Dual SPs, ports per SP: 1x Serial (RJ-45), 1x 100BASE-T

1x Serial (RJ-45), 1x 100BASE-T, 2x VGA (HD-15)

-
Up to 24x PCIe 3.0 (x16) slots
Hot-Plug Low Prole slots with Card Carrier
8 x Redundant Hot-Swap Dual Fan Modules
6 x 3000 Wak AC, N+N
8,923 W

4x USB 3.0
16x PCIe 3.0 (x8) slots
Hot-Plug Low Prole slots with Card Carrier
10 x Redundant Hot-Swap Dual Fan Modules
4 x 3000 Wak AC, N+N
6,060 W

Form Factor
Physical Domains
Processor
Max. Processors/Cores/Threads
Memory

USB ports
PCI Express Slots
Fans
Redundant Hot-Swap Power Supplies
Maximum Power Consump@on

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

CMIOU Chassis
SPARC M7-8 and M7-16 Servers

Front

Power Supplies (6x)

Fan Modules
(8x)

Rear Control
& LEDs

Service
SP Tray
Rear Processors (SP)

CMIOU (8x)

Front Control
& LEDs
10RU

CL/SL Interconnect
Assemblies (4x)

CL Interconnect
Assembly, wide (1x)

SP Interconnect
Assembly (1x)

A/C inlets (6x)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

PCIe Carriers (24x)

CMIOU Board
SPARC M7-8 and M7-16 Servers

DIMM Sockets (8x2)
PCIe 3.0 (x16) LP
Slot1 Card Carrier

Buer on Board (8x)

eUSB Device

SPARC M7
Processor
SP Truss
Connec@on

I/O Controller
Coherency/Scalability
Link Connec@ons

PCIe 3.0 (x16) LP

Slot2 Card Carrier

DC/DC Converters

PCIe 3.0 (x16) LP

Slot3 Card Carrier

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-8 with One PDom

Glueless System Interconnect
Total Aggregated System Bandwidth: 2.0 TB/sec
All-to-All local interconnect. The 8-way CPU-to-CPU
fabric is 7 x16 Coherency Links (CL) from each CPU to
the other 7 CPUs

At 18.1 Gb/sec/lane this results in ~36 GB/sec/direc]on
per x16 CL link ~254 GB/sec/direc]on per CPU

DIMM
16
DIMM
16

M7

M7

M7

DIMM
16

M7

Bisec]on Bandwidth: 1,160 GB/sec

16 x16 CL links x 36 GB/sec/link/direc]on

POINT-TO-POINT
LOCAL
INTERCONNECT
M7

Memory Bandwidth
Per M7 = 333GB/sec
Or 2.66 TB/sec for M7-8

DIMM
16

DIMM
16

M7

M7

DIMM
16

M7

DIMM
16

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

DIMM
16

CMIOU 0
CMIOU 1
CMIOU 2
CMIOU 3
CMIOU 4
CMIOU 5

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

CMIOU 6

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP1/SPM0 x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP0/SPM0 x1

SPARC M7-8 with One Pdom: Device Map

M7 #0
M7 #1
M7 #2
M7 #3
M7 #4
M7 #5
M7 #6
M7 #7

I/O
I/O
I/O
I/O
I/O
I/O
I/O
I/O

CMIOU 7

SPARC M7-8 with Two PDoms

Glueless System Interconnect

Bisec]on Bandwidth: 580 GB/sec (per PDOM)

8 x16 CL links x 36 GB/sec/link/direc]on

Aggregated System Bandwidth: 870 GB/sec per PDom

Two separate All-to-All local interconnects. The 4-way
CPU-to-CPU fabric is 6 x16 Coherency Links (CL) from
each CPU to the other 3 CPUs

At 18.1 Gb/sec/lane this results in ~36 GB/sec/direc]on
per x16 CL link ~254 GB/sec/direc]on per CPU

DIMM
16
DIMM
16

Memory Bandwidth
Per M7 = 333GB/sec or
1.3 TB/sec (per PDOM)

POINT-TO-POINT
LOCAL
INTERCONNECT

M7

PDOM 1 CMIOU boards 4-7

PDOM 0 CMIOU boards 0-3

M7

DIMM
16
DIMM
16

M7

M7

DIMM
16

M7

M7

POINT-TO-POINT
LOCAL
INTERCONNECT
M7

DIMM
16

DIMM
16

M7

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

DIMM
16

CMIOU 0
CMIOU 1
CMIOU 2
CMIOU 3
CMIOU 4

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

CMIOU 5
CMIOU 6

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP1/SPM1 x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP0/SPM1 x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP1/SPM0 x1

PCIe SLOT3 x16

PCIe SLOT2 x16

PCIe SLOT1 x16

eUSB x1

SP0/SPM0 x1

SPARC M7-8 with Two PDoms: Device Map

PDOM 0
PDOM 1
M7 #0
M7 #1
M7 #2
M7 #3
M7 #4
M7 #5
M7 #6
M7 #7

IOC
IOC
IOC
IOC
IOC
IOC
IOC
IOC

CMIOU 7

SPARC M7-8 PDom Popula@on Rules

Dual SPs,
2x SPMs

M7-8 with one PDom, includes up to 8 Processors

M7-8 with two PDoms, each up to 4 Processors
Minimum of two CMIOU boards per system
Minimum of two CMIOU per PDom (unless empty),
addi@onal CMIOUs in increments of one

PDOM0

M7-8 with one PDom

Dual SPs,
4x SPMs

Either or fully populated memory on CMIOU boards

All the memory on the CMIOU must be the same density and
type
Mixing memory in DCUs and PDoms is supported

PDOM1

PDOM0

M7-8 with two PDoms

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 Server

System Details

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 Overview

Recongurable: 1, 2, 3 or 4 Physical Domains
4 to 16 SPARC M7 Processors (up to 512 Cores / 4096 Threads)
Up to 8 TB of Memory
8 or 16 DIMMs per Processor (16 GB or 32 GB DIMMs)
Up to 48 PCIe 3.0 (x16) Slots
3 PCIe Slots per Processor
One dedicated PCIe Bus per Slot
Redundant hot-swappable SPs with automa@c fail-over
Redundant Distributed System Clocks
Redundant, Hot-Pluggable Fans
16 3,000 W Hot-plug Power Supplies (N+N)
Power input: Dual 3-phase PDUs
Maximum total power 20,033 Waks
Factory mounted in Sun Rack II 1242 system rack
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 vs. SPARC M6-32

Feature
Form Factor
Physical Domains
Processor
Max. Processors/Cores/Threads
Memory
Integrated Network Ports
Internal Storage
Removable Media
PCI Express Slots
Fans
Power Connec@ons
Maximum Power Consump@on

SPARC M7-16

SPARC M6-32

H: 78.7/2000 mm, W: 23.6/600 mm, D: 47.2/1200 mm,

1,670 lbs. (749 kg)
1, 2, 3 or 4
SPARC M7, 32-cores, 4.13 GHz
16 / 512/ 4096

H: 78.7/2000 mm, W: 35.6/940 mm, D: 57.1/1451 mm,

3,700 lbs. (1678 kg)
1, 2, 3 or 4
SPARC M6, 12-cores, 3.6 GHz
32 / 384/ 3072

DDR4-2133, 256x Slots, Max. 8TB w/ 32 GB DIMMs

DDR3-1066, 1024x Slots, Max. 32TB w/ 32 GB DIMMs

PCIe NIC Cards

Up to 32 Flash Accelerator F160 PCIe Card, hot pluggable
via rKVMS
Up to 48x PCIe 3.0 (x16) slots
Hot-Plug Low Prole slots with Card Carrier
8 x Redundant Hot-Swap Dual Fan Modules
3-phase/Dual Grid, total of 6 inputs cables
20,033 W

Base IO Cards
Up to 32 x 2.5 SAS HDD or SSD, hot-pluggable
via rKVMS
64x PCIe 3.0 (x8) slots
Hot-Plug Low Prole slots with Card Carrier
10 x Redundant Hot-Swap Dual Fan Modules
3-phase/Dual Grid, total of 6 inputs cables
26,490 W

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Server Hardware Components

SPARC M7-8 and M7-16 Servers

CMIOU Chassis

Eight CMIOU Boards (CPU, Memory, and IO Units)

Dual SPs or SPPs

Switch Chassis

Six Switch Boards (aka Switch Unit, SWU)

Dual SPs

System Interconnect Wire Trusses

Internal Interconnect (II) Assemblies

External Interconnect (XL) Assemblies

SunRack II style System Rack

Dual 3-phase PDUs

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 Domain Congurable Unit (DCU)

DCU is set of 4 xed CMIOU slots, bokom 4
and top 4 slots
Each CMOIU Chassis includes two DCUs
Data communica@on between CMIOUs
within the DCU pass through the Coherency
Links (CL, glueless interconnect)
Communica@on between CMIOUs in
dierent DCUs uses the Scalability Links (SL,
glued interconnect)

DCU 1
DCU 0

DCU

CL data trac can overow through SL

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Coherency Links

Scalability Links

SPARC M7-16 Systems Interconnect

Total Aggregated System Bandwidth: 4.8 TB/sec
Global Interconnect : Each CPU connects to 12
Coherency Switches . The CPU-to-Switch fabric
is 24 x4 Scalability Links per CPU

At 18.1 Gb/sec/lane this results in a SL bandwidth of
~9 GB/sec/direc]on per x4 SL link
~218 GB/sec/direc]on per CPU
Aggregated ~870 GB/sec per a 4-way DCU
Aggregated ~3.5 TB/sec per a 16-way M7-16

Local Interconnect within the DCU: The 4-way

CPU-to-CPU fabric is 3 x12 Coherency Links (CL) per CPU

At 18.1 Gb/sec/lane this results in a CL bandwidth of
~27 GB/sec/direc]on per x12 CL link
~82 GB/sec/direc]on per CPU
Aggregated ~326 GB/sec per a 4-way DCU
Aggregated ~1.3 TB/sec per a 16-way M7-16

DIMM
16

DIMM
16

M7
Bisec]on Bandwidth: 218 GB/sec

4 x12 CL links x 27 GB/sec/link/direc]on

M7
LOCAL
INTERCONNECT

M7
Memory Bandwidth
Per M7 = 333 GB/sec
1.3 TB/sec for a 4-way DCU
5.3 TB/sec for a 16-way M7-16

DIMM
16

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

M7

DIMM
16

SPARC M7-16 Systems Interconnect

SPARC M7
Processors

Coherency Links (CL)

Glueless Interconnect

DCU1

Scalability Links (SL)

Switched Interconnect

DCU3

CMIOU
Chassis #1
Scalability
ASICs

Switch
Chassis

CMIOU
Chassis #0
DCU0
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

DCU2

SPARC M7 Switch Board (aka Switch Unit, SWU)

Fan Module (x6)

Scalability ASIC

SP Internal
Interconnect
Connector

7
6
5
4

External
Interconnect
Connectors (x8)

Scalability ASIC

3
2
1
SWU Port
Number

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7 Switch Chassis

SP Internal
Interconnect

Front Controls & LEDs

Rear Control
& LEDs

Switch Unit (6x)

Front

Rear

Dual Service
Processors

Switch Module
Fans (36x)

External
Interconnect
Assemblies (8x)

A261 PSUs (4x)

AC Inlets (4x)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 Systems Interconnect

64 Port Switch ASIC's (only 32 ports are used)
Divided into 2 Switch Groups of 6 Switch ASICs
5.2TB/s Payload Bandwidth
4X Bisec@on Payload Bandwidth over M6

Physical Domains of 4-way DCUs

Fully Connected Local Topology

Dynamically Combine Processor Domains

Fully Connected Switch Topology

2 Links Connec@ng Every Processor and Switch

Coherence Directory Distributed Among Switches
Latency Reduc@on over M6 Genera@on

SMP Interconnect RAS

Link Auto Retry & Retrain, Single Lane Failover

Link Level Mul@-pathing
Opera@onal with 5 of 6 SWU's per Switch Group
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 Domain Congura@on Unit (DCU)

Coherency Links are physically located in the
Internal Interconnect Assemblies
Scalability Links are physically located in the
External Interconnect Assemblies
In each DCU the rst two CMIOU boards (always
present) have physical IO connec@ons to the SPP
Each PDom uses rst two connec@ons (ac@ve and
stand-by) for HOST/ILOM communica@on. Any
addi@onal physical connec@ons remain unused.

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

CMIOU 0
CMIOU 1
CMIOU 2
CMIOU 3
CMIOU 4
CMIOU 5

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

CMIOU 6

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 10

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 9

eUSB x1

DCU 0

M7 #8
M7 #9
M7 #10
M7 #11
M7 #12
M7 #13
M7 #14
M7 #15

I/O
I/O
I/O
I/O
I/O
I/O
I/O
I/O

CMIOU 11

DCU 1

M7 #0
M7 #1
M7 #2
M7 #3
M7 #4
M7 #5
M7 #6
M7 #7

I/O
I/O
I/O
I/O
I/O
I/O
I/O
I/O

CMIOU 7

PDOM 2

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

SPP3/SPM1 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

SPP2/SPM1 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

DCU 2

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 8

eUSB x1

SPP1/SPM1 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 11

eUSB x1

SPP0/SPM1 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 10

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 9

eUSB x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

SPP3/SPM0 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

SPP2/SPM0 x1

PDOM 1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

CMIOU 8

eUSB x1

SPP1/SPM0 x1

PCIe SLOT3 X16

PCIe SLOT2 X16

PCIe SLOT1 X16

eUSB x1

SPP0/SPM0 x1

PDOM 0

SPARC M7-16 Device Map (Example with 3 PDoms)

DCU 3

SPARC M7-16 Physical Domain (PDom)

Up to 4 PDoms per M7-16 Server
PDoms are dened in increments of DCUs,
all CMIOUs in a DCU belong to same PDom
A PDom can be made of 1, 2, 3 or 4 DCUs

Example: M7-16 with 3 PDoms

PDOM2

PDOM1

Each PDom is controlled and managed by its

own SPP (ac@ve/stand-by connec@ons to SPMs)
The admin manages the PDoms via the main SP
PDOM0

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7-16 DCU/PDom Popula@on Rules

Must include minimum of 4 CMIOU boards

Minimum of one 4-way DCU (DCU0), or two 2-way DCUs (DCU0 and DCU2)

Minimum of two CMIOU boards in a DCU (unless empty)

First and 2nd slots in a DCU must be populated

Addi@onal CMIOU boards can installed in increments of one

Either or fully populated memory on CMIOU boards

All the memory on the CMIOU must be the same density and type
Mixing memory in DCUs and PDoms is supported

Minimum one Network Adapter per PDom

No Internal Storage required

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Server Boot Op@ons

SPARC M7-8 and M7-16 Servers
Each PDom must have a Boot Source, one of the following:
Boot Op]on
PCIe Adapter/Op]on
Internal NVMe SSD Oracle Flash Accelerator F160 PCIe Card
Fiber Channel
(SAN akached)

iSCSI (Ethernet)

iSCSI (Inniband)2

Connects to
N/A

Sun Storage Dual 16 Gb FC HBA

StorageTek 8 Gb FC HBA, dual port

Oracle ZFS Storage ZS3 & ZS4,

Oracle FS1 Flash Storage
Sun Storage 6180, 6580 and 6780 Array1
Pillar Axiom 300, 500 and 6001
Sun ZFS Storage1
Sun Dual Port GbE PCIe 2.0, MMF
Oracle ZFS Storage ZS3 & ZS4
Sun Quad Port GbE PCIe 2.0, UTP
Oracle FS1 Flash Storage
Sun Dual Port 10GBase-T Adapter
Pillar Axiom 6001
Sun Dual 10GbE SFP+ PCIe 2.0
Sun ZFS Storage1
Oracle Dual Port QDR InniBand Adapter M3 Oracle ZFS Storage ZS3 & ZS4
1) The product is EOLd but supported
2) Requires a specic boot process
Copyright 2015, Oracle and/or its aliates. All rights reserved. |


Embedded USB (eUSB) and Boot over Inniband
New Oracle Solaris Boot Process

Conven@onal network boot is not possible over IB

IB storage devices are not accessible by the OpenBoot Prom rmware

Boot program and data loaded from local ash memory

New servers include internal, embedded USB (eUSB) storage device
One or more eUSB devices form the boot pool
Boot pool stores the rmware accessible boot archives

Boot archive allows root le system mount using iSCSI over IPoIB
Fall back: A boot archive exist on the on system service processor
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7 Servers - Service Processor (SP)

All models have dual SPs with an ac@ve/stand-by congura@on

Automa@c failover in the event of a failure

One serial (RJ45) and one 1000BASE-T port (auto nego@ates to 10/100/1000 Mb/s)
Also accessible via the host network (PCIe Adapter on the CMIOU board)

SP is responsible for:

Ini@alize, manage the CPU, Memory controller, and DIMMs

Environmental monitoring such as temp sensors and adjust fans/cooling
Host rKVMS service for the PDom

All PDoms are supported with redundant SP func@onality

SPARC M7-8 with 1 PDom: Dual SPs with 1 SPM in each suppor@ng one PDom
SPARC M7-8 with 2 PDoms: Dual SPs with 2 SPMs in each suppor@ng two PDoms
SPARC M7-16: Dual SPMs in all four SPPs in the CMIOU chassis, and dual SPs in the
switch chassis suppor@ng up to 4 PDoms
Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7 Servers - Service Processor Top View

Dual Service Processor Modules (SPM)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

SPARC M7 Service Processor Module (SPM)

SPM contains the processor that runs the SP/SPP func@on
Each SP/SPP includes one or two SPMs depending on model
M7-8 with One PDom: Each SP has only one SPM
M7-8 with Two PDoms: Each SP has two SPMs
M7-16 Switch Chassis: Each SP has only one SPM
M7-16 CMIOU Chassis: Each SPP has two SPMs

Each PDom is connected to two SPMs in separate SPs/SPPs providing

an ac@ve/stand-by congura@on with failover capability
In a mul@-PDom scenario one SPM per CMIOU Chassis manages hardware
items that are not associated with PDoms (PSUs, fans etc.)

Copyright 2015, Oracle and/or its aliates. All rights reserved. |

Copyright 2015, Oracle and/or its aliates. All rights reserved. |