10/6/2021

EXADATA NEW FEATURES

Oracle Exadata New Features

• Brief History of Exadata
• Hardware Changes
• Software features

Brief History of Exadata

Exadata Exadata
V1 V2 Oracle Software and HP Hardware

Oracle Software and Hardware(Sun)

Exadata Exadata Exadata Exadata Exadata Exadata Exadata Exadata Exadata
X2 X3 X4 X5 X6 X7 X8 X8M X9M

1
 10/6/2021

Networking Change
• Starting X8M
• RDMA – which provides 100Gb/sec network fabric
Replaces Infiniband Networking (40Gb/sec) is
replaced with

Hardware evolution - CELLS

• X9M High Capacity and Extended (XT) Storage

Hardware changes - CELLS

• High Capacity Storage Servers
Hard Flash Memory CPUs System Area
Disks (12) (4)
X6 8 TB 3.2TB 128GB 2*10 cores First 2 Disks
X7 10 TB 6.4TB 192GB 2*10 cores M2 devices
2* 150 GB
X8 14 TB 6.4TB 192GB 2*16 cores M2 devices
/X8M 2* 240 GB
X9M 18TB 6.4TB 256GB 2*16 cores

X8M onwards, 12 * 128GB Intel Optane DC Persistent Memory modules

2
 10/6/2021

Hardware evolution - CELLS

• Extended (XT) Storage
Hard Flash Memory CPUs System Area
Disks (12) (4)
X8 14 TB NA 96GB 1*16 cores M2 devices
2* 240 GB
X8M 14 TB NA 96GB 1*16 cores M2 devices
2* 240 GB
X9M 18TB NA 96GB 1*16 cores

Do not have Intel Optane DC Persistent Memory modules

Hardware evolution - CELLS

• Extreme Flash Storage

Hardware evolution - CELLS

• Extreme Flash Storage Servers
Flash Drives Memory CPUs System Area
(8)
X6 3.2TB 128GB 2*10 cores First 2 Disks
X7 6.4TB 192GB 2*10 cores M2 devices
2* 150 GB
X8 6.4TB 192GB 2*16 cores M2 devices
/X8M 2* 240 GB
X9M 6.4TB 256GB 2*16 cores
X8M onwards 12 * 128GB Intel Optane DC Persistent Memory modules

3
 10/6/2021

Persistent Memory
• Starting from X8M Storage servers
– 16 Million read IOPs
– 560GB/sec throughput

Persistent Memory
• Architecture of using the PMEM devices

Cell Software requirements

• X7 Storage servers
– Exadata Software release 18.1.0 or later
• X8 Storage servers
– Exadata Software release 19.2.0 or later
• X8M Storage servers
– Exadata Software release 19.3.0 or later
• X9M Storage servers
– Exadata Software release 21.2.0 or later

4
 10/6/2021

Hardware evolution - Compute

• 2 Socket Compute Servers
Local Memory CPUs Network Ports
drives (4) (expandable)
X6 600 GB 256GB 2*22 cores 2 *IB
(768 GB) 4 *1GbE/10 GbE Base-T
2* 10GbE Ethernet
X7 600 GB 384GB 2*24 cores 2 *IB
(768 GB or 2 *1GbE/10 GbE Base-T
1.5 TB) 2* 10GbE/25GbE Ethernet
X8 /X8M 1.2 TB 384GB 2*24 cores 2 *IB/RDMA
(768 GB) 2 *10 GbE Base-T
2* 10/25GbE Ethernet

Hardware evolution - Compute

• 2 Socket Compute Servers
Local Memory CPUs Network Ports
drives (4) (expandable)
X9M 3.84 TB 512GB 2*32 cores 2 * RDMA
(Flash) (2TB) 2 *10/25 Gb Optical or 4*10
Gb copper
2 * 10/25 Gb Optical or 4* 10
Gb copper
2 * 10/25 Gb Optical or 4*10
Gb copper
1 * 1 Gb ( Admin)

Hardware evolution - Compute

• 8 Socket Compute Servers
Local Memory CPUs Network Ports
drives (8) (expandable)
X6 600 GB 2 TB 8*18 cores 8 *IB
(6 TB) 10 *1GbE/10 GbE Base-T
8 * 10GbE Ethernet
X7 600 GB 3 TB 8*24 cores 8 *IB
(6 TB) 8 *1GbE/10 GbE Base-T
8 * 10GbE Ethernet
X8/X8M 2 * 6.4 TB 3 TB 8*24 cores 8 *IB/RDMA
Flash (6 TB) 8 * 10 GbE Base-T
8 * 10/25GbE Ethernet

5
 10/6/2021

Hardware evolution - Compute

• 8 Socket Compute Servers
Local Memory CPUs Network Ports
drives (8) (expandable)
X9M 2 * 6.4 TB 3 TB 8*24 cores 8 * IB/RDMA
Flash (6 TB) 8 * 10/25 Gb Copper
8 * 1/10 Gb Ethernet
(admin)

Software new features 18c

• In-Memory RAM Cache in Storage Servers
– This is in addition to the Flash Cache
– RAM Cache is like an extension of Buffer Cache to Storage
RAM
– Data will be either in Buffer Cache or in RAM Cache
– Performance data available in AWR also

Software new features 18c

• In-Memory Columnar Cache in Storage Servers
– Similar to In-Memory in Instance
– This is in the Storage, enable Smart scan to use the In-Memory
feature
– Supports Uncompressed and Compressed Tables
– 12.2.1.1.0 supported HCC tables

6
 10/6/2021

Software new features 19c

• Supports PMEM in X8M
– Storage Server software19.3.0 required
– Oracle Database 19c
• Used for Caching data and for Log Writes

Software new features 19c

• Supports RDMA over Converged Ethernet (RoCE)
• With X8M hardware
• Provides 100Gb/sec Network fabric

Software new features 19c

• Starting X8M Hardware , KVM is the virtualization
technology on Database Machine Servers

• Xen only with Infiniband

• KVM only with RDMA

7
 10/6/2021

Software new features 20c

• Smart Flash Log Write-Back
• Use the Flash Cache in Write Back mode
– Stores entire Redo Log file in Flash Cache
– Applicable only from X7 Hardware

Software new features 20c

• Control which Database can use PMEM
• New Parameter in IORM plan
– pmemcache=on/off
– Use with Inter Database plan

Software new features 21c

• Storage indexes can be persisted
– Need not be rebuilt after reboot of Cell
• They are persisted to the System Area ( M2 devices)
• Set Cell Attribute storageIndexPersMode

8
 10/6/2021

Software new features 21c

• Columnar Cache in Flash Cache was rebuilt on Cell
reboots
• Now the Cache can be persisted across Restarts
• Set Cell Attribute columnarCachePersMode

Software new features 21c

• IORM Cluster Plan
• To also include IO prioritization for multiple Grid
Infrastructure Clusters ( accessing same Cell)
• ASM Scoped security must be implemented

Software new features 21c

• Maintain Redundancy while a Disk is replaced
– Drop for Replacement
• This task is done as a proactive replacement of Hard
disk
• Using Maintain Redundancy option, ensure the data
is rebalanced before the disk is dropped

9
 10/6/2021

Additional references
• Images/ Pictures
https://docs.oracle.com/en/engineered-systems/exadata-database-machine/dbmmn/maintaining-
exadata-storage-servers.html#GUID-EC85B6CB-33F3-4487-A4B7-8608C14B1575

• New Features in Software

https://docs.oracle.com/en/engineered-systems/exadata-database-machine/dbmso/new-
features.html#GUID-45D4D12A-C249-46B3-B698-FE176601674B

• Hardware components
https://docs.oracle.com/en/engineered-systems/exadata-database-machine/dbmso/hardware-
components-exadata-db-machine.html#GUID-1C6D6FCA-6B44-42DE-AA64-EA5F9791F9DC

10