2 Site Requirements for Recovery Appliance and Oracle Exadata Storage Expansion Rack

This chapter describes the site requirements for Recovery Appliance, sometimes referenced as "ZDLRA Rack".

Ensuring That the Site is Ready

Before ZDLRA Rack is delivered to the site, the following tasks must be performed to ensure the site is ready:

Task 1   Review Site Requirements

Review the site requirements in this chapter to understand the requirements for ZDLRA Rack.

Task 2   Understand the Networking Requirements and Options

Review Preparing Your Networks for Recovery Appliance to discern the networking requirements and configuration decisions that you must make.

Task 3   Run Oracle Exadata Deployment Assistant (OEDA)

Run OEDA to create the necessary configuration files.

See Using Oracle Exadata Deployment Assistant.

Task 4   Configure the Network

Configure the network using the files from OEDA. This includes registering the networks in the Domain Name System (DNS), assigning IP addresses, and configuring data center switches and firewalls.

Task 5   Prepare the Site Based on Requirements

Prepare the site based on the requirements, such as, install the network cables and power supplies, prior to the arrival of ZDLRA Rack.

Review the procedures in unresolvable-reference.html#GUID-42CADEBB-E412-4374-9C11-9A7E6E685F04

General Environmental Requirements

The following sections describe the general environmental requirements for ZDLRA Racks.

General Environmental Requirements for ZDLRA Rack X6 and Later

Starting with X6 models of Recovery Appliance and Oracle Exadata Storage Expansion Rack, use Oracle Exadata Configuration Assistant (OECA) to determine environmental requirements, such as size, weight, acoustic level, power, cooling, and airflow. This includes all X6, X7, X8, X8M, X9M, and later models.

Space Requirements

For all Recovery Appliance X7, X8, X8M, X9M, and later models, use Oracle Exadata Configuration Assistant (OECA) to determine the size of each rack.

In addition to the rack height, 914 mm (36 inches) of space is required above the rack height for maintenance access, as described in Table 2-3.

The space surrounding the cabinet must not restrict the movement of cool air between the air conditioner and the front of the systems within the cabinet, or the movement of hot air coming out of the rear of the cabinet.

Space Requirements for Racks up to Recovery Appliance X6

All racks up to Recovery Appliance X6-2 use the same hardware rack, and have the same space requirements.

The space requirements are as follows:

  • Height: 1998 mm (78.66 inches)
  • Width: 600 mm with side panels (23.62 inches)
  • Depth: 1200 mm (47.24 inches)

The minimum ceiling height for the cabinet is 2912 mm (114.65 inches), measured from the true floor or raised floor, whichever is higher. This includes an additional 914 mm (36 inches) of space required above the rack height for maintenance access, as described in Table 2-3. The space surrounding the cabinet must not restrict the movement of cool air between the air conditioner and the front of the systems within the cabinet, or the movement of hot air coming out of the rear of the cabinet.

Receiving, Unpacking, and Access Route Requirements

Before your ZDLRA Rack arrives, ensure that the receiving area is large enough for the package.

Use the following package dimensions for ZDLRA Rack:

  • Shipping height: 2159 mm (85 inches)
  • Shipping width: 1219 mm (48 inches)
  • Shipping depth: 1575 mm (62 inches)

If your loading dock meets the height and ramp requirements for a standard freight carrier truck, then you can use a pallet jack to unload the rack. If the loading dock does not meet the requirements, then you must provide a standard forklift or other means to unload the rack. You can also request that the rack be shipped in a truck with a lift gate.

When ZDLRA Rack arrives, leave the rack in its shipping packaging until it arrives at its installation site. Use a conditioned space to remove the packaging material to reduce particles before entering the data center. The entire access route to the installation site should be free of raised-pattern flooring that can cause vibration.

Allow enough space for unpacking it from its shipping cartons. Ensure that there is enough clearance and clear pathways for moving ZDLRA Rack from the unpacking location to the installation location.

Caution:

Prior to moving the rack, always make sure that all four leveling and stabilizing feet are raised and out of the way.

Table 2-1 Access Route Requirements

Access Route Item With Shipping Pallet Without Shipping Pallet

Minimum door height

2184 mm (86 inches)

2040 mm (80.32 inches)

Minimum door width

1270 (50 inches)

640 mm (25.19 inches)

Minimum elevator depth

1625.6 mm (64 inches)

1240 mm (48.82 inches)

Maximum incline

6 degrees

6 degrees

Minimum elevator, pallet jack, and floor loading capacity

1134 kg (2500 lbs)

1134 kg (2500 lbs)

Rack Weights for Recovery Appliance

Review the weight of your ZDLRA Rack to ensure that it can be delivered and located safely.

For all Recovery Appliance X6, X7, X8, X8M, X9M, and later models, use Oracle Exadata Configuration Assistant (OECA) to determine the net rack weight. In addition to the net rack weight, allow approximately 180 kg (400 lbs) for packaging materials.

For earlier models, use the following table to determine the rack weight:

Table 2-2 Shipping Weight

Recovery Appliance Full Rack Minimum Configuration

X7 Weight

899.9 kg (1983.9 lbs)

385.7 kg (850.4 lbs)

X6 and X5 Weight

875.7 kg (1930.5 lbs)

381.2 kg (840.5 lbs)

X4 Weight

866 kg (1909 lb)

469 kg (1034 lb)

Maintenance Access Requirements

The maintenance area must be large enough for ZDLRA Rack, and have the required access space.

The required space to remove the side panels is 675.64 mm (26.6 inches). Side panel access is not required for normal maintenance.

Front access space requirement is typically the length of the longest chassis supported in the rack, plus the distance the rails need to travel out to install and remove equipment from the front.

Rear access space requirement is the space needed for a person working behind the ZDLRA Rack.

Top access space requirement is for a person standing on a ladder to be able service components installed in the top of the rack.

Table 2-3 Maintenance Access Requirements for ZDLRA Rack (All Models)

Location Maintenance Access Requirement

Rear maintenance

914 mm (36 inches)

Front maintenance

1232 (48.5 inches)

Top maintenance

914 mm (36 inches)

Note:

  • In raised floor data centers, an adjacent tile at the rear of the rack must be able to be opened to access any cabling going under the floor.
  • ZDLRA Racks can be placed side-by-side when interconnecting the racks.

Flooring Requirements

ZDLRA Rack may be installed on raised floor or solid floor environments.

The site floor or the raised flooring must be able to support the total weight of ZDLRA Rack.

Table 2-4 Floor Load Requirements for ZDLRA Rack

Description Requirement

Maximum allowable weight of installed rack equipment

952.5 kg (2100 lbs)

Maximum allowable weight of installed power distribution units

52.16 kg (115 lbs)

Maximum dynamic load (maximum allowable weight of installed equipment including PDUs)

1004.66 kg (2215 lbs)

Note:

If you want to route data or power cables through the bottom of the rack, you can cut out a rectangular hole in the floor below the rear portion of the rack. However, avoid creating a hole that impacts the rack casters or leveling feet. For details, see Floor Cutout Dimensions in Oracle Rack Cabinet 1242 User's Guide.

Electrical Power Requirements

The ZDLRA Rack can operate effectively over a wide range of voltages and frequencies. However, each rack must have a reliable power source.

Damage may occur if the ranges are exceeded. Electrical disturbances such as the following may damage ZDLRA Rack:

  • Fluctuations caused by brownouts
  • Wide and rapid variations in input voltage levels or in input power frequency
  • Electrical storms
  • Faults in the distribution system, such as defective wiring

To protect ZDLRA Rack from such disturbances, you should have a dedicated power distribution system, power-conditioning equipment, as well as lightning arresters or power cables to protect from electrical storms.

PDU Power Requirements

Each ZDLRA Rack configuration contains two power distribution units (PDUs). Various PDUs are available to cater for different circumstances. Select the correct PDU for your data center and ZDLRA Rack configuration.

The following are the PDUs that Oracle Zero Data Loss Recovery Appliance currently supports or has supported in the past:

Low-Voltage 15 kVA Single Phase PDU for North America, South America, Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-5 Specifications for each Low-Voltage 15 kVA Single Phase PDU for North America, South America, Japan and Taiwan

Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 24A
Phase Current N/A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 30A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 30A NEMA L6-30
Low-Voltage 15 kVA Three Phase PDU for North America, South America, Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-6 Specifications for each Low-Voltage 15 kVA Three Phase PDU for North America, South America, Japan and Taiwan

Specification Value
Number of Inputs 1
Source Voltage 200-220V
Frequency 50/60 Hz
Max Line Current 40A
Phase Current 23A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 50A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 3ph 3W + ground 60A IEC60309
High-Voltage 15 kVA Single Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-7 Specifications for each High-Voltage 15 kVA Single Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Specification Value
Number of Inputs 3 x 25A 1ph
Voltage 220 - 240 VAC
Frequency 50/60 Hz
Current 25A maximum (per input)
Power Rating 15 kVA
Output Current 72A (3 x 24A)
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Group Protection (UL489 1-pole circuit breaker) 20A
Data Center Receptacle IEC309 32A 3 PIN 250 VAC IP44

Note:

The high-voltage 15 kVA single phase PDU is no longer available. The high-voltage 22kVA single phase PDU is the recommended replacement.
High-Voltage 15 kVA Three Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-8 Specifications for each High-Voltage 15 kVA Three Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Specification Value
Number of Inputs 1
Source Voltage 220/380 - 240/415VAC 3Ø
Frequency 50/60 Hz
Max Line Current 21A
Phase Current 21A
Nominal Power Rating 15kVA
Recommended Circuit Breaker 25A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 220-240V
Data Center Receptacle 3ph 4W + ground 32A IEC60309 5P 6h 400V
Low-Voltage 22 kVA Single Phase PDU for North America, South America, Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-9 Specifications for each Low-Voltage 22 kVA Single Phase PDU for North America, South America, Japan and Taiwan

Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 36.8A
Phase Current N/A
Nominal Power Rating 22kVA
Recommended Circuit Breaker 50A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 30A NEMA L6-30
High-Voltage 22 kVA Single Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-10 Specifications for each High-Voltage 22 kVA Single Phase PDUs for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Specification Value
Number of Inputs 3
Source Voltage 200-240V
Frequency 50/60 Hz
Max Line Current 32A
Phase Current N/A
Nominal Power Rating 22kVA
Recommended Circuit Breaker 30A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 1ph 2W + ground 32A IEC60309 3P 6H 230V
Low-Voltage 24 kVA Three Phase PDU for North America, South America, Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-11 Specifications for each Low-Voltage 24 kVA Three Phase PDU for North America, South America, Japan and Taiwan

Specification Value
Number of Inputs 2
Source Voltage 200-220V
Frequency 50/60 Hz
Max Line Current 34.6A
Phase Current 20A
Nominal Power Rating 24kVA
Recommended Circuit Breaker 50A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 20A
Output Voltage 200-240V
Data Center Receptacle 3ph 3W + ground 60A IEC60309
High-Voltage 24 kVA Three Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Note:

The following specifications are for a single PDU. Every ZDLRA Rack configuration contains two PDUs.

Table 2-12 Specifications for each High-Voltage 24 kVA Three Phase PDU for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan

Specification Value
Number of Inputs 2
Source Voltage 220/380 - 240/415VAC 3Ø
Frequency 50/60 Hz
Max Line Current 16A
Phase Current 16A
Nominal Power Rating 24kVA
Recommended Circuit Breaker 25A
Outlets 42 x C13, 6 x C19
Outlet Groups 6
Max Group Current 18A
Output Voltage 220-240V
Data Center Receptacle 3ph 4W + ground 32A IEC60309 5P 6h 400V

Facility Power Requirements

To prevent catastrophic failures, design the input power sources to ensure adequate power is provided to the PDUs.

Use dedicated AC breaker panels for all power circuits that supply power to the PDU. When planning for power distribution requirements, balance the power load between available AC supply branch circuits. In the United States of America and Canada, ensure that the overall system AC input current load does not exceed 80 percent of the branch circuit AC current rating.

Note:

Electrical work and installations must comply with applicable local, state, or national electrical codes. Contact your facilities manager or qualified electrician to determine what type of power is supplied to the building.

PDU power cords are 4 meters (13.12 feet) long, and 1 to 1.5 meters (3.3 to 4.9 feet) of the cord is routed within the rack cabinet. The installation site AC power receptacle must be within 2 meters (6.6 feet) of the rack.

Circuit Breaker Requirements

If computer equipment is subjected to repeated power interruptions and fluctuations, then it is susceptible to a higher rate of component failure.

You are responsible for supplying the circuit breakers. One circuit breaker is required for each power cord. In addition to circuit breakers, provide a stable power source, such as an uninterruptible power supply (UPS) to reduce the possibility of component failures.

Use dedicated AC breaker panels for all power circuits that supply power to the server. Servers require electrical circuits be grounded to the Earth.

Note:

Electrical work and installations must comply with applicable local, state, or national electrical codes.

Electrical Grounding Guidelines

The cabinets for ZDLRA Rack are shipped with grounding-type power cords.

  • Always connect the cords to grounded power outlets.
  • Check the grounding type, because different grounding methods are used depending on your location.
  • Refer to documentation such as IEC documents for the correct grounding method.
  • Ensure that the facility administrator or qualified electrical engineer verifies the grounding method for the building, and performs the grounding work.

Temperature and Humidity Requirements

Excessive internal temperatures may result in full or partial shut down of Recovery Appliance.

Airflow through ZDLRA Rack is from front to back. Refer to General Environmental Requirements for information on cooling and airflow.

Note:

Studies have shown that temperature increases of 10 degrees Celsius (15 degrees Fahrenheit) above 20 degrees Celsius (70 degrees Fahrenheit) reduce long-term electronics reliability by 50 percent.

The following table lists the temperature, humidity and altitude requirements for operating and non-operating machines.

Table 2-13 Temperature, Humidity and Altitude Requirements

Condition Operating Requirement Non-operating Requirement Optimum

Temperature

5 to 32 degrees Celsius (41 to 89.6 degrees Fahrenheit)

-40 to 70 degrees Celsius (-40 to 158 degrees Fahrenheit).

For optimal rack cooling, data center temperatures from 21 to 23 degrees Celsius (70 to 74 degrees Fahrenheit)

Relative humidity

10 to 90 percent relative humidity, non-condensing

Up to 93 percent relative humidity.

For optimal data center rack cooling, 45 to 50 percent, non-condensing

Altitude

3048 meters (10000 feet) maximum

12000 meters (40000 feet).

Ambient temperature is reduced by 1 degree Celsius per 300 m above 900 m altitude above sea level

Set conditions to the optimal temperature and humidity ranges to minimize the chance of downtime due to component failure. Operating ZDLRA Rack for extended periods at or near the operating range limits, or installing it in an environment where it remains at or near non-operating range limits could significantly increase hardware component failure.

The ambient temperature range of 21 to 23 degrees Celsius (70 to 74 degrees Fahrenheit) is optimal for server reliability and operator comfort. Most computer equipment can operate in a wide temperature range, but near 22 degrees Celsius (72 degrees Fahrenheit) is desirable because it is easier to maintain safe humidity levels. Operating in this temperature range provides a safety buffer in the event that the air conditioning system goes down for a period of time.

The ambient relative humidity range of 45 to 50 percent is suitable for safe data processing operations. Most computer equipment can operate in a wide range (20 to 80 percent), but the range of 45 to 50 percent is recommended for the following reasons:

  • Optimal range helps protect computer systems from corrosion problems associated with high humidity levels.
  • Optimal range provides the greatest operating time buffer in the event of air conditioner control failure.
  • This range helps avoid failures or temporary malfunctions caused by intermittent interference from static discharges that may occur when relative humidity is too low.

Electrostatic discharge (ESD) is easily generated, and hard to dissipate in areas of low relative humidity, such as below 35 percent. ESD becomes critical when humidity drops below 30 percent. It is not difficult to maintain humidity in a data center because of the high-efficiency vapor barrier and low rate of air changes normally present.

Ventilation and Cooling Requirements

Always provide adequate space in front and behind the rack to allow for proper ventilation.

Do not obstruct the front or rear of the rack with equipment or objects that might prevent air from flowing through the rack. Rack-mountable servers and equipment typically draw cool air in through the front of the rack and let out warm air out the rear of the rack. There is no air flow requirement for the left and right sides due to front-to-back cooling.

If the rack is not completely filled with components, then cover the empty sections with filler panels. Gaps between components can adversely affect air flow and cooling within the rack.

Relative humidity is the percentage of the total water vapor that can exist in the air without condensing, and is inversely proportional to air temperature. Humidity goes down when the temperature rises, and goes up when the temperature drops. For example, air with a relative humidity of 45 percent at a temperature of 24 degrees Celsius (75 degrees Fahrenheit) has a relative humidity of 65 percent at a temperature of 18 degrees Celsius (64 degrees Fahrenheit). As the temperature drops, the relative humidity rises to more than 65 percent, and water droplets are formed.

Air conditioning facilities usually do not precisely monitor or control temperature and humidity throughout an entire computer room. Generally, monitoring is done at individual points corresponding to multiple exhaust vents in the main unit, and other units in the room. Special consideration should be paid to humidity when using underfloor ventilation. When underfloor ventilation is used, monitoring is done at each point close to an exhaust vent. Distribution of the temperature and humidity across the entire room is uneven.

Oracle Exadata Racks have been designed to function while mounted in a natural convection air flow. The following requirements must be followed to meet the environmental specification:

  • Ensure there is adequate air flow through the server.

  • Ensure the server has front-to-back cooling. The air inlet is at the front of the server, and the air is let out the rear.

  • Allow a minimum clearance of 1219.2 mm (48 inches) at the front of the server, and 914 mm (36 inches) at the rear of the server for ventilation.

Use perforated tiles, approximately 400 CFM/tile, in front of the rack for cold air intake. The tiles can be arranged in any order in front of the rack, as long as cold air from the tiles can flow into the rack. Inadequate cold air flow could result in a higher inlet temperature in the servers due to exhaust air recirculation. The following table describes the recommended number of floor tiles:

Type of Oracle Exadata Database Machine or Oracle Exadata Storage Expansion Rack Recommended Number of Floor Tiles

Oracle Exadata full rack systems

4

Oracle Exadata half rack systems

3

Oracle Exadata quarter and eighth rack systems

1

Figure 2-1 shows a typical installation of the floor tiles for a full rack.

Figure 2-1 Typical Data Center Configuration for Perforated Floor Tiles

Description of Figure 2-1 follows
Description of "Figure 2-1 Typical Data Center Configuration for Perforated Floor Tiles"

Network Connection and IP Address Requirements for ZDLRA Rack

This section describes the requirements to connect the Oracle Zero Data Loss Recovery Appliance to your existing network infrastructure.

Network Connection Requirements for ZDLRA Rack

Prior to installation, network cables must be run from your existing network infrastructure to the installation site. The requirements to connect Recovery Appliance to your existing network infrastructure are as follows:

Network Connection Requirements

Administration Network

  • Mandatory: 1 uplink for the Management Network Switch.

  • Recommended: 2 uplinks for remote monitoring of the power distribution units (PDUs).

  • Optional: 1 uplink for ILOM on each database server or storage server if using a separate ILOM network.

Client Network

  • For bonded network configurations: 2 uplinks for each database server.

  • For non-bonded network configurations: 1 uplink for each database server.

    Note: Non-bonded network configurations are not supported on Recovery Appliance X7 and later systems.

Additional Network(s)

  • For bonded network configurations: 2 uplinks for each database server and additional network.

  • For non-bonded network configurations: 1 uplink for each database server and additional network.

    Note: Non-bonded network configurations are not supported on Recovery Appliance X7 and later systems.

RDMA Network Fabric (Private Network)

No uplinks are required. The RDMA Network Fabric is completely self-contained within Recovery Appliance.

DNS Configuration for ZDLRA Rack

Prior to receiving your ZDLRA Rack, you must use Oracle Exadata Deployment Assistant (OEDA) to generate files that drive the configuration of the system. The system configuration files contain network host names and IP addresses for the management network, client network, and additional public networks, which should be registered in Domain Name System (DNS) prior to initial configuration. In particular, all public addresses, single client access name (SCAN) addresses, and VIP addresses should be registered in DNS prior to installation.

The assistant-generated file defines the SCAN as a single name with three IP addresses on the client access network. The three SCAN addresses provide service access for clients to Oracle Zero Data Loss Recovery Appliance. Configure DNS for round robin resolution for the SCAN name to these three SCAN addresses.

All addresses registered in DNS must be configured for both forward resolution and reverse resolution. Reverse resolution must be forward confirmed (forward-confirmed reverse DNS) such that both the forward and reverse DNS entries match each other.

IP Address Requirements for ZDLRA Rack

The Recovery Appliance requires a dedicated allocation of host names and IP addresses. The number of required IP addresses primarily depends on the size of the system.

The detailed network configuration, including host names and IP addresses, is generated from information supplied to Oracle Exadata Deployment Assistant (OEDA).

You should configure the IP addresses in your existing networks after you run OEDA. All IP addresses in the configuration file must be unassigned at the time of initial configuration. In addition, all IP addresses must be statically-assigned IP addresses, not dynamically-assigned (DHCP) addresses.

All RDMA Network Fabric IP addresses must be in the same subnet, with a minimum subnet mask of 255.255.240.0 (or /20). The subnet mask chosen should be wide enough to accommodate possible future expansion of the Recovery Appliance and the internal network.

You can use the information in the following sections to calculate the IP address requirement for Recovery Appliance. However, ensure that you use the configuration information generated in OEDA as your authoritative guide.

Rack-Level IP Address Requirements

The following table outlines the rack-level IP address requirements for Recovery Appliance. These addresses are required regardless of the configuration options that are selected for the system.

Network IP Address Requirements

Administration Network

  • 1 IP address for the administration network interface on each compute server or storage server.

  • 1 IP address for the ILOM network interface on each database server or storage server.

  • 1 IP address for the management interface on each RDMA Network Fabric switch.

  • 1 IP address for the management interface on the Management Network Switch switch.

  • 1 IP address for the management interface in each power distribution unit (PDU).

RDMA Network Fabric (Private Network)

2 IP addresses for each database server or storage server.

Dedicated Backup Network between Oracle Exadata and Oracle Zero Data Loss Recovery Appliance

This section describes an Oracle convention for a dedicated backup network between Oracle Exadata and Oracle Zero Data Loss Recovery Appliance RA23. Its purpose is to facilitate Oracle Exadata customers using 10G networks to take advantage of the 100GE NICs option. The networking default configuration on RA23 remains 2 x 25 GE ports for ingest and 2 x 25GE ports for replication per compute server. A small benefit is that the dedicated network does increase network bandwidth for backup and restore traffic to the Oracle Zero Data Loss Recovery Appliance (ZDLRA).

The convention calls for two 100GE switches for the rack.

Table 2-14 Ethernet Cabling for the Recovery Appliance RA21 Racks

R23 Connection Exadata X10M Exadata X9M and earlier

100 GE

  • 25GE NICs connected via Split Cables, or
  • Direct Connection from Exadata Database Server X10M nodes 100GE NICs

to RA23 TOR switches

25 GE

Connection from Exadata Database Server X10M node's 25GE NICs to RA23 TOR switches through:

  • 25/10 SFPs, or
  • Split cables

Connection from Exadata Database Server X9M node's 25GE NICs to RA23 TOR switches through:

  • 25/10 SFPs, or
  • Split cables

10 GE

TOR Switch is not recommended.

Use appropriate 10/40 split cables

* Using 100GE NICs in Exadata Database Server X10M nodes is not necessary.

Using the 10 GE port of the Exadata Database Server X10M with the ZDLRA TOR switches is inefficient, and not using them for this purpose keeps them available should older Exadata systems need to be connected.

Exadata Database Server X10M nodes can connect their 25GE NICs with 25/100GE Splitter Cables (1x100GE to 4x25GE).

25/100 GbE requires OM4 cables and splitters and (Q)SFP28 transceivers. 10 GbE requires OM3 cables and splitters and (Q)SFP+ transceivers.

If the Exadata and RA23 are in adjacent racks and 5 meters is sufficient, use the 7118366 Copper Splitter Cable assembly: 5 meters, QSFP28 to 4 SFP28 part to connect the database machine nodes to the RA23 ToR switches.

For longer distances, you must use optical connections. There are three parts to this:

  • QSFP28 transceivers, part 7604159, to connect the cable to the switch. Two are required for every four database server nodes nodes.

  • Optical splitter cables to run to the Exadata rack. Again, two are required for every four database server nodes, and the quantity chosen is per controller.

  • Exadata has 25 GbE transceivers that are ordered with Exadata and not with RA23. Two are required for each database server node in the Exadata.

Figure 2-2 ZDLRA RA23 100GE to Exadata X10

Shows dedicated network from Exadata to ToR switch to ZDLRA.