Page 1
C122-B001-02EN Front Cover SYSTEM DESIGN GUIDE...
Page 3
SAFETY" Use the product according to the instructions and information available in this manual. Keep this manual handy for further reference. Fujitsu makes every effort to prevent users and bystanders from being injured or from suffering damage to their property. Use the product according to this manual.
Page 4
RADIO FREQUENCY INTERFERENCE STATEMENT The following notice is for EU users only. WARNING: This is a product which meets Class A of EN55022. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.
Page 5
System and product names in this manual are not always noted with trademark or registered trademark symbols (™), (). The contents of this manual shall not be disclosed in any way or reproduced in any media without the express written permission of Fujitsu Limited. All Rights Reserved, Copyright FUJITSU LIMITED 2005 C122-B001-02EN...
Page 7
Revision History (1/1) Revised section Edition Date Details (Added/ Deleted/ Altered) (Note) 2005-07-11 — — 2005-09-16 All chapters (correction) Technical brushup Section 9.3 (addition) Addition of description for cluster of Windows Note: In this table, the revised section is indicated by its section number in the current edition.
Preface This manual describes conditions and points for consideration for PRIMEQUEST system operation design and provides related essential notes. The manual is intended for system administrators. Read the manual together with the reference manuals cited in it. This section explains Structure and Contents of This Manual Other Reference Manuals Text Conventions...
Page 10
Preface CHAPTER 6 Redundant Configuration Describes the redundant configuration of main unit components, including the mirrored configuration and redundant LANs and HDDs. CHAPTER 7 Hot Swapping Describes hot swapping of hardware components of the main unit. CHAPTER 8 Partition Describes how to set up and operate partitions of the main unit and describes the necessary items for determining the partition configuration.
The command syntax is shown in a frame such as this one. Environmental Requirements for Using This Product This product is a computer which is intended to be used in a computer room. For details on the operational environment, see the PRIMEQUEST 480/440 Installation Planning Manual (C122-H001EN). C122-B001-02EN...
• In this manual, it is assumed that two BMMs (optional products) can be connected to a single I/O unit; this is reflected both in the explanations and in the figures included in this manual. At present, however, the PRIMEQUEST 480/400 series supports only connection to one BMM (BMM#0) per I/O unit.
NOTE ON SAFETY Alert Labels The following labels are attached to this product: These labels provide information to the users of this product. Do not peel off the labels. • Main unit Front view C122-B001-02EN...
Page 16
NOTE ON SAFETY Rear view Unit rear viii C122-B001-02EN...
Page 17
NOTE ON SAFETY • Extended Power Cabinet Rear view Front view • Extended I/O cabinet Front view Rear view C122-B001-02EN...
Page 18
NOTE ON SAFETY • PCI_Box Left side view Front view (without cover) C122-B001-02EN...
Maintenance and inspections (repairing, and regular diagnosis and maintenance) The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer. Users must not perform these tasks. Incorrect operation of these tasks may cause malfunction.
Page 25
Contents 6.5.1 Duplication of a transmission line between servers (high-speed switch method) 6-17 6.5.2 Duplication between a server and a hub and between switches on the same network (NIC switch method) 6-18 6.6 Degradation Function ......... . 6-20 CHAPTER 7 Hot Swapping .
Page 29
Contents Figure 5.10 Age-out of learning table ....... 5-24 Figure 5.11 VLAN Tag of mirroring frame ......5-28 Figure 5.12 Example of flow control .
Page 30
Contents Figure 10.1 Local backup using a standard utility (when the KVM console is used) ......10-3 Figure 10.2 Backup to the remote host by using a standard utility (when using the KVM console) .
Page 31
Table 2.20 Number of mounted SBs and IO_Units, and PSU configuration (PRIMEQUEST 480) ........2-32 Table 2.21 Number of mounted SBs and IO_Units, and PSU configuration...
Page 32
Contents Table 5.7 Auto-negotiation priority ....... . Table 5.8 Interface support for flow control ......Table 5.9 Flow control and restriction list .
32 CPUs and the PRIMEQUEST 440 is a middle-range server model that houses up to 16 CPUs. The PRIMEQUEST 480 is equipped with up to 512 GB of memory, internal HDDs with a capacity of up to 4.70 TB, and PCI slots that can be expanded to 128 slots. The cabinet can be flexibly divided into up to 8 partitions.
CHAPTER 1 PRIMEQUEST Overview These models support Linux and Windows, operating systems (hereafter sometimes abbreviated as OSs) that are available in 64-bit processor configurations. Figure 1.1 shows the appearance of the PRIMEQUEST 440/PRIMEQUEST 480. Figure 1.1 PRIMEQUEST 440/PRIMEQUEST 480 C122-B001-02EN...
1.1 Basics of PRIMEQUEST 1.1.1 PRIMEQUEST conceptual diagram The PRIMEQUEST cabinet contains hardware elements. These hardware elements are interconnected within the cabinet and work independently of other elements and, at the same time, cooperate with each other to serve as an integral system. Business LAN PRIMEQUEST GSWB...
32 HDDs (4.70 TB) and the PRIMEQUEST 440 can contain up to 16 HDDs (2.35 TB). To accommodate PCI cards, the PRIMEQUEST 480 has 32 PCI card slots and the PRIMEQUEST 440 has 16 PCI card slots. By using PCI_BOXes (optional), you can add additional PCI card slots.
SB: System board MMB: Management board IOU: IO_Unit GSWB: Gigabit switch board Figure 1.3 Configuration of all hardware (PRIMEQUEST 480) 1.1.2 Product lineup The PRIMEQUEST lineup consists of two models: a high-end server that accommodates up to 32 CPUs, and a mid-range server that accommodates up to 16 CPUs.
Page 38
CHAPTER 1 PRIMEQUEST Overview Specification Item PRIMEQUEST 480 PRIMEQUEST 440 System board (SB) Up to 8 boards Up to 4 boards IO_Unit Up to 8 boards Up to 4 boards Chipset PRIMEQUEST-dedicated PRIMEQUEST-dedicated chipset chipset Memory (maximum 512 GB 256 GB...
MMB Web-UI. Figure 1.4 shows the technologies underlying the three features. The following sections describe the overview of these technologies. Software technologies Fujitsu middleware, etc. Clustering Firmware Linux Hardware redundancy and GSWB...
The chipset is an LSI device that controls data transfer among CPUs, memory, and IO_Units. The PRIMEQUEST-series machines contain this new chipset that has been developed by Fujitsu for improved performance and increased reliability. The following three achievements are made by the PRIMEQUEST-dedicated chipset: • Large-scale SMP...
SMP technology, so processing can be assigned to any processor. High scalability can thus be obtained with applications unchanged. In an SMP system configuration with multiple SBs linked, the PRIMEQUEST 480 supports up to 32 CPUs, and the PRIMEQUEST 440 supports up to 16 CPUs.
CHAPTER 1 PRIMEQUEST Overview 1.2.1.4 System Mirror System Mirror duplicates the address cross bar and data cross bar, the inside of the chip set, and memory. Thus, even if a duplicated component fails, its mirror, the normal component, can continue the system processing. The use of System Mirror can thus increase reliability and improve continuity of business.
1.2 PRIMEQUEST Features In operation with System Mirror, if a hardware failure occurs while the system is operating, the failure location (system) is disconnected, and the task is continued with the other system. The disconnection stops neither the system nor the task. After the disconnection, the task is performed only by one system, while a search for the cause of the failure is made so that the faulty component can be replaced quickly and operation can return to system mirrored operation quickly.
CHAPTER 1 PRIMEQUEST Overview 1.2.1.5 Partition function The partition function logically divides hardware resources in one cabinet into multiple systems, and each of the systems operates independently. The maximum number of partitions depends on the model: up to 8 partitions in the PRIMEQUEST 480, and up to 4 partitions in the PRIMEQUEST 440.
1.2 PRIMEQUEST Features Independent resource expansion in each partition The PRIMEQUEST flexible I/O mechanism and partition function can be used to allocate resources effectively. For example, a system with the minimum configuration can be constructed first, and required hardware resources can then be added to the system at any time to improve its capabilities.
CHAPTER 1 PRIMEQUEST Overview Operation on different platforms The partition function enables a mixture of systems in the same cabinet. Each partition in the cabinet can run a different OS or a different OS version. This makes possible flexible development and capability improvements, so hardware resources can be used effectively.
1.2 PRIMEQUEST Features 1.2.1.6 Flexible I/O mechanism The flexible I/O mechanism provides greater flexibility in connecting SBs and IO_Units. In operation without the flexible I/O mechanism, some resources remain unused because CPUs, memory, and I/O resources have fixed connections, as shown in Figure 1.10.
CHAPTER 1 PRIMEQUEST Overview • Free resource allocation If CPUs, memory, and I/O resources have fixed connections, resources may sometimes be used ineffectively. The flexible I/O mechanism enables CPUs, memory, and I/O resources to be allocated as required according to the operation mode to reduce costs.
1.2 PRIMEQUEST Features Table 1.2 Relationship of the above partitions, SBs, and IO_Units Partition IO_Unit Partition #0 SB #0 IO_Unit #0 Partition #1 SBs #1, #2, #3, and #4 IO_Units #1, #2, and #3 Partition #2 SBs #5, #6, and #7 IO_Units #4, #5, #6, and #7 In Partition #0, SB #0 and IO_Unit #0 are connected in a one-to-one basis.
CHAPTER 1 PRIMEQUEST Overview Reduced MTTR Figure 1.12 shows an example where the MTTR is shortened by a reserved SB. Operation is switched to reserved SB #4 when a hardware failure occurs on SB #3. SB #3 is disconnected from Partition #1. The active IO_Unit #2 can be connected to the reserved SB #4 as is by the flexible I/O mechanism.
Also, PRIMEQUEST supports the hot maintenance function under certain conditions, so that maintenance components can be disconnected and installed during system operation. However, replacing components is a task handled by Fujitsu maintenance personnel. Hardware redundant configuration The redundant configurations of the main hardware components are described below:...
CHAPTER 1 PRIMEQUEST Overview SB#0 Management LAN Crossbar duplication IOU#0 Business LAN duplication GSWB#0 GSWB#1 Figure 1.13 Duplication of the main components Hot maintenance function The hot maintenance function disconnects a unit from the system for maintenance work on the unit, without stopping system operation. Hot maintenance is possible because the main components and important units in a PRIMEQUEST-series machine are in redundant configurations, as described below: Since the power supply units (PSUs) and fans are in redundant configurations as...
1.2 PRIMEQUEST Features 1.2.1.8 Management board (MMB) No dedicated management server need be installed because the PRIMEQUEST cabinet contains the MMB, which has the server management function. The MMB functions include hardware status monitoring, displaying configuration and error information, partition management, network environment management, and power control.
CHAPTER 1 PRIMEQUEST Overview 1.2.1.9 GSWB (internal LAN switching hub) Since PRIMEQUEST cabinet has a built-in switching hub (GSWB) compatible with Gigabit Ethernet, effective network infrastructures can be constructed. The GSWB can be operated from the MMB Web-UI for centralized and simple operation.
The following software is adopted by the PRIMEQUEST-series machines to increase reliability, availability, and operability: Firmware for PRIMEQUEST Linux Windows Clustering software Fujitsu middleware products 1.2.2.1 Firmware The following hardware management and operation firmware is installed on PRIMEQUEST-series machines. For details, see CHAPTER 3, "General Software Configuration."...
CHAPTER 1 PRIMEQUEST Overview 1.2.2.2 Linux PRIMEQUEST supports Red Hat Enterprise Linux, which are platforms adopted as global standards. Table 1.3 Linux OS features Growth Linux's strong growth potential is underscored by the following potential characteristics: • Not dependent on the principles and business of any particular enterprise (OS vendor) •...
1.2 PRIMEQUEST Features 1.2.2.4 Clustering software The Linux OS supports clustering using PRIMECLUSTER. Windows Server 2003 supports clustering using the OS standard function (Microsoft Cluster Service). The availability of the whole system can be increased in a cluster configuration. If a failure occurs in the active partition or the cabinet, the current task can be handed to a standby partition or cabinet, thereby providing high availability.
1.2.2.5 Fujitsu middleware products A high-reliability and high-availability system can be constructed by linking the PRIMEQUEST-series machines with the following middleware products that use Fujitsu's high-reliability and high-performance technologies and accumulated know- how: Interstage ......Business integration software Symfoware .......Database software Systemwalker ....Integrated operation management software...
CHAPTER 2 General Hardware Configuration This chapter describes the following hardware devices that compose a PRIMEQUEST-series machine: Main unit - Cabinet - System Board (SB) - IO_Unit - Management Board (MMB) - Crossbar - GSWB (Gigabit Switch Board) - KVM Interface Unit (KVM) - Clock and PCI_Box Control Board (CPCB) - OPL - AC Section (ACS)
CHAPTER 2 General Hardware Configuration Table 2.1 Types and maximum numbers of boards and components Maximum number Board/component PRIMEQUEST PRIMEQUEST Remarks The minimum is one. 32 (4 × 8 SB) 16 (4 × 4 SB) Each SB requires at least one CPU.
The gigabit switch board (GSWB), which is a switching hub compatible with Gigabit Ethernet is an optional product that can be mounted in the cabinet. Figure 2.3 shows the appearance of the cabinet with its front and rear covers removed (example of the full package of the PRIMEQUEST 480). GSWB KVMSU CPCB...
System Board (SB) CPUs, memory, various chipsets, and a DC-DC converter are mounted on the SB: The PRIMEQUEST 480 main unit contains one to eight SBs, and the PRIMEQUEST 440 main unit contains one to four SBs. The SB contains one to four CPUs and one set (four modules) to eight sets (32 modules) of memory.
2.2 System Board (SB) 2.2.1 Table 2.3 lists the two types of CPUs that can be mounted: The CPU is an IPF processor. The reliability, availability, and serviceability (RAS) function is enhanced by the error detection and correction function incorporated for cache memory, etc.
CHAPTER 2 General Hardware Configuration 2.2.2 Memory This section describes the memory: The memory module (DIMM) uses double data rate synchronous dynamic random access memory (DDR2 SDRAM). The memory module can be added in sets of four modules of the same type. One LDX has four DDR2 interface channels.
2.2 System Board (SB) Notes on mounting DIMMs Note the following points on mounting DIMMs: DIMMs must be added in sets of four DIMMs. One set is the minimum configuration unit. The four DIMMs in each set must be the same type. When adding DIMMs to a channel, start from Slot #0.
HDD, PCI cassette, and PCI-X slot are mounted in the IO_Unit, which provides instructions to devices and inputs and outputs data: The PRIMEQUEST 480 main unit contains one to eight IO_Units, and the PRIMEQUEST 440 main unit contains one to four IO_Units.
2.3 IO_Unit Table 2.5 IO_Unit external interfaces External interface Count Remarks Mounted on optional BMM product RS-232C SCSI Ultra320-SCSI PCI-Box interface Connected to optional PCI_Box PCI-Box interface side band 4 Connected to optional PCI_Box 2.3.1 BMM (COM port and USB port) The BMM is a board that manages input and output of a partition.
CHAPTER 2 General Hardware Configuration 2.3.3 PCI slot The PCI slot is a slot in which a PCI-X card is installed: One IO_Unit contains four slots. A PCI card is inserted into a PCI card cassette (adapter), and the cassette is inserted into the PCI slot.
CHAPTER 2 General Hardware Configuration 2.3.5 Mounting conditions of PCI cards and usable built-in I/Os 2.3.5.1 Mounting conditions of PCI cards Table 2.8 contains the mounting conditions of PCI cards for the PRIMEQUEST series. A LAN card can be mounted only in a 100-MHz PCI slot within an IO_Unit or PCI_Box.
2.3 IO_Unit Table 2.9 Priority ranks of IO_Units (within the same partition) Priority rank IO_Unit Home IO_Unit The IO_Unit with the smallest IO_Unit number among all IO Units except the home IO_Unit The IO_Unit with the IO_Unit number next smallest after that of the IO_Unit with a priority rank of 2 except the home IO_Unit The IO_Unit with the IO_Unit number next smallest after that of the IO_Unit with a priority rank of 3 except the home IO_Unit...
CHAPTER 2 General Hardware Configuration 2.3.5.2 Usable built-in I/Os The IO_Unit includes the IOs listed below. These IOs are referred to as built-in IOs. Table 2.10 contains usable built-in IOs. If two or more partitions are defined and operated, the contents in this table apply to each partition. USB port on the BMM (connected to the USB port connected to the USB connector provided on the BMM front panel, and to the KVM) Video port on the BMM (connected to the KVM video port)
2.3 IO_Unit Mounting conditions of SCSI cards and usable built-in I/Os Figure 2.8 shows an example that explains the priority ranks of IO_Units, mounting conditions of SCSI cards, and usable built-in IOs within the same partition. In the partition shown in Figure 2.8, eight IO_Units are allocated (the SB is omitted) and IOU #1 is specified as the home IO_Unit.
PCI segment mode PCI bus mode Red Hat Enterprise Linux Supported (*1) Supported Windows Server 2003, Enterprise Edition Unsupported Supported Windows Server 2003. Datacenter Edition Unsupported Supported Fujitsu recommends the PCI segment mode when Red Hat Enterprise Linux is used. 2-18 C122-B001-02EN...
2.4 Management Board (MMB) Management Board (MMB) The MMB is integrated in the main unit, and it manages the unit as a whole. The MMB has a specific CPU and memory separate from the SBs. MMB firmware runs on the MMB. The MMB firmware provides a Web interface.
100Base-TX • Used for console connection: user port • Used for maintenance - [LOCAL]: port of the Fujitsu certified service engineer - [REMOTE]: REMCS port Two MMBs are mounted to set up a redundant configuration. If one MMB fails, processing continues.
2.5 Crossbar Crossbar The crossbar provides sharing of memory in up to eight SBs and the symmetric multi- processing (SMP) system that supports 32 CPUs. It also provides the flexible I/O mechanism, which enables up to eight SBs and up to eight IO_Units to be flexibly connected.
CHAPTER 2 General Hardware Configuration 2.5.2 A chip for controlling the address bus system of the crossbar is mounted on the Xbar address interconnect board (XAI). The XAI ports connect eight SBs and eight IO_Units, and the XAI transmits address information between the ports. Two XAIs are mounted in the main unit.
2.5 Crossbar 2.5.3 A chip for controlling the data bus system of the crossbar is mounted on the Xbar data interconnect board (XDI). The XDI ports connect eight SBs and eight IO_Units, and the XDI transmits data between the ports. Four XDIs are mounted in the main unit.
CHAPTER 2 General Hardware Configuration GSWB (Gigabit Switch Board) The gigabit switch board (GSWB) is an optional product. The main unit accommodates up to two GSWBs. The GSWB functions as a Gigabit Ethernet switching hub. GSWB LAN 1Gb~8 1000 GSWB GSWB Location Power...
2.6 GSWB (Gigabit Switch Board) Connection to a Gigabit Ethernet interface The GSWB is connected to a Gigabit Ethernet interface as shown below. SB#0 Crossbar IOU#0 FLP#0 BMM#0 PXH#0 BMM#1 PXH#1 Manage- Private Manage- Private GbE SCSI SCSI ment ment GSWB#0 GSWB#1 Switching hub function...
CHAPTER 2 General Hardware Configuration KVM Interface Unit (KVM) The KVM has the function for switching between the keyboard, video, and mouse. The KVM collects the VGA interface and the three USB interfaces from IO_Units and selects one of them to provide external output. The interface that is output from the KVM is specified with the Web-UI of the MMB.
2.8 Clock and PCI_Box Control Board (CPCB) Clock and PCI_Box Control Board (CPCB) The CPCB generates system clock signals, it has a function that sends the signals to SBs, boards in IO_Units, and other boards, and it has an interface connector for controlling a PCI_Box: Two sets of clock generator circuits are mounted on the CPCB.
CHAPTER 2 General Hardware Configuration Table 2.16 CPCB external interfaces Interface Count Remarks UPC interface Connected to an external uninterruptible power supply (UPS). It can be used for the dual power feed option. PCI_Box interface Connected to a PCI_Box 2-28 C122-B001-02EN...
2.9 OPL The OPL contained in this unit has a four-LED display function. Each LED status indicates the unit status and whether a failure has occurred. The OPL has the following functions: Displaying the power status of the main unit (Power-LED) Indicating whether a unit is faulty (Alarm-LED) Identifying the unit under operation (Location-LED) Displaying the MMB status, for MMB status checks from outside the main unit...
CHAPTER 2 General Hardware Configuration 2.10 AC Section (ACS) This section explains the AC section (ACS). The ACS has a redundant configuration only for the PRIMEQUEST 440 using dual power feed. Two power distribution board (PDB) units can be connected to an ACS unit. Three power supply units (PSUs) can be connected to a PDB.
The PSU has n + 1 redundant configuration of the primary power feed as standard: The PSU supports dual power feed as an option. For PRIMEQUEST 480, the number of mounted PSUs depends on the number of mounted SBs and IO_Units.
CHAPTER 2 General Hardware Configuration Table 2.20 Number of mounted SBs and IO_Units, and PSU configuration (PRIMEQUEST 480) Number of SBs Receiving Number of Remarks and IO_Units power mode mounted PSUs configuration Four SBs and Primary power 5 + 1 redundancy...
2.12 Fan (Cooling Unit) 2.12 Fan (Cooling Unit) The fan is used to cool the unit as a whole. This unit has the following two types of fans: - Fan A (front): FANA#0 to FANA#5 - Fan B (rear): FANB#0 to FANB #1 FAN Alarm Fan_A (front) Fan_B (rear)
The PCI_Box is an optional unit for PCI slot expansion, and it is mounted in an extended I/O cabinet: Up to eight PCI_Boxes can be mounted in one PRIMEQUEST 480 main unit, and up to four PCI_Boxes can be mounted in one PRIMEQUEST 440 main unit Four PCI Slot Units (PCIUs) can be mounted in one PCI_Box.
CHAPTER 2 General Hardware Configuration Table 2.22 PCI_Box configuration for PRIMEQUEST Count at maximum Addition Maximum number configuration Unit unit PCI_Box PCI slot unit (PCIU) 4/PCI_Box 4/PCI_Box PCI slot 3/PCIU 3/PCIU The following figure is a conceptual diagram of PCI_Box connections. SB#0 #7 CPCB Crossbar...
2.14 PCI_Box 2.14.1 PCIU Three PCI cards can be inserted in the PCIU. The PCIU contains three PCI card cassettes as standard. The PCIU is connected to an IO_Unit with a PCI_Box interface cable and a PCI_Box side band interface cable. Figure 2.21 PCIU (with PCI card cassettes inserted) 2.14.2 PCI slot...
CHAPTER 2 General Hardware Configuration 2.14.3 PCI card cassette To use a PCI card in a PCI_Box in PRIMEQUEST series machines, a PCI card cassette (adapter) is required. A PCI card is mounted in a PCI card cassette, which is then mounted in a PCI_Box.
2.15 Other (Options and Other Devices) 2.15 Other (Options and Other Devices) This section describes optional products. 2.15.1 A UPS contains a battery, and it provides power to the system even in the event of a power abnormality such as a power outage. The main unit provides a power failure notification pin for receiving a power failure notification from a UPS.
CHAPTER 2 General Hardware Configuration UPS → Unit - Power failure notification - UPS hardware failure - Notification of end of battery discharge Unit → UPS - Power-on/off status Main unit AC cable UPS interface cable UPS interface card CPCB AC cable UPC0 UPC1...
CHAPTER 3 General Software Configuration This chapter describes the PRIMEQUEST software configuration. As shown in Figure 3.1, the software configuration consists of MMB firmware installed on the management board (MMB), GSWB firmware installed on the gigabit switch board (GSWB), and the software installed in each partition, such as the OS (Linux or Windows), PRIMEQUEST Server Agent (PSA), and related software.
CHAPTER 3 General Software Configuration Firmware This section describes the different types of PRIMEQUEST firmware. 3.1.1 Processor Abstraction Layer (PAL) PAL is part of the Itanium architecture, and it abstracts the functions unique to IPF CPU hardware to higher layers. PAL encapsulates processor functions that may vary from one IPF CPU to another.
3.2 OS (Linux or Windows) 3.1.5 MMB firmware MMB firmware is incorporated in the MMB. MMB firmware is linked with different types of firmware (e.g., PAL/SAL/EFI, BMC firmware, and GSWB firmware) for operations such as managing the entire PRIMEQUEST hardware configuration, managing partition configurations, hardware monitoring, and power control.
CHAPTER 3 General Software Configuration 3.2.1 Linux Linux supports large-scale enterprise environments that require high reliability: (1) Support of large-scale systems Linux supports construction of large-scale systems by increasing scalability with the following functions: • 64-bit virtual space Large-scale business applications can be developed without consideration of the virtual space size.
3.3 Supplied Software 3.2.2 Windows PRIMEQUEST supports Microsoft Windows Server 2003 and its subsequent versions. Supplied Software The software programs supplied as standard with the PRIMEQUEST-series machines are described below. The software is installed and used in individual partitions. For details on the supplied software, see Appendix A, "Software Supplied with PRIMEQUEST Hardware."...
CHAPTER 3 General Software Configuration 3.3.4 System data output tool (fjsnap) fjsnap collects the system information (e.g., configuration information, operation information, definition information, and logs) required for a failure investigation in the event of a PRIMEQUEST system failure. This software can run in Linux. Linked Software This section describes optional software that can be used in linkage with the PRIMEQUEST-series machines.
- VERITAS NetBackup - NetVault - Softek ACM - NetWorker - Softek TSM For details on backup and restoration, see CHAPTER 10, "Backup and Restoration." Remarks: Access the Fujitsu Web site to confirm the latest information on linkage software. C122-B001-02EN...
CHAPTER 4 Hardware System Management This chapter describes the basic mechanism of hardware system management, the functions of the management board (MMB) that is thecore component that performs total hardware management, and the functions of the PRIMEQUEST Server Agent (PSA) that monitors each partition to be managed. Basic Mechanism MMB Functions PSA Functions...
Page 108
CHAPTER 4 Hardware System Management The MMB manages the mounted components (SBs, IO_Unit, chip sets, power supply units, fans, LANs, etc.) and partitions, and controls the system clock, management LAN and private LAN, and PCI_Box. The MMB sets various types of operations such as console redirection, KVM switching, and mirror mode.
The management LAN is provided for system management purposes and has external ports for the user (system administrator), Fujitsu certified service engineer, and remote customer support system (REMCS) on the MMB. The private LAN is provided for internal control of the system.
CHAPTER 4 Hardware System Management Each partition is connected to the GSWB through the intra-cabinet LAN, called the business LAN, and then connected to a LAN outside of the cabinet through the GSWB. The business LAN is provided for the business system. The GSWB manages the network of the entire business LAN.
Page 111
LAN. - User port For management purposes such as connecting an external management server and using the operation console - Fujitsu certified services engineer’s port For connection to a maintenance terminal - REMCS port For connection to the REMCS Center...
The hub for the management LAN can be found on the MMB. On this hub, cables for each partition network, user port, Fujitsu certified service engineer's port, and REMCS port are concentrated and the Virtual LAN (VLAN) function is mounted.
4.1 Basic Mechanism Table 4.2 Inter-partition communication disconnection mode (VLAN mode) Fujitsu certified REMCS VLAN mode User port service Partition ports port engineer's port User port Fujitsu certified service engineer's port REMCS port Partition ports All-partition communication disconnection mode (Port disable mode) This mode is provided for enhancing security.
CHAPTER 4 Hardware System Management 4.1.1.2 Private LAN The configuration of the private LAN is shown in Figure 4.3. GSWB GSWB SB#0 Crossbar IOU#0 FLP#0 BMM#1 BMM#0 PXH#0 PXH#1 Manage- Private Manage- Private GbE SCSI SCSI ment ment Hub for management LAN Hub for private LAN Hub for management LAN Hub for private LAN...
4.1 Basic Mechanism 4.1.1.3 Business LAN The business LAN is used for configuring the user's business system. The following two methods are available for building a business LAN in an external device: - Mount a GSWB to use the switching hub function. Manage and operate the GSWB by using the MMB Web-UI.
CHAPTER 4 Hardware System Management 4.1.2 IP addresses of PRIMEQUEST management LAN The PRIMEQUEST management LAN uses the IP addresses shown in Figure 4.5. IOU#0 IOU#7 BMM#1 BMM#1 BMM#0 BMM#0 IP = IP = 192.168.1.1 192.168.1.8 VIP = 192.168.1.102 MMB#0 MMB#1 IP = IP =...
Page 117
4.1 Basic Mechanism If GSWB CLI operation or SNMP access is performed from the business LAN side, this IP address is not assigned but the subnet IP address on the business LAN side is assigned. • IP address set by the OS on a partition Each of IO_Units from IOU #0 to IOU #7 has one IP address.
CHAPTER 4 Hardware System Management MMB Functions The MMB functions are indicated by MMB in Figure 4.6 in which all of the PRIMEQUEST functions are shown. This section describes the MMB functions. The MMB functions include the switching function for using the PSA and GSWB functions.
4.2 MMB Functions 4.2.1 User privilege management The user privileges necessary for accessing the MMB are classified as follows. System account elements such as a user name and a user privilege need to be registered. Users can use functions corresponding to their access privileges. - User ....A user having this privilege is allowed only to reference the system state.
CHAPTER 4 Hardware System Management 4.2.2 Hardware configuration display This function displays the configuration and state of hardware. This function displays the configuration of all components such as SBs and IO_Units including fans and power supply units mounted in the PRIMEQUEST system and units in the components such as CPUs, memory, and HDDs.
4.2 MMB Functions 4.2.3 Hardware monitor This function monitors for hardware failures and errors. Hardware failures and errors are detected by various types of check mechanisms and sensors. If a failure or an error is detected, the required corrective action must be taken according to the location where the failure or error was detected, and the elements of the system configuration in place, such as mirror mode, redundant configuration, and the like.
4.2 MMB Functions 4.2.4 Partition settings and configuration display This function is used to set a partition and display its configuration. Partition settings are used to divide mounted hardware resources and to determine the units of control management.Figure 4.10 shows an example in which three partitions are set. PRIMEQUEST A mixture of different OSs (Linux and Windows) and different versions in the cabinet is allowed.
CHAPTER 4 Hardware System Management Figure 4.11 Example of display of the partition configuration screen 4.2.5 KVM/USB connection switching This function switches the connection destinations of the KVM, a component for connecting the keyboard, mouse, display, and DVD drive. As shown in Figure 4.12, arbitrary partitions comprise the connection destinations.
4.2 MMB Functions PRIMEQUEST n = 0 to 15 Partition#n Partition#1 Partition#0 A partition to which the KVM is connected is switched. Web-UI Management LAN Connection switching instruction Figure 4.12 KVM/USB connection switching Figure 4.13 Example of the KVM/USB individual connection switching setting screen C122-B001-02EN 4-19...
CHAPTER 4 Hardware System Management 4.2.6 Console redirection This function sets I/O destinations of each partition's console information through an management LAN. The two methods below are available for OS input and output in each partition. These methods can be set independently in each partition: Using the COM port of the IO_Unit incorporated in each partition Using the management LAN through the MMB Figure 4.14...
CHAPTER 4 Hardware System Management 4.2.7 MMB use environment setting This function sets and changes the MMB use environments. • Centralized system account The MMB and GSWB support interfaces such as Telnet and Web-UI and their system accounts are managed centrally by the MMB. The MMB also performs GSWB user authentication.
4.2 MMB Functions Figure 4.17 Example of setting the usage evironment Access control To ensure security, an IP filter for permitting access to the MMB is set up. (Usable IP addresses are specified for each protocol.). Access to the MMB is allowed only from the set IP addresses.
CHAPTER 4 Hardware System Management 4.2.8 Time synchronization To assure synchronization among partitions, this function synchronizes the partition times with that of the MMB. The NTP server function and the NTP client function are used to synchronize partition times with the MMB time. As shown in Figure 4.19, synchronization with the NTP server time is possible by accessing the external NTP server.
Figure 4.20 Example of the scheduled operation display screen 4.2.10 Firmware maintenance This function updates various types of firmware. The update is performed by Fujitsu certified service engineer. The following firmware components are subject to update: - MMB firmware (installed in the MMB)
CHAPTER 4 Hardware System Management 4.2.11 Setting information save and restore This function saves and restores PAL/SAL/EFI setting information for each partition and MMB setting information. Separate PAL/SAL/EFI settings are required for each partition. However, using the PAL/SAL/EFI SETUP screen to make the settings in each partition is complicated, so as shown in Figure 4.21, the MMB provides a save and restore function for PAL/SAL/...
Page 133
4.2 MMB Functions Partition#m Partition#m Partition#n Partition#n PAL/SAL/EFI PAL/SAL/EFI Restore Restore Save Save PAL/SAL/EFI PAL/SAL/EFI Configuration and setting Configuration and setting setting information setting information setting information setting information information can be saved and information can be saved and restored. restored.
CHAPTER 4 Hardware System Management PSA Functions The PSA functions are indicated by PSA in Figure 4.22 which shows all of the PRIMEQUEST functions. This section describes each PSA function. Remarks: If a PRIMEQUEST series machine is operated, be sure to install the PSA. If the PSA is not installed, the following restrictions apply: •...
4.3 PSA Functions Figure 4.22 PSA functions 4.3.1 Operation management GUI This function is a Web-UI function that can be used to manage partition operation. By linking the PSA in each partition to MMB firmware, the partition can be displayed and operated via the MMB Web-UI without a Web server function at the partition end.
OS console, are provided by the Command Line Interface (CLI). For details, see the PRIMEQUEST 480/440 Reference Manual: GUI/Commands (C122-E003EN). - SAF_TE operation command (used by a Fujitsu SE when hot swapping disks) - PSA start/stop command - PSA survey data collection command...
4.3 PSA Functions 4.3.2 Hardware configuration management This function displays the hardware resources that form a partition. This function displays the following configuration information: - SB configuration, IOU configuration - CPU configuration (maximum number of CPUs which can be mounted, CPU mounting locations, identification information such as the CPU type, error status information) - Memory configuration (mounting locations, detailed information such as the...
CHAPTER 4 Hardware System Management 4.3.4 Hardware error monitoring PSA monitors the partition for errors output by PCI cards and SCSI device drivers, and periodically monitors predictive signs detected by the S.M.A.R.T. (Self- Monitoring Analysis and Reporting Technology) function of the hard disk. When an error is detected, error analysis is performed to identify the unit.
CHAPTER 4 Hardware System Management 4.3.5 Log collection, analysis, and display This function collects, analyzes, and displays logs related to the hardware error monitoring function. When various types of events and messages are posted from firmware, various types of drivers, and the OS, this function records them in log files and takes a predefined action (notification by e-mail, notification to the REMCS, and log output).
OS on the partition to the REMCS Center via the MMB firmware. The PSA also reports software configuration information and software error information detected by the SIRMS to the REMCS Center via the MMB firmware. For information on REMCS, see Appendix C in the PRIMEQUEST 480/440 Operation Manual (C122-E002EN). C122-B001-02EN...
CHAPTER 4 Hardware System Management PRIMEQUEST REMCS Center Partition#n Partition#n Error notification, etc. Error notification, etc. REMCS Agent REMCS Agent SIRMS MMB-FW MMB-FW Error notification, etc. Error notification, etc. Linux/Windows Linux/Windows Management LAN System administrator Figure 4.25 REMCS linkage 4.3.8 PRIMECLUSTER linkage This is the linkage with the PRIMECLUSTER clustering software.
4.3 PSA Functions - Event reception from another system..Receives a status change of a remote node. - Instruction to another system ....Issues an instruction to the specified remote node. As shown in Figure 4.26, control information is taken over from the active system to the standby system to continue operation.
CHAPTER 4 Hardware System Management 4.3.9 Operation management software linkage This function enables a linkage with operation management software. Figure 4.27 shows software that is installed on a partition and that can work with the PSA. The function enables the PSA to work with operation management software such as Systemwalker.
CHAPTER 5 Business LAN Management by GSWB A GSWB (optional) provides frame relay on the data link layer (layer 2) and related functions by using a dedicated CPU and memory. GSWB firmware is installed in the GSWB, and controls the GSWB. GSWB firmware is used via MMB firmware.
Page 146
CHAPTER 5 Business LAN Management by GSWB Item Description Remarks CoS function IEEE802.1p Priority control function Priority with four steps (maximum) Port ranking function IEEE802.3ad Link aggregation function Spanning tree function IEEE802.1D Supported by software control IGMP snooping IGMPv1 (RFC1112) Supported by software control IGMPv2 (RFC2236) Jumbo frame...
5.1 GSWB Specifications 5.1.1 Communication function support list The communication function support list for a business LAN is shown below. Table 5.2 Communication-related function support list Function Business LAN Unit MAC address Unit IP address Number of L2 address entries 16 K Flow control Auto-sense/auto-negotiation...
CHAPTER 5 Business LAN Management by GSWB Main GSWB Functions The main GSWB functions are shown in the GSWB box included in the main PRIMEQUEST functions shown in Figure 5.1. This section describes the GSWB functions. Figure 5.1 Main PRIMEQUEST functions C122-B001-02EN...
5.2 Main GSWB Functions 5.2.1 Physical layer functions 5.2.1.1 Function overview A GSWB, which is a layer 2 LAN switch blade, has 16 Gigabit Ethernet ports on the Backplane side and eight Gigabit Ethernet ports on the Front side. Table 5.3 Interface overview LAN type Location Interface Number of ports...
CHAPTER 5 Business LAN Management by GSWB 5.2.1.3 Details of the functions Details of the GSWB-supported functions are described below. Maximum frame length of transmittable frame The maximum frame length (size from MAC DA to FCS) of a frame that this unit can transmit is listed below.
5.2 Main GSWB Functions Auto-sense and auto-negotiation functions The auto-sense and auto-negotiation functions are available. Auto-sense is a function for the port itself, for detecting the speed of a connected unit. Auto-negotiation, which is a protocol between two units stipulated in IEEE802.3u, sets the communication speed, the communication mode (full duplex or half duplex), and whether to use the flow control function.
CHAPTER 5 Business LAN Management by GSWB • auto-MDI/MDI-X function The auto-MDI/MDI-X function is provided as a function of automatic negotiation. When the automatic negotiation function is enabled, the auto-MDI/MDI-X function is also enabled. Flow control function If the network load increases, the amount of input data may exceed the throughput of the unit, and data may overflow from buffer memory.
5.2 Main GSWB Functions • Support functions Back pressure Back pressure is a method for retaining transmission of a sender by generating a dummy collision. Back pressure can be specified for half-duplex communication. PAUSE frame function The PAUSE frame function sends a PAUSE frame using the MAC control mechanism.
CHAPTER 5 Business LAN Management by GSWB Jumbo frame function The GSWB supports the jumbo frame function. A frame size that exceeds 1514 bytes, which is the maximum frame size according to the Ethernet standard, is referred to as a jumbo frame. It is expected that enabling jumbo frames will increase the throughput, because this allows increasing the size of data items that can be transferred at the same time, and reducing the number of times data is transferred.
5.2 Main GSWB Functions Rate control function The GSWB supports the rate control function. The rate control function protects packets against network failures caused by storms. With respect to packets for broadcast, multicast, and Destination Lookup Failure (DLF), it is possible to discard frames greater than or equal to a threshold value on a PPS basis for each port.
CHAPTER 5 Business LAN Management by GSWB 5.2.2 MAC bridge function A GSWB supports the MAC bridge function complying with IEEE802.1D. The MAC bridge function relays frames between MAC sublayers in transmission lines that differ up to Media Access Control (MAC). The MAC layer is a lower sublayer of the data link layer.
5.2 Main GSWB Functions 5.2.3 Spanning tree function This function determines the dynamic relay path of a bridge relay as stipulated in IEEE802.1D. This function is used when a bridge network that has multiple paths between two points is created. The spanning tree protocol automatically constructs tree-formed logical paths (spanning tree) including all switches based on message exchanges between switches.
CHAPTER 5 Business LAN Management by GSWB 5.2.4 VLAN function The GSWB provides a VLAN function complying with IEEE802.1Q. A virtual LAN (VLAN) is a system that enables setting up a logical network configuration in contrast to a conventional system that depends on a physical network configuration.
5.2 Main GSWB Functions Tag method PRIMEQUEST Application server Web server DB server Server for development Partition#0 Partition#1 Partition#2 Partition#3 GSWB GSWB Internet Firewall To identify packets, additional information referred to as a tag is added to the header of packets that transit. Group 1 Group 3 - Ensuring security...
CHAPTER 5 Business LAN Management by GSWB Table 5.12 How transmission and receiving are handled depending on port setting statuses and frame types PVID Port status Port VLAN Tag VLAN (at tag VLAN) Frame type DOWN DOWN DOWN With a The same VLAN Unavailable Available...
5.2 Main GSWB Functions 5.2.5 Priority control function This function performs priority processing of traffic. Class of Service (CoS) is information stored in a field in the VLAN tag of a MAC frame. CoS is standardized by a standard, and indicates the priority of frames. Based on this value, priority can be controlled as shown in Figure 5.6.
CHAPTER 5 Business LAN Management by GSWB 5.2.6 Port ranking function This function binds multiple ports to handle them like a single port. As shown in Figure 5.7, this function groups two or more ports, makes them operate as a single port, and allocates an IP address to the grouped port. This function has two major advantages.
5.2 Main GSWB Functions 5.2.7 IGMP snooping This function monitors whether to join a multicast group. Internet Group Management Protocol (IGMP) snooping is a filtering function to relay multicast data only to the required switch port. As shown in Figure 5.8, a switch that does not support IGMP snooping broadcasts multicast stream to all ports.
CHAPTER 5 Business LAN Management by GSWB 5.2.8 Port mirroring This function mirrors the replication of frames that transit on the specified port to another port. Specify a port as a mirror port, and another port as a port to be monitored. The replication of frames that transit on the monitored port is passed to the mirror port.
5.2 Main GSWB Functions 5.2.9 Statistical information and log information function This function displays statistical information and log information. As statistical information, it is possible to display the number of transmitted and received frames and the number of error frames of the entire unit or for each port. As log information, the following items can be displayed.
CHAPTER 5 Business LAN Management by GSWB 5.2.11 Managing units and others The GSWB provides operating management functions and maintenance functions in its function as a server. The main functions are as follows: Telnet functions Remote log-in functions Secure Shell (SSH) functions The functions (server/client functions) for improving security at remote log-in are supported.
5.3 Notes on System Design Notes on System Design 5.3.1 Learning table The GSWB has the switching function, which creates a learning table for automatically recording connection information indicating which port is connected to which IO_Unit port. The age-out function deletes the old connection information when ports are moved such as because of a partition reconfiguration.
CHAPTER 5 Business LAN Management by GSWB Actual age-out time = Specified aging time + α Deletion O t ^ O t ^ Learning Flag assignment MAC address learning ¿ Specified aging time Specified aging time Learning table monitoring Monitoring Monitoring - The monitoring interval is the specified aging time.
5.3 Notes on System Design Entry deletion from the learning table An entry is deleted from the learning table when one of the following conditions is met. Table 5.13 Conditions under which an entry is deleted from the learning table Item Deletion conditions Deletion of an entry...
CHAPTER 5 Business LAN Management by GSWB 5.3.2 Relay-inhibited frame A relay-inhibited frame is a frame that IEEE802.1D specifies to not be relayed. Some examples are the BPDU and PAUSE frames. The following explains the processing to be performed when the GSWB receives these relay-inhibited frames.
5.3 Notes on System Design Table 5.15 Addition of a VLAN Tag to BPDU BPDU Output port Source BPDU Output BPDU filter VLAN setting Enable Port VLAN Without a VLAN Tag Tag-VLAN Disable Without a VLAN Port VLAN Without a VLAN Tag With a VLAN Tag Port VLAN With a VLAN Tag...
CHAPTER 5 Business LAN Management by GSWB VLAN Tag of mirroring frame This section explains the VLAN Tag of the mirroring frame. VLAN 10 Port A Port B Port C Figure 5.11 VLAN Tag of mirroring frame Monitored port: Port B transmission/reception Mirror port: Port C Frames are transferred between ports A and B.
5.3 Notes on System Design Table 5.18 VLAN Tag of mirroring frame (transfer from port B to port A) Port A Port B Port C Receiving a frame without a tag Sending a frame without Frame without a tag a tag Receiving a frame with a VLAN Following the setting of Frame with a VLAN 10 tag...
CHAPTER 5 Business LAN Management by GSWB Speed on one side is fixed to 10 Mbps and Speed on the other side is fixed to 100 Mbps. Linkup may be successful on the side fixed to 10 Mbps but normal communication is disabled.
CHAPTER 5 Business LAN Management by GSWB Table 5.22 Example of load distribution Source MAC address of send Modulo result Destination port frame 00:0B:5D:70:80:01 00:0B:5D:70:80:02 00:0B:5D:70:80:03 00:0B:5D:70:80:04 00:0B:5D:70:80:05 00:0B:5D:70:80:06 00:0B:5D:70:80:07 00:0B:5D:70:80:08 00:0B:5D:70:80:09 00:0B:5D:70:80:0A 5.3.7 Other notes Port linkup time When the external ports (GigabitEthernet 0/1 to 0/8) are set to auto-negotiation (default) and connected to the 1G-bit ports, the linkup timing of all ports at startup may vary by about five seconds.
5.3 Notes on System Design STP setting for VLAN When VLAN is divided to avoid a loop, set STP to off. STP operates for each device. Even when VLAN is divided, STP determines a loop and blocks one port. GSWB VLAN2 Port A Port B...
Page 178
CHAPTER 5 Business LAN Management by GSWB 5-34 C122-B001-02EN...
CHAPTER 6 Redundant Configuration Redundant configuration refers to a configuration where even if some components making up the hardware configuration fail, the remaining components maintain adequate throughput. PRIMEQUEST provides redundant configuration for most elements of the hardware configuration, such as memory, CPUs, IO_Units, chip sets, transmission lines, and power units, to achieve high reliability and high availability.
Redundant configuration possible depending on operation. is possible. Figure 6.1 General redundant configuration (1) PRIMEQUEST 480 This part describes redundant configuration of the following components for the PRIMEQUEST 480 family. • System Board (SB) From one to up to eight SBs can be mounted. Redundant configuration can be adopted depending on the operation methods.
Page 181
6.1 Redundancy of Components • Xbar Data Interconnect board (XDI) An XDI is a board on which ASIC (GDX) that controls data paths of the crossbar is mounted. An XDI has ports to connect to SBs and IO_Units, and transfers data between ports.
FAN tray. (2) PRIMEQUEST 440 Redundant configuration is the same as for the PRIMEQUEST 480 family. Redundancy of Private LAN and Management The management board (MMB) manages the PRIMEQUEST system as a whole.
Page 183
CPUs of an MMB are also connected to an management LAN. An management LAN has three external interface ports. Two ports are allocated for maintenance tasks performed by Fujitsu certified service engineers and REMCS. The remaining port can be used to connect to a console unit, or for connection between nodes across cabinets in a cluster configuration.
CHAPTER 6 Redundant Configuration Redundant configuration is also adopted for management LAN interfaces for each partition. A port is connected to MMB #0 and a port is connected to MMB #1. A virtual IP address to be shared is assigned to these ports as well, and a communication destination unit can continue operation without having to give consideration to the redundant status.
6.3 System Mirror System Mirror The PRIMEQUEST System Mirror duplicates main server components, such as, memory, an address crossbar (XAI), a data crossbar (XDI), or a chip set, and reads data from and writes data to both components at the same time. Since hardware components and read/write are duplicated, even if a hardware component fails, operation can be continued without stopping the system.
6.3 System Mirror Mirroring of memory In System Mirror, memory is divided into two groups for mirroring. Therefore, the logical memory capacity becomes half of the physical memory capacity installed. However, data read and write operation is duplicated and performed simultaneously. Thus, even in the case where a part of memory fails, the operation continues using the rest of the memory.
CHAPTER 6 Redundant Configuration Redundancy of an HDD (Use of PRIMECLUSTER GDS) This section describes the redundant configuration for a HDD. In the PRIMEQUEST series, an IO_Unit includes SCSI controllers, each of which has its own system. Each SCSI controller connects to two HDDs. An IO_Unit has four PCI cassette slots.
6.4 Redundancy of an HDD (Use of PRIMECLUSTER GDS) 6.4.1 Redundancy provided to system disk drives PRIMEQUEST supports software mirroring of internal HDDs and system disks as an option. To support this function, optional software is required. Linux supports mirroring using PRIMECLUSTER Global Disk Services (GDS), which is provided as an optional software product.
CHAPTER 6 Redundant Configuration Configuration providing redundancy of an HDD and a SCSI controller Figure 6.8 shows a configuration providing redundancy of an HDD and a SCSI controller. In this configuration, HDD-SCSI controller PXHs are mirrored. I/O paths including FLP and FLI are not mirrored. SB#0 SB MMB Memory...
6.4 Redundancy of an HDD (Use of PRIMECLUSTER GDS) HDD redundant configuration where all I/O paths are mirrored Figure 6.9 shows a HDD redundant configuration where all I/O paths are mirrored. SB#0 SB MMB Memory Memory LDX LDX LDX LDX .
CHAPTER 6 Redundant Configuration 6.4.2 Redundancy of external storage Mirroring between cabinets PRIMECLUSTER GDS supports mirroring between cabinets. This, however, does not include the case where a disk is used as a system disk. Figure 6.10 shows an example where mirroring between cabinets is enabled using external SCSI ports incorporated in an IO_Unit.
CHAPTER 6 Redundant Configuration Redundancy of the Business LAN (Use of PRIMECLUSTER GLS) If MMBs and GSWBs are duplicated, networks in a PRIMEQUEST cabinet, such as the management LAN, the private LAN, and the business LAN are also duplicated. This section describes the implementation of redundancy for a business LAN as related to the construction of a business system.
PRIMEQUEST, PRIMERGY, PRIMEPOWER, GP7000F, FUJITSU S series, and GP-S units. When this method is used, the unit cannot communicate with a host on a different network across a router.
CHAPTER 6 Redundant Configuration Figure 6.13 High-speed switching method 6.5.2 Duplication between a server and a hub and between switches on the same network (NIC switch method) In the NIC switch method, as shown in Figure 6.14, duplicated Network Interface Card (NICs) are connected on the same network, and switch of transmission lines is controlled by exclusive use.
6.5 Redundancy of the Business LAN (Use of PRIMECLUSTER GLS) With this method, as shown in Figure 6.15, duplicated NICs are connected on the same network, and switching of transmission lines is controlled by exclusive use (during normal operation, put one NIC in the "up" status for communication). A TCP/IP application can communicate with a destination system without having to take into consideration switching of NICs, by using the IP address set in the physical interface in the "up"...
CHAPTER 6 Redundant Configuration Degradation Function If a hardware abnormality is detected in the hardware power-on diagnosis or during system operation, the degradation function stops the faulty hardware and has the system inherit the operation with the remaining hardware. Degradation reservation is the act of notifying a MMB about hardware that caused more correctable errors than the threshold in a given period, and that is likely to fail.
CHAPTER 7 Hot Swapping Hot Swappable Components Figure 7.1 shows the layout of components included in PRIMEQUEST series machines. Table 7.1 lists whether hot swapping and/or redundant configuration is available for components. FAN_A#1 FAN_A#3 FAN_A#5 FAN_B#1 FAN_A#0 FAN_A#2 FAN_A#4 FAN_B#0 Figure 7.1 Layout of included components C122-B001-02EN...
Page 201
7.1 Hot Swappable Components Table 7.1 Component hot swapping and/or redundant configuration availability Redundant Notes on redundant Item Component swapping configuration configuration Y (optional) Redundancy by the reserved SB function Memory (DIMM) Redundancy is ensured when System Mirror is set. IO_Unit A redundancy function that is ensured by hardware alone is not...
Page 202
CHAPTER 7 Hot Swapping Redundant Notes on redundant Item Component swapping configuration configuration PCI card Redundancy is ensured depending on the operation. IO_PSU Y = Available, N = Unavailable (1) SB The reserved SB function enables a redundant configuration. System Mirror enables DIMM mirroring (redundant configuration).
Page 203
7.1 Hot Swappable Components (3) Memory (DIMMs) Memory (DIMM) cannot be subjected to hot swapping. Stop the partition that includes the SB containing the failed DIMM, extract the SB containing the failed DIMM, and replace the failed DIMM. A redundant configuration is enabled when System Mirror is set. If a DIMM fails, the system containing the failed DIMM stops, and operation continues with the other normal system alone.
Page 204
CHAPTER 7 Hot Swapping (7) PCI cards Hot swapping is available. A redundant configuration is also available using mirroring software (such as PRIMECLUSTER GDS). Hot swapping is available while a PCI card is cassette inserted in a PCI cassette. (8) BPs Redundant configuration is not adopted, and hot swapping is not available.
Page 205
7.1 Hot Swappable Components (10) XDIs A redundant configuration and hot swapping are available while System Mirror is enabled. They are not available when System Mirror is not set. When the operation is performed in System Mirror: Two XDI systems form a redundant configuration. If an XDI fails, the failed XDI is automatically isolated from the system operation configuration, and the operation continues with the other normal XDI in degradation mode without a reboot.
Page 206
CHAPTER 7 Hot Swapping (15) GSWBs Redundant configuration and hot swapping are available. If two GSWBs are mounted and redundant operation is performed by LAN redundancy software (PRIMECLUSTER GLS), hot swapping is available. (16) OP Panels Redundant configuration is not adopted, but hot swapping is available. (17) PSUs Redundant configuration is adopted, and hot swapping is available.
Page 207
7.1 Hot Swappable Components (23) IO_PSUs Redundant configuration is adopted, and hot swapping is available. C122-B001-02EN...
CHAPTER 8 Partition This chapter describes the partition function the PRIMEQUEST provides and the following items that are required to determine a system configuration: Overview of Partitions Partition Configuration Definition Points to Consider when Determining Configurations Function for Changing Partition Configurations Notes to Observe when Configuring Partitions Overview of Partitions The PRIMEQUEST series allows one system to be divided into multiple systems,...
CHAPTER 8 Partition SB MMB Crossbar IOU IOU IOU IOU IOU IOU IOU IOU Partition#0 Partition#1 Partition#2 Figure 8.1 Example of partition configuration 8.1.1 Mounting requirements When a partition is defined as a combination of SBs and IO_Units, the individual mounting requirements of these units must be met.
8.1 Overview of Partitions 8.1.1.2 Mounting requirements of IO_Units When defining partitions, ensure that the following mounting requirements are fulfilled: The partition must include one IO_Unit having a BMC module (BMM) mounted. When a partition contains two or more IO_Units with an MBB mounted on each , only one BMM actually operates.
To do this, first, create a partition having a specific partition ID (PartitionName) , and then register SBs and IO_Units belonging to the partition on the [Partition Configuration] screen of the MMB Web-UI. For information on the setting procedure, see the PRIMEQUEST 480/440 Installation Manual (C122-E001EN). Figure 8.3 Partition Configuration screen...
8.3 Points to Consider when Determining Configurations Points to Consider when Determining Configurations This section describes the points to consider when determining the configuration and operation of partitions. The partition configuration must be determined by considering the requirements of each system. 8.3.1 SB and IO_Unit maintenance policy The system administrator must determine whether to use the hot swapping function...
8.3 Points to Consider when Determining Configurations 8.3.4 Notes on the memory configuration The SB requires at least one CPU operating normally and one set of memory (DIMM × 4) operating normally. Consequently, if the memory degrades due to detection of an error in the memory and no set of memory operating normally is available, the entire SB is degraded.
The partition configuration of PRIMEQUEST series machines is changed using the [Partition Configuration] screen of the MMB Web-UI. For details of the operation, see the PRIMEQUEST 480/440 Operation Manual (C122-E002EN). Remark: Change of the partition configuration is applied by power-off and subsequent power-on, or reboot in units of partitions.
CHAPTER 9 Clustering This chapter describes clustering and items required to configure a cluster system. To perform the cluster operation of the PRIMEQUEST, the clustering software PRIMECLUSTER is required. For details of PRIMECLUSTER, see the relevant PRIMECLUSTER manuals. The basics of clustering PRIMECLUSTER Cluster Functions Provided in Linux Environments The basics of clustering...
CHAPTER 9 Clustering For inter-node communication of management information on the PRIMEQUEST cluster system, a management LAN of 100 Mbps is used. As with the MMB that monitors errors in each node, the management LAN is duplicated. Because an error during communication to each node and an error in the MMB may otherwise cause the entire system to stop, the management LAN and MMB are duplicated to increase the reliability of the system.
9.1 The basics of clustering N:1 standby One standby node is prepared for multiple active nodes. Since only one standby node is required for multiple active nodes, a cluster system with good cost-performance can be constructed. Standby A Standby A Error Error Active A...
CHAPTER 9 Clustering Cascade Multiple standby nodes are prepared for one active node. When one node stops, the remaining nodes provide a redundant configuration, thereby maintaining availability during periodical maintenance tasks, etc. Error Error Standby A Standby B Active Standby Active When node A is...
9.2 Cluster Functions Provided in Linux Environments Cluster Functions Provided in Linux Environments 9.2.1 Cluster Configurations Two types of PRIMEQUEST cluster configuration are available: Intra-cabinet cluster and inter-cabinet cluster. 9.2.1.1 Inter-cabinet cluster configuration For the inter-cabinet cluster configuration, the cabinet is treated as one node or multiple nodes to construct a cluster system.
CHAPTER 9 Clustering Cabinet Cabinet S B#0 S B#1 S B#2 S B#3 S B#0 S B#1 S B#2 S B#3 Crossbar Crossbar IOU#0 IOU#1 IOU#0 IOU#1 MMB#0 MMB#1 MMB#0 MMB#1 GSWB GSWB GSWB GSWB Fabric SW RAID : CPU : Chipset : Memory : Business LAN...
IO_Units and mirroring is applied by the PRIMECLUSTER Global Disk Services (GDS). Two separately mounted IO_Units increase the resilience against failures. Inter-system paths are connected via the GSWB. In this configuration, Fujitsu recommends disabling the spanning tree protocol (STP). Cabinet...
CHAPTER 9 Clustering 9.2.2 PRIMECLUSTER PRIMECLUSTER is a software product for constructing a cluster system. PRIMECLUSTER virtualizes system-configuring elements such as servers, storage, networks, and middleware, and enables job processing to be continued autonomously by error detection, failover (job takeover), and degradation functions to implement high reliability of the entire system.
9.3 Cluster Functions Provided in Windows Environments Cluster Functions Provided in Windows Environments Windows Server 2003 supports cluster functions as standard features of the operating system. This section explains Microsoft Cluster Service (MSCS), which is provided by Windows Server 2003. A cluster system consisting of up to eight partitions (*1) can be configured with Windows Server 2003.
CHAPTER 9 Clustering Network configuration The nodes that belong to a cluster are connected via a dedicated LAN to ensure that they can monitor errors encountered by any of the other nodes and that data consistency can be maintained among the nodes. This network is called a private network.
9.4 Points to be Considered at Cluster System Installation 9.3.4 Notes on construction MSCS construction requires a separate environment for the Windows Server 2003 directory service (Active Directory). You can use the cluster construction service for the Active Directory and MSCS construction. Points to be Considered at Cluster System Installation This section discusses points to be considered before determining a cluster...
CHAPTER 9 Clustering Cluster operation by using a flexible I/O component and reserved SB Using a flexible I/O component and reserved SBs in a cluster configuration can shorten the time required for restoration to normal cluster operation even if a failure occurs in an SB.
Page 233
9.4 Points to be Considered at Cluster System Installation Processing at failure occurrence Clustering If a failure occurs in the active node, the cluster system recognizes the failure and the standby node takes over job processing. The standby node must check the consistency of the taken over data.
CHAPTER 10 Backup and Restoration This chapter describes the importance of backing up data, backup methods, and restoration methods. 10.1 Importance of Backing Up Data PRIMEQUEST uses components and hardware with high reliability and duplicates many units to maintain high reliability. To be prepared for failure occurrences, however, be sure to back up data periodically.
CHAPTER 10 Backup and Restoration The methods above include a method that uses a backup server with a backup unit. Contact a Fujitsu sales representatives and prepare the backup software program and the backup server. An overview of each backup and restoration method is provided below.
Page 237
#0). A serial console or KVM console can be used as the OS console. When this method is used, the network needs to have been activated. For the data transmission line, Fujitsu recommends using a LAN exclusively prepared for backup purposes. It is also possible to use the management LAN.
Page 238
CHAPTER 10 Backup and Restoration For Windows: If data in Partition #0 is backed up, it is necessary to use NTBackup on the remote host side (Partition #n) for the backup and restoration work. First, perform remote-login to Partition #n from Partition #0 that is connected to the KVM console by using remote desktop connection.
10.2 General Methods of Backup and Restoration 10.2.2 Cloning software (SystemcastWizard Lite) A cloning software program (SystemcastWizard Lite) is a tool for easily installing a system on multiple computers and performing maintenance in a short time. SystemcastWizard Lite can save the hard disk image of the system to be backed up to a deployment server via a network, and also recover and expand the image back to the target system.
Page 240
CHAPTER 10 Backup and Restoration Note: • Since deployment server console has an interface for direct exchanging information with an MMB, it needs to connect to the management LAN. Place deployment server console in the same segment as the PRIMEQUEST system. ((a) terminal for an MMB console can be used also when placed in another segment.) •...
10.2 General Methods of Backup and Restoration 10.2.3 Backup software (Softek ACM, VERITAS NetBackup, NetVault, NetWorker, Softek TSM) To design a schedule for backup in conformity with basic business operations, and to back up data in a database operation in cooperation with database software, use a backup-dedicated software program.
CHAPTER 10 Backup and Restoration ACM Agent Controls the AdvancedCopy function of the ETERNUS. ACM Agent is installed in the business server that is a backup target. ACM Tape Server Controls the tape library and the backup to and restoration from tape media. The tape library is connected to a partition in which ACM Tape Server is installed.
10.2 General Methods of Backup and Restoration • Online backup of a DB (Oracle) For Oracle, Recovery Manager (RMAN) provided by Oracle becomes the interface to the DB. VERITAS NetBackup Oracle Agent is linked to RMAN, and data is passed from Oracle Agent to VERITAS NetBackup.
CHAPTER 10 Backup and Restoration • Backup of a system volume Start PRIMEQUEST by using the NetVault disaster recovery-dedicated OS (VaultOS) and use a disk image to perform backup (VaultDR disaster recovery backup). To recover from a disk failure or other failures, boot the corresponding client by using VaultOS, and recover files from the VaultDR disaster recovery backup data via the network in a format supported by the OS, the application software etc.
10.2 General Methods of Backup and Restoration 10.2.4 Appliances with the backup function The user can use a dedicated unit with a backup function. The ETERNUS SP5000 is a storage server used together with the disk array unit ETERNUS6000 or ETERNUS3000. Using this setup, it is possible to back up disk array data without going through a business server or a LAN.
CHAPTER 10 Backup and Restoration 10.3 Comparison of Backup Methods Table 10.1 lists the usage method and characteristics of various backup and restoration methods. The requirements for the backup methods vary with the operation. The methods appropriate to each requirement need to be combined to back up data.
Page 247
10.3 Comparison of Backup Methods Method Main usage Characteristics Backup Softek ACM General data • It is possible to perform backup without software (Linux) stored in the applying load to a LAN. ETERNUS disk • It is possible to perform backup during array unit DB (Oracle/Symfoware) operation.
CHAPTER 11 Considerations for Maintenance This chapter describes the following consideration the user needs to take with respect to the maintenance of a system when designing the system: Estimating the Dump-use Area 11.1 Estimating the Dump-use Area If using Linux in PRIMEQUEST systems, the dump function provided by Linux distribution (diskdump) is available.
CHAPTER 11 Considerations for Maintenance The capacity of the dump device needs to be expanded according to the amount of memory installed. Therefore, if the user plans to expand the amount of installed memory, estimate the size of the dump device based on the amount of installed memory after expansion.
Page 251
Appendix A Software Supplied with PRIMEQUEST Hardware The software programs supplied with PRIMEQUEST hardware are listed below. Y: Supported Target OS Name Function Linux Windows (RedHat) EFI/BIOS Firmware Hardware system management SIRMS Collecting software configuration information SCSI Related Driver Driver Fusion MPT EFI appl.
Appendix A Software Supplied with PRIMEQUEST Hardware Target OS Name Function Linux Windows (RedHat) Bundled-Software • Installing the bundled software for Package Installer Linux • Installing Driver • Installing PSA DSNAP Dump High-reliability tool Installation tool (bundled software) package installer System Parameter Check Checking the environment variable Tool...
Appendix B Status Confirmation from LED PRIMEQUEST has a function for indicating the power-on or off state of each component, whether an error exists, and the physical location of such an error by using LEDs. More detailed state information on each component can be confirmed by using the MMB Web-UI.
Appendix B Status Confirmation from LED LED Display on the Operator Panel PRIMEQUEST has an LED display function on the operator panel which displays the power status and whether an error has occurred. The operator panel has a Power-LED (green) and Alarm-LED (orange), which indicate the power status of the cabinet and whether an error has occurred.
B.2 LED Display of Each Board or Component LED Display of Each Board or Component PRIMEQUEST has a function for indicating the power-on or off state of each board or component, whether an error exists, and the physical location of such an error by using LEDs.
Appendix B Status Confirmation from LED B.2.1.1 LED display of the MMB Besides the Power-LED (green), Alarm-LED (orange), and Location-LED (blue), the MMB has a Ready-LED (green), which indicates that the MMB is being operated, and the Active-LED (green), which indicates that the MMB is the Active one of duplicated MMBs.
B.2 LED Display of Each Board or Component B.2.1.2 LED display of a GSWB Besides the Power-LED (green), Alarm-LED (orange), and Location-LED (blue), a GSWB has LEDs for a LAN. The Speed LED is placed to the left of the LAN connector and the Link/Act LED is placed to the right of it.
Appendix B Status Confirmation from LED B.2.3 List of LED displays for different boards and components List of LED displays The following table shows LED states of different boards and their meaning: Table B.1 LED list Board, Color Number State Meaning component OPL (operator...
Page 259
B.2 LED Display of Each Board or Component Board, Color Number State Meaning component GSWB GSWB green 48V supplied in the GSWB Power Blinking Hot swapping being performed GSWB orange An error in the GSWB Alarm Location blue A component identified Blinking A component identified Link/Act green/...
Page 260
Appendix B Status Confirmation from LED Board, Color Number State Meaning component Power green 48V supplied to the XAI Blinking Hot swapping being performed Alarm orange An error in the XAI Location blue A component identified Blinking A component identified Power green 48V supplied to the XDI...
Page 261
B.2 LED Display of Each Board or Component Board, Color Number State Meaning component PCI_Box Power green 3.3V supplied to the PCI_Box Good Blinking Hot swapping being performed Power orange An error in the PCI_Box Alarm Location blue A component identified Blinking A component identified PCIIU- blue...
Appendix B Status Confirmation from LED B.2.4 LED display at power-on The following table lists LED display during the period from power-on to the start of the MMB and LED display cases where a problem occurs at the start time: Table B.2 LED Display of the operator panel (cabinet) and MMB Operator panel Common to Active-MMB...
B.2 LED Display of Each Board or Component B.2.5 Display function of HDD LEDs The LED display of an HDD is as follows: Table B.3 LED display of an HDD Access(green) Check(orange) Power-OFF (not mounted) Power-OFF (mounted) Power-ON (no disk access) Power-ON (disk being accessed) Power-ON (error location identified)
Glossary ACS (AC Section) CLI (Command Line Interface) AC power input section This interface with UNIX or DOS allows the user to enter commands and optional ASIC (Application Specific arguments to communicate with the OS. Integrated Circuit) COM Port (Communication Port) Integrated circuit (IC) designed and RS-232C serial port for PC/AT compatible manufactured for specific applications...
Page 266
Protocol used for high-speed communication between integrated circuits (ICs) GAC (Global Address Controller) IA (Intel Architecture) One of the ASICs developed by Fujitsu for the PRIMEQUEST-series machine Generic term for the basic design (architecture) of Intel's microprocessors GbE (Gigabit Ethernet)
Page 267
LDX (Local Data Xbar) Internet. Highly precise time information with consideration of line speeds and load changes One of the ASICs developed by Fujitsu for the in paths can be obtained with this protocol. PRIMEQUEST-series machine PAL (Physical Abstract Layer)
Page 268
PCI (Peripheral Component REMCS (Remote Customer Support Interconnect) System) Bus architecture established by PCI SIG for Fujitsu's remote customer support service connecting PC components Reserved SB PCIU (PCI Unit) Standby SB reserved for possible failures Unit that is mounted in a PCI_Box...
Page 269
SERDES (Serializer Deserializer) that one of duplicated components fails Parallel-to-serial converter (from low speeds to Systemwalker high speeds) One of Fujitsu's middleware products. Server System Manager Systemwalker is integrated operation management software. Management software for integrated management of multiple Fujitsu servers...
Page 270
Glossary Web UI (Web User Interface) XAI (Xbar Address Interconnect Board) Interface that uses a Web browser for displaying information to users and for user Board that transfers address information and operations controls the information transfer between SBs and IO_Unit boards XDI (Xbar Data Interconnect Board) Board that transfers data and controls the data transfer between SBs and IO_Unit boards...
Page 271
Index ..5-3 communication function support list ..5-6 communication mode, supported ....4-23 access control .
Page 277
Technical level: Too detailed Appropriate Not enough detail All comments and suggestions become the property of Fujitsu Limited. For Users in U.S.A., Canada, For Users in Other Countries and Mexico Fax this form to the number below or send this form to the address below.
Page 278
IF MAILED IN THE UNITED STATES BUSINESS REPLY MAIL FIRST-CLASS MAIL PERMIT NO 741 SUNNYVALE CA POSTAGE WILL BE PAID BY ADDRESSEE FUJITSU COMPUTER SYSTEMS AT TENTION ENGINEERING OPS M/S 249 1250 EAST ARQUES AVENUE SUNNYVALE CA 94085-5401 FOLD AND TAPE...