Method for efficient inter-processor communication in an active-active RAID system using PCI-express links

Abstract

A fault-tolerant RAID system is disclosed. The system includes redundant RAID controllers coupled by a PCI-Express link. When a PCI-Express controller of one of the RAID controllers receives a PCI-Express memory write request transaction layer packet (TLP), it interprets a predetermined bit in the header as an interrupt request flag, rather than as its standard function specified by the PCI-Express specification. If the flag is set, the PCI-Express controller interrupts the processor after storing the message in the payload at the specified memory location. In one embodiment, an unused upper address bit in the header is used as the interrupt request flag. Additionally, unused predetermined bits in the TLP header are used as a message tag to indicate one of a plurality of message buffers on the receiving RAID controller into which the message has been written. The PCI-Express controller sets a corresponding bit in a register to indicate which message buffer was written.

Description

CROSS REFERENCE TO RELATED APPLICATION(S)[0001]This application claims the benefit of pending U.S. Provisional Application Ser. No. 60 / 645,340 filed Jan. 20, 2005, entitled METHOD FOR EFFICIENT INTER-PROCESSOR COMMUNICATION IN AN ACTIVE-ACTIVE RAID SYSTEM USING PCI-EXPRESS LINKS, which is hereby incorporated by reference for all purposes.FIELD OF THE INVENTION[0002]The present invention relates in general to the field of message transfers between redundant storage controllers, and particularly to the generation of interrupt requests as notification of the message transfers.BACKGROUND OF THE INVENTION[0003]Redundant Array of Inexpensive Disk (RAID) systems have become the predominant form of mass storage systems in most computer systems today that are used in applications that require high performance, large amounts of storage, and / or high data availability, such as transaction processing, banking, medical applications, database servers, internet servers, mail servers, scientific com...

AI Technical Summary

Benefits of technology

[0007]The present invention provides a system and method for redundant RAID controllers to communicate via a PCI-Express link. In particular, the invention provides a method for using an unneeded predetermined bit in a PCI-Express memory write request transaction layer packet (TLP) header as an interrupt request flag, rather than as its standard function specified by the PCI-Express specification, to selectively cause the PCI-Express controller on the receiving RAID controller to interrupt its processor after storing the message in the packet to the specified memory location. In one embodiment, an unused upper address bit in the header is used as the interrupt request flag. Additionally, unused bits in the TLP header are used as a message tag to indicate one of a plurality of message buffers on the receiving RAID controller into which the message has been written. The PCI-Express controller also includes a message buffer register having a bit corresponding to each of the message buffers. When the PCI-Express controller receives a message and writes the message to a message buffer, it sets the bit in the register corresponding to the message buffer indicated in the message tag before interrupting the processor. This enables the transmitting RAID controller to queue up multiple messages to the receiving RAID controller before receiving an acknowledgement, and enables the receiving processor to efficiently determine which message buffers have a valid message without having to poll the message buffers.

Problems solved by technology

Consequently, these communication channels may be subject to service interruptions if a storage device fails or if the physical channel medium is damaged or removed.

Additionally, these communications channels typically incur a relatively high latency in communicating messages back and forth between the RAID controllers.

Images