Businesses must ensure that the data that is used to make strategic decisions is accurate. Data corruption reduces the accuracy of the information that is needed and can cause a loss of revenue due to inaccurate information. Data corruption is one of the sources of inaccurate information.
This paper focuses on data corruption and how the following computer system architecture using the T10-PI standard meets this challenge:
- Hitachi Virtual Storage Platform (VSP) G series and VSP F series, powered by Hitachi Storage Virtualization Operating System (SVOS).
- Oracle Linux with the Unbreakable Enterprise Kernel (UEK).
- QLogic host bus adapter (HBA).
This architecture reduces data corruption and protects your investment in today’s complex data processing environment.
Silent Data Corruption
With data flowing from the application layer to the storage array layer and back again, there is a possibility that the data may become corrupt. Undetected data errors, where there is no indication that the data has been corrupted, are known as silent data corruption.
Hitachi Virtual Storage Platform (VSP) G series and VSP F series systems, powered by Hitachi Storage Virtualization Operating System (SVOS), are designed and engineered with the ability to detect, recover and/or correct data corruptions. Nevertheless, data corruption can still occur at any level external to Hitachi’s storage systems, such as the host, the host bus adapter (HBA) or the SAN.
The T10-PI Standard
The International Committee on Information Technology Standards (INCITS, pronounced “insights”) operates under the rules established by the American National Standards Institute (ANSI). T10, which is the technical committee of INCITS, has developed a process for finding and correcting errors in data that is flowing from the application layer to the storage layer. The T10 committee is also responsible for the creation of the SCSI interface architecture.
In their 2003 proposal, the Protection Information (PI) subcommittee of T10 added a section on data integrity, formally known as T10-DIF (Data Integrity Field), to the SCSI standards. In the T10-DIF specification, the SCSI block device protocol is extended by 8 bytes. The additional information is attached to each data block that is transmitted between the HBA and the storage array and serves as a checksum.
The Data Integrity Extension (DIX) improves things further by moving the checksum calculation up to the application for a full end-to-end data integrity check. HBA vendor QLogic implements Oracle’s DIX specification by enabling the exchange of T10-PI between the Hitachi VSP storage array and the operating system (Oracle Linux with the Unbreakable Enterprise Kernel) and the application (Oracle Database). The data is verified as it travels through the I/O stack, where the extra 8 bytes in each sector leaving the HBA are used by the storage array firmware for integrity checking. In the 8 byte extended sector, the guard tag protects the data portion of the sector. The data in the reference tag is used to protect against out-of-order and misdirected write. The application tag is used by the operating system and the application or relational database management system (RDBMS) for error correction, when data is written to storage and then checked after it is read back.
Therefore, to achieve end-to-end protection, the operating system, HBA and storage array use this common format. Checksums created by Oracle’s ASMLib can be verified by the host adapter and storage array firmware. Any mismatches between the data and the protection information can be corrected before the corrupted data is used in your business applications.
T10-PI With DIX Testing
Hitachi storage systems are engineered to have no single points of failure. Our engineering and quality assurance teams conduct extensive quality assurance tests prior to each release.
Hitachi’s VSP G series and VSP F series DIX and T10-PI capable storage arrays have undergone rigorous end-to- end testing. Our T10 and DIX test environments consist of:
- Oracle Real Application Clusters (RAC) and single instance Oracle Database 11g Release 2 (126.96.36.199).
- Oracle Linux Release 6 Update 5 (x86_64) with UEK Release 3 (UEK R3). T10 and DIX capable HBA (QLogic 16Gb/s – QLE2672 firmware 7.04.01).
- T10 and DIX capable Hitachi storage arrays.
- Online transaction processing (OLTP) application simulators such as Oracle’s SwingBench.
Hitachi’s VSP G series and VSP F series systems that are DIX and T10-PI capable have minimal impact on system performance. They provide the storage administrator the flexibility to enable or disable the T10-PI or DIX support in the storage array.
Hitachi Virtual Storage Platform Family
All-flash VSP F series systems and hybrid flash VSP G series systems give you more choice in how you design your data center, while delivering industry-leading data management efficiencies.
From entry models to full-scale enterprise, the VSP G series models are hybrid flash arrays that deliver data faster to improve user experiences. They are the right choice for organizations that are making a seamless transition to flash, tier by tier. VSP F series models are all-flash arrays designed to become the foundation of your data center modernization needs.
The entire VSP family provides support for both block and file workloads. SAN and NAS protocols are supported, enabling organizations to serve a wide variety of internal and customer-facing applications from a single high- performance array. And for mainframe users, VSP G1500 and VSP F1500 models can be integrated with mainframe applications for an unprecedented level of performance and operational resiliency.
Hitachi Storage Virtualization Operating System 7 is the powerful engine at the heart of every VSP system. It includes a new set of capabilities engineered specifically for flash.
- Adaptive data reduction: software that reduces capacity requirements by two times, five times or more, which lowers acquisition and maintenance costs.
- Quality of service: controls that help deliver consistent application performance.
- Direct connect to cloud: functionality that enables unparalleled on-site capacity reduction with transparent movement of files via data migrator to cloud.
With many years of experience building and delivering enterprise-class storage systems, Hitachi’s T10/DIX capable storage arrays meet the requirements that allow business to build highly reliable and complex compute environments. Hitachi VSP G series and VSP F series DIX or T10-PI capable storage platforms protect your valuable data. They minimize downtime caused by silent data corruption that may occur in data transmission, ensuring that your data is accessible and accurate.