Browse Prior Art Database

Value Added Deduplication Service Solutioning by Data Store Transparency in Hybrid Storage Environments

IP.com Disclosure Number: IPCOM000243753D
Publication Date: 2015-Oct-16
Document File: 8 page(s) / 221K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed is an algorithm that can be integrated with ILM (Information Life Cycle Management) policies embed in a clustered file system that helps provide storage transparency in a deduplication enabled heterogeneous cloud environments

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 46% of the total text.

Page 01 of 8

Value Added Deduplication Service Solutioning by Data Store Transparency in Hybrid Storage Environments

Out of all effective optimization solutions evolved in the storage industry, ILM policies (Information Life Cycle Management) and Deduplication can be considered as major breakthrough in Exascale (massive clustered storage) information world. ILM deals with the strategic policies and processes that make effective management of information stored in the appliance throughout its life span. For example consider Automatic storage tiering policy which constitutes in ILM, helps in automatic movement of data across different tiers (types) of storage media and this movement of data depends on different types of disk according to performance and capacity requirements. Deduplication can be defined as a technique that helps in eliminating the storage of duplicate copies on entire storage unit tied to clustered File system by comparing chunks / whole of data among multiple files and map's a pointer to memory of original data at duplicated location. On the other side of the coin storage cloud (data-as-a service) has become a successful business model due to the adherent features namely QoS (Quality of Service) and pay-per-usage etc. With the dramatic evolution of various greener Disk and memory technologies, helped in rapid establishment of Hybrid storage environment of heterogeneous storage units.

Consider a scenario where Client-X has opted for both Bronze (larger disk space on slow access disk) and Gold plan (lower disk space on high access disk). Suppose if the disk space on high speed disk (Gold plan) has reached the threshold, on the other end he / she has sufficient amount of disk space on low speed disk (Bronze plan) and there is an incoming file (File-X) on to the high speed disk (Gold plan). In this scenario, the current traditional system indicates the client that File-X cannot be stored on to the high speed disk (Gold plan) due to limit exceeding on Gold pool and the client is left with only options of freeing up the data stored on Gold pool or migrate the data from Gold pool to Bronze pool.

[ Here in this scenario even if the deduplication is applied on the Gold and Bronze pools, the traditional deduplication engine cannot promise free space on Gold pool and does not ensure

1


Page 02 of 8

the transparency and reliability of space optimized to the vendor as well as client. ]

Implementation

Implementation of proposed policy engine tied to ILM follows a strategic approach that performs deep analysis of deduplicated and original file entries collected from the deduplication engine and File system tables. And the policy engine provides a value added service that enables over-provision of storage space by utilizing deduplication transparency between the vendor and client.

The tactical procedure of implementing proposed policy engine is as follows;

1. As a prerequisite procedure, the policy engine monitors the capacity thresholds set...