Browse Prior Art Database

Segmented filesystem design for superior scalability and performance

IP.com Disclosure Number: IPCOM000234120D
Publication Date: 2014-Jan-13
Document File: 8 page(s) / 275K

Publishing Venue

The IP.com Prior Art Database

Abstract

Describes the notion of a segmented filesystem design to improve scalability and boost performance of a large filesystem implementation.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 25% of the total text.

Page 01 of 8

Segmented filesystem design for superior scalability and performance

As filesystems get bigger and are becoming distributed across nodes there is a continual challenge to keep track of the filesystems blocks in an organized way and to do the basic filesystem helper commands such as fsck,defragfs, backup, and restore. The distribution of file system blocks and other file metadata such as inodes ,block maps, and inode maps also makes it more challenging to do log transactions in an organized and systematic way. The purpose of this invention is to share a new filesystem design which makes all the basic filesystem helper commands more efficient and better performing in both a clustered and non-clustered filesystem environment.

One known filesystem solution that improves the fsck helper command in given in patent

WO2010050944A1:
2010-05-06 ONLINE CHECKING OF DATA STRUCTURES OF A FILE SYSTEM (en) 050944A1 :

A part of its summary is:
One embodiment is a method that divides a file system into plural segments bounded in size so each of the plural segments is independently checked for inconsistencies (300, 310). A file system checker (fsck) then locates and corrects data structures that are corrupt in each of the plural segments while the file system remains online with access available to file system data

The above patent talks about a segmented filesystem for a bounded online fsck. Also proposed is a segmented filesystem. However, the similarities end there. Proposed is a completely new file system design where each segment is a mini-filesystem, more conducive to parallel file system operations. The file system is expected to be more scalable and better performing.

The disclosed invention adds other novel ideas to the basic idea of a filesystem divided into regions of segmented blocks. The ideas are:

1) Individual files are allowed to also be segmented. This means parts of files can be found in different segments.

2) The segments contain inode descriptors that keep track of modification times and inode numbers associated with the files segments

3) Each segment contains its own data blocks, block maps, inode descriptor maps, and inline logs so that each segment can process its file segments independently.

4) Ideas 1,2,3, in summary creates a minifilesystem for each segmented region. This mini filesystem can be constructed using designs known today for regular filesystems structures but can be simplified since it will always be a set size.

5) There are 3 types of Regions defined as a Main Directory with superblock, main inode segments, and regular data segments with mini filesytems as defined in 1-4.

6) The main inode segments can have their inodes constructed in normal ways such as in xtree pages with extents which point to internal pages with extents that point to leaf pages with extents. The leaf page extents instead of pointing to data pages point to specific segments for certain parts of each file. The filesystem code then goes to which...