Dismiss
InnovationQ will be updated on Sunday, Oct. 22, from 10am ET - noon. You may experience brief service interruptions during that time.
Browse Prior Art Database

Method and System for Performing Eventual Consistency Intent Cleanup

IP.com Disclosure Number: IPCOM000249440D
Publication Date: 2017-Feb-27
Document File: 2 page(s) / 22K

Publishing Venue

The IP.com Prior Art Database

Abstract

A method and system is disclosed for achieving eventual consistency intent cleanup by prefixing all intent names with the associated session marker’s ID in order to find all intents for an associated session without scanning or reading all currently persisted intents. Thus, a prefixable scanning mechanism is used to find all of the associated intents.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 52% of the total text.

1

Method and System for Performing Eventual Consistency Intent Cleanup

Eventual consistency Intents are small objects that are stored in a Dispersed Storage Network (DSN) memory to ensure that a piece of work eventually gets done. A DSN processing unit generally writes these intents along with an immediate consistency update and returns a response to the user before moving on to processing the eventual consistency update. Once the DSN processing unit finishes the eventual consistency update in the background, the DSN processing unit deletes the intent from the DSN memory.

However, if the DSN processing unit crashes or runs into a network partition which prevents the DSN processing unit from accomplishing the update, the intent is left in DSN memory. Intents which are left behind are later discovered and executed by a cleanup agent.

Intents cleanup is essential for ensuring that eventual consistency updates eventually get done, even in the face of network outages or crashes during the initial execution attempt. When a network partition or crash occurs, the intent object will be left in the DSN memory to be later found by a cleanup agent. The intent cleanup generally consists of performing some work described by the intent and then deleting the intent itself. Cleanup agents are run on any Dispersed Storage (DS) processing unit or a DS unit that has access to read intent storage as well as access to perform the necessary writes to execute the intents that are found.

Since intents are written to the DSN memory even while they are actively being executed, there needs to be an indication of whether they are being currently worked on. One way to achieve this is to link the intent to a session which is also stored in the DSN memory. The session can be persisted in the form of a session marker which is periodically updated to indicate the current timestamp. Cleanup agents read this session to determine whether it has recently been updated and thus determine whether the associated intents are actively being worked on.

Moreover, there exists a need for an efficient way to find all intents for an associated session without scanning or reading all currently persisted intents.

Disclosed is a method and system for achieving eventual consistency inten...