Browse Prior Art Database

Optimized Migration of a Stream

IP.com Disclosure Number: IPCOM000244000D
Publication Date: 2015-Nov-04
Document File: 3 page(s) / 58K

Publishing Venue

The IP.com Prior Art Database

Abstract

Described is a method to move a live streaming application which optimizes and/or minimizes the number of temporary cross environment streams while the stream is being migrated from a source environment to a target environment. The minimal number of temporary cross environment streams may be measured as the minimum temporary cross environment streams at any time, or the minimum total number of temporary cross environment streams.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 54% of the total text.

Page 01 of 3

Optimized Migration of a Stream

During the life cycle of a streams application, developers and system admins may wish to migrate all or a portion of a live streaming application from a first environment to a second environment. This live streams migration (of all or a portion of the app ) may be for a variety of reasons including reconfiguring a streams application, moving from test to production, moving from old hardware to new hardware, etc.

    For large streaming applications (or portions thereof), the live streaming application may need to be moved one at time or different sets of operators (versus all moved in parallel) may be moved in steps until the whole application is moved. One problem would be selecting an arbitrary migration ordering of operators (or sets of operators) which may result in poor migration performance and/or poor streaming application performance. A poor migration order results in more temporary cross environment connections which generally are slower and may take both extra work to configure and extra resources to manage and execute over and finally shut down and delete after the application is moved. The number of operators, and links between operators, in a large streaming application may be in the thousands, and thus an optimal ordering may be impossible to achieve manually, and thus the need for this invention which dynamically determines the best migration order.

    Described here is an optimized method to move a live streaming application which optimizes and/or minimizes the number of temporary cross environment streams while the stream is being migrated from a source environment to a target environment. The minimal number of temporary cross environment streams may be measured as the minimum temporary cross environment streams at any time, or the minimum total number of temporary cross environment streams. An algorithm estimates the various orders of moving operators (or sets of operators), and counts the...