Browse Prior Art Database

Performance improvement techniques of log transfer system keeping the order of logs

IP.com Disclosure Number: IPCOM000225965D
Publication Date: 2013-Mar-18
Document File: 5 page(s) / 77K

Publishing Venue

The IP.com Prior Art Database

Abstract

Disclosed is a system to improve the performance of the log transfer system keeping the order of logs.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 17% of the total text.

Page 01 of 5

Performance improvement techniques of log transfer system keeping the order of logs

Disclosed is a system to improve the performance of the log transfer system keeping the order of logs.

1. Background:

 
The information processing system (or abbreviated as IPS) retrieves the millions of transactional data (transaction log, or log for simplicity) which are triggered in real-time by the channel systems such as Branch, ATM, Internet, Mobile, and Call Center, from the core banking system into the data warehouse and data marts so that IPS can utilizes these data for the sales support activities. For the application which requires the very fresh data from the core banking system, such as Loan application, the delay of this transfer from the core banking system into IPS would be very big impact, and the high speed transfer is required. We call the system which input is the data source such as the core banking system and which output is IPS database as "log transfer system". In this disclosure, the idea is disclosed that improves the performance of the log transfer system. We showed the example of the financial institutes, but this techniques are not limited to that specific industry, but it can be widely applied to other area.

 The logical channel where the transaction log are transferred from the core banking system to IPS is called as "Transformer" in this publication. Transformer reads the transaction log from the input queue (hereafter, IN-Q), refers the content of transaction log, and edit the data (transformation) if necessary, and writes to the output queue (hereafter, OUT-Q). (Fig-1)

 Data Source (Core banking system) transaction

Fig-1: Log transfer system and Transformer

Sending transaction logs from core banking system to IN-Q and Retrieving from OUT-Q and reflecting to Data Warehouse are out of scope of this idea, and will not be covered in this publication.

One idea that improves the performance of the log transfer processing from core banking system to IPS is to have a Load Balancer (hereafter, LB) at the front stage of Transformer and have multiple Transformers. The Workload Management technology is an example of this kind of performance improvement technologies. The Workload Management technology dynamically adjusts the allocation of resource such as CPU and manages the distribution of the workload in order to keep the Service Level Objective (SLO). The differences between the idea in this disclosure and the workload management technology are seen as follows:


- This idea does not involve the OS level control such CPU adjustment. This idea can be realized by the application.


- This idea is not just a workload management. This idea improves the throughput keeping the order of log transfer. Transaction log which is generated in the core banking system should be transferred to IPS keeping the order of generation. For example, think about the case the customer A withdrew the cash from ATM, and then A requested the money transfer a...