Browse Prior Art Database

Method and System for Universal Data Collection

IP.com Disclosure Number: IPCOM000210022D
Publication Date: 2011-Aug-22
Document File: 7 page(s) / 161K

Publishing Venue

The IP.com Prior Art Database

Abstract

A method and system for universal data collection which provides a single interface that interacts with a plurality of data collection interfaces is disclosed.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 35% of the total text.

Page 01 of 7

Method and System for Universal Data Collection

Disclosed is a method and system for universal data collection which provides a single interface that interacts with a plurality of data collection interfaces,.

The disclosed method and system consolidates multiple data collection tools and leverages various data extraction methods in a single interface. The system includes a core unit that may interact with various data sources such as, but not limited to, database, web services, Service Oriented Architecture (SOA) interface and Application Program interfaces (APIs) to retrieve information.

In an exemplary embodiment, the core unit may provide data models for a plurality of data collection sources to store the extracted data. The Core unit may maintain configuration data which includes, but is not limited to, data model, web service methods and parameters, API names and parameters, and SOA interface and parameters. The configuration data describes the source of data collection and the method used for retrieving the data. Further, the core unit may include a query engine that dynamically builds different types of queries such as, but not limited to, Simple Object Access Protocol (SOAP) request, Structured Query Language (SQL) query, web query, and API request. Queries are constructed based on configuration of a source of data collection and user requirements. In an instance, an SQL query submitted by the Core unit may be redirected to a federated data base and all remaining requests such as, but not limited to, SOAP request, web query and API requests may be forwarded to the respective interfaces of the plurality of data collection sources.

In another exemplary embodiment, the method and system may incorporate a push queue system. Figure 1 shows a flow diagram of the method and system incorporating the push queue system. The method and system may use publish/subscribe method for data extraction. The core unit may post a subscription request in a push queue processor. Subsequently, a subscribe/publish queue processor may process the subscription request and forward the request to all the data collection systems for registration. According to the frequency and the data requested in the subscription, data may be published back by the data collection system to the publish/subscribe queue processor. Subsequently, the publish/subscribe queue processor may send the response received from the data collection systems back to core unit for processing. Thereafter, the core unit may display the result to a user and provide an option to update the result.

1


Page 02 of 7

(This page contains 00 pictures or other non-text object)

Figure 1

In another exemplary embodiment, a method and system may incorporate a pull queue system. Figure 2 shows a flow diagram of the method and system incorporating the pull queue system. Configuration data for the data collection systems may be created and saved in configuration data model which may be accessed by the...