Browse Prior Art Database

Dynamic compression and transmission of data from remote data sources via an intermediary messaging system

IP.com Disclosure Number: IPCOM000132488D
Original Publication Date: 2005-Dec-19
Included in the Prior Art Database: 2005-Dec-19
Document File: 3 page(s) / 49K

Publishing Venue

IBM

Abstract

Disclosed is means of decoupling a message producer and a message consumer, which are separated by a low bandwidth (or expensive) communications link, and dynamically compressing the data such that the message consumer is unaware of the remote link.

This text was extracted from a PDF file.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 45% of the total text.

Page 1 of 3

Dynamic compression and transmission of data from remote data sources via an intermediary messaging system

The problem arises in the situation where a producer of information and a consumer of that information are initially interconnected via a messaging system on a high bandwidth network e.g. a local area network at a specific location.

    In order to remotely monitor the data stream being produced, it is necessary to decouple the system across a low bandwidth (and or expensive) communications link (e.g. a wide area network), so the data producer remains in the original location, and the consumer is now situated remotely.

    The consumer (often an application) in this situation expects data to be delivered to it from the producer (often a device or sensor) exactly as it was emitted, for example temperature readings produced once a second. However, it is often found to be impractical (and/or unnecessarily expensive) to send the data stream exactly as it is produced, across the wide area network. For example, if the temperature is changing only slowly, it would make far more sense to only send it when it changes, and assume it was the same as the previous reading until the next reading is sent.

However, therein lies the problem: if the consumer is expecting to see the same one-per-second readings that are being generated by the producer, then a "report-by-exception" mechanism as described above can not be used.

    The invention works by the introduction of an second element in the messaging system (D) which collaborates with the existing messaging system element (B) at the remote location (where the data producer (A)is located) in order that the second messaging element (D) can receive a compressed data stream from the first messaging element (B), and yet can still deliver a reconstructed data stream, precisely matching that being generated by the data producer (A) , to deliver to the consumer (E).

Messaging system

Messaging system

Messaging system

Messaging system

D

D

Data consumer

Data consumer

E

E

B

B

Low bandwidth and/or expensive network link

Low bandwidth and/or expensive network link

    The mechanism of this invention, is that a message channel is set up between the two messaging system elements (B and D), which comprises two elements: a meta data stream and a compressed data stream.The meta data stream is sent from B to D and tells D in what way the messages that are about to be sent in the

Data producer

Data producer

A

A

Data consumer

Data consumer

C

C

[This page contains 2 pictures or other non-text objects]

Page 2 of 3

compressed data stream have been compressed. B then sends messages to D in the compressed data stream. Messaging system D receives those compressed messages, decompresses them according to the information received from B on the meta data stream, and uses that information to reconstruct a "live" message stream to consumer E at the remote location, which appears be the same as when the consumer was at "C".

    The nature of...