Large Message Distribution in Message/Queueing Application Integration software.
Original Publication Date: 2003-Sep-02
Included in the Prior Art Database: 2003-Sep-02
Data that is being transferred between systems, particularly in the form of messages is growing. Increasingly there is the issue of large messages (100 Mbytes +) being transferred between systems. It has recently come to light that a user is looking to use a publish subscribe method to transfer 300Mbyte messages to hundreds of subscribers. This can place a huge load on the infrastructure of the systems involved, particularly of the network that the data is being transferred over and storage systems that these messages are being written to. Where the network and systems are already under load, this additional burden of transferring and receiving large messages at an inappropriate time could break or severely impair the systems involved. This disclosure discusses the idea of Instead of transferring the data, send a message with a 'pointer' to a single copy of the original data. This pointer includes enough information for the receiving application to know that there is a data message waiting to be retrieved.