Browse Prior Art Database

Remote User Interface (RUI) that Performs as Screen Capture Steaming to Other Client Devices for Graphics

IP.com Disclosure Number: IPCOM000242271D
Publication Date: 2015-Jun-30
Document File: 3 page(s) / 44K

Publishing Venue

The IP.com Prior Art Database

Related People

Michelle Kuo: INVENTOR

Abstract

Disclosed is a method in which a Remote User Interface (RUI) performs a screen capture to stream to other client devices for graphics. The first RUI client application renders the graphic display through an RUI protocol from the server and sends the screen capture to the second client without involving a server with an RUI protocol.

This text was extracted from a Microsoft Word document.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 53% of the total text.

Sony Corporation

Sony Electronics Inc.

IPD Case #201405457

Title: Remote User Interface (RUI) that Performs as Screen Capture Steaming to Other Client Devices for Graphics

Description of the Invention:

Disclosed is a method in which a Remote User Interface (RUI) performs a screen capture to stream to other client devices for graphics. The first RUI client application renders the graphic display through an RUI protocol from the server and sends the screen capture to the second client without involving a server with an RUI protocol.

Inventor:

Michelle Kuo

Invention Disclosure:

What issues/problems does your invention try to address?

A Remote User Interface (RUI) is based on the thin client concept and is applied to engage broadcast services and consumer electronic (CE) devices with Internet Protocol television (IPTV) streaming. The RUI server/service(s) form the graphic display per metadata. The RUI client only needs to perform the graphic rendering with input events associated with the RUI sever as well as the client media player streaming audio/visual (A/V) content from the server (e.g., Universal Plug and Play (UPnP) or IPVT).

It cannot, however, conduct the multiple clients to simultaneously perform the same RUI as a 3-box (i.e. two clients with one server) that needs an RUI display synchronization between two client devices.

Explain your invention and specifically identify the new and novel features.

The novel contribution is an RUI that performs as screen capture streaming to other client devices for graphics.  The first RUI client application renders the graphic display through an RUI protocol from the server and sends the screen capture to the second client without involving a server with an RUI protocol.

The RUI graphic display is not usually updated as the input event or server requests (e.g., timeout); therefore, it does not need to consume much network connection bandwidth. When the first RUI client updates the RUI, it sends the screen capture to the second client, which also updates.   


Both clients do not involve the meta-data, but just conduct the graphic screen/window rendering. The second client just performs as a graphic Miracasting update with the first client only when the RUI graphic changes. The RUI server only connects to the first client. Alternatively, the first client can perform the graphic rendering off screen, but still capture the graphic screen/window frame and casting to the second client. Then, the first client can perform the A/V streaming playback on screen.

This method can improve the overhead of video frame data transferring (e.g., Miracasting) when a network has limited bandwidth and poor performance.

Explain how your invention overcomes the problems described above.

This solution makes the synchronization among RUI clients easy, as the RUI server only connects to the first RUI client. The primary (i.e. first) client conducts A/V playback with the server per the protocol of RUI streaming.

...