Naturalistic integration of feature and function with journaling software on digital devices
Publication Date: 2010-Oct-26
The IP.com Prior Art Database
Described is an idea to use existing techniques for natural language processing in combination with annotations, gestures, and/or demarcation of the text you write to trigger an event that assists the user in integrating existing services already available on the device in to the journaling environment. This is not just a launch of a service in context, as the idea is to allow the user to remain in their current journaling context.
Page 01 of 5
Tablet and slate PCs heavily leverage an electronic journaling environment where one of the primary input devices is a pen. With tablet PCs becoming common place, users need a way to annotate and interact with written communications in a way that is more natural and intuitive to pen-based writing. For example, when reviewing notes, you have to read through the detail of all the notes to find items you need to take action on, emails you need to send, and research you want to do regarding topics that came up. In a paper world, you might underline, circle, use question marks, or put a star in the margins to make it easier to go back and do these things. While you can still do this in an electronic journal, the fact of it being electronic lends you to want to immediately take some action such as searching for information, adding something to an electronic to do list, or sending an email without leaving the context you are currently working in. Today, the user must mark and copy text from the journal, find and open an external application, then paste the copied text into the external application, act on the text, leave the external application, and return to the journal. The core idea of the invention is to use techniques for natural language processing in combination with annotations, gestures, and/or demarcations to convert handwritten text and annotation fragments into actions which can be used to provide access to external programs, data, and multimedia on the connected device inside of the journal environment in a way that is natural and intuitive to pen-based writing and does not require the user to switch contexts away from their main interaction, which is writing in the electronic
journal using a pen.
This invention defines/associates a well-defined set of actions, such as search, email, and to do list, with a set of gestures and/or words. The invention also uses the margin of the journal page as a special "action" area to supplement actionable gestures and words elsewhere on the
Some gestures and annotation invoke actions, such as '*', '?', double-tap, editor's delete symbol, etc, while others result in selecting or demarcating written content that will be acted upon, such as circling, curly braces, underlining, and white space.
The invention monitors pen input as it is being written. If text is written in the margin, such as "Send to Ted", it is scanned for known actions, such as send the nearby text to Ted in an email. If the text written in the margin is not recognized by the invention, the user can always double tap it, and the invention will ask them what action they would like to take and whether they would like to associate that text with this action all the time (similar to associating a file extension with an application). If a selection/demarcation gesture, such as circling is performed, the invention will mark the associated content as the current selection. If the user double taps on an annotation, g...