Maximum Entropy Method of Data Encoding for Dictionaries and Texts
Original Publication Date: 1990-Nov-01
Included in the Prior Art Database: 2005-Mar-17
Conventional methods of data encoding, such as EBCDIC and ASCII, are inefficient to use when storing and transmitting natural language data such as dictionaries and texts. Conventional compression techniques often use block encoding, which maps large and larger blocks of data into codewords from which the original data can be recovered by decoding. While performing optimal compression of the data, other is learned about the linguistic nature of the data.