Browse Prior Art Database

Intelligent Data Element Counting Logic For Flat File Processing Automation

IP.com Disclosure Number: IPCOM000177584D
Original Publication Date: 2008-Dec-18
Included in the Prior Art Database: 2008-Dec-18
Document File: 4 page(s) / 24K

Publishing Venue

IBM

Abstract

The logic of counting data elements for input files that uses predefined data elements and delimiter allows developing fully automated file processing programs. It does not require that input files must be in the form of a record per line. An input file is not required to be in .xls or .csv format, tt can be a .txt, or .del (if exported from database directly) or in an other file extension. It can process flat text files and allow one or many data elements in multiple lines for a single record, does not require third party software, and cuts the cost for processing files. It can fully automate flat file database input/output processes.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 47% of the total text.

Page 1 of 4

Intelligent Data Element Counting Logic For Flat File Processing Automation

Typically, loading batch files to databases requires third party software. This software has cost associated with purchase as well as possible licensing fees. Also, the data to be loaded in the database must be in a spreadsheet format. This invention is a Java® program that correctly recognizes the end of a logic record, not by the end of an input line, but by counting the data elements of the predefined fixed numbers of data elements. The logic of data elements counting allows merging multiple lines (which otherwise will be treated as multiple records) to one single line. When the number of data elements counted by read in line(s) satisfies the predefined number of data elements, one logic record is found and then parsed through the rest of program for data verifications and assignments and eventually loaded to database.

This intelligent data element counting logic allows:
- develop fully automated back-end processes coded in any computer languages (e.g. Java) to process any predefined-fixed-number-of-data-elements files including text files. It does not require data in spreadsheet format. It can accept files that may be pulled from a database and saved in a plain text file format. A logic record can be correctly recognized from an input file.
- No need to use third party software. Costs are reduced.

An example of a file with predefined data elements and delimiter: file name: PeopleRecord.txt
Data element delimiter: |
predefined data elements: employee

_

An Object defined to hold input record: class peopleRecord {

String employee

_number;

String address;

String department;

String note;
}
and all data elements will be defaulted to null.

sample input data: employee

_

       number| first name | last name | address| department|note 003|name|name|123 Street, Research Triangle Park, Durham, NC 12345|Software|add employee
001|name|name|123 Road,
P. O. Box 123


Raleigh, NC 12345|Sale|please update following info: address;

number| first name | last name | address|

department | note

String first

String last

_name;

_name;

1

Page 2 of 4

department
002|name|name|Home office,NC||please update location

In this sample file, there are three data records. The first line is a header or label which is optional. The second line is record one, and line 3 through line 7 is record two. Coding in Java reads in one line at a time, and data elements will be parsed by the delimiter. The first data line is allowed to process since all data elements are in one single line. The Object will have values assigned from input:
{employee

_

       number = 003 first

   name =xxxx last

_

  _name = xxxx
address = 123 Street, Research Triangle Park, Durham, NC 12345 department=Software
note=add employee}

But it will fail or incorrectly load the second record which comes in multiple lines. Current method for loading data one record/line, will assign the peopleRecord: {employee

_

       number...