Log Tape Records

It is common in examining big data to encounter log tapes. Many organizations create log
tapes only to wake up one day and discover that there is a wealth of information on those
tapes that have not ever been used.

As a rule, log tapes contain information that is stored in a cryptic manner. Most log tapes
are written for purposes other than analytic processing. Most log tapes are written for
purposes of backup and recovery or for the purpose of creating a record of historical
events. As a consequence, log tapes require a utility to read and decipher the log tape.
The utility reads the log tape, infers the meaning of the data found on the log tape, and
then reformats the data into an intelligible form. Once the data are read and reformatted,
the analyst can then start to use the data found on the log tape.

Most log tape processing requires the elimination of irrelevant data. Much data appear on
the log tape that is of no use to the analyst.

Fig. 9.1.19 shows a schematic of what a typical log tape might look like.

Chapter 9.1: Repetitive Analytics: Some Basics