Digital permanence
Encyclopedia
Digital permanence addresses the history and development of digital storage techniques specifically quantifying the expected lifetime of data stored on various digital media and the factors which influence the permanence of digital data. It is often a mix of ensuring the data itself can be retained on a particular form of media and that the technology remains viable. Where possible, as well as describing expected lifetimes, factors affecting data retention will be detailed including potential technology issues.
Since the inception of computers, a key concept differentiating computers from other calculating machines has been their ability to store information. Over the years, various hardware device have been designed to store ever larger quantities of data. With the development of the Internet the quantity of information available appears to continue to grow at an ever increasing rate often characterised as an Information Explosion
. As information stored on traditional media such as hand-written documents, printed books, photographic images and the likes is being replaced by digital files so our social and cultural legacy to future generations will depend more and more on the permanence of digital information.
However, not all this information is worth saving for any length of time; sometimes its value can be very short-lived. Other data, such as the contents of the Wikipedia we might like to keep around ... well, forever. This article describes how reliable different types of storage media are at storing data over time and factors affecting this reliability.
Librarians and Archivists responsible for large repositories of information take a deeper view of electronic archives.
Given that individuals' personal data also seems to be growing at an alarming rate, these archiving issues affecting professional repositories will soon be manifest in small organisations and even the home.
known as RAM
or ROM
and although the most common form today is RAM, designed to retain data while the computer is powered on, this was not always the case. Nor is active memory the only form used; passive memory devices are now in common use in digital cameras.
s consist of narrow bands of a magnetic medium bonded in paper or plastic. The magnetic medium passes across a semi-fixed head which reads or writes data. Typically magnetic media has maximum lifetime of about 50 years although this assumes optimal storage conditions; life expectancy can decrease rapidly depending on storage conditions and the resilience and reliability of hardware components.
Magnetic disks and drums include a rotating magnetic medium combined with a movable read/write head.
Since the inception of computers, a key concept differentiating computers from other calculating machines has been their ability to store information. Over the years, various hardware device have been designed to store ever larger quantities of data. With the development of the Internet the quantity of information available appears to continue to grow at an ever increasing rate often characterised as an Information Explosion
Information explosion
The information explosion is the rapid increase in the amount of published information and the effects of this abundance of data. As the amount of available data grows, the problem of managing the information becomes more difficult, which can lead to information overload. The Online Oxford English...
. As information stored on traditional media such as hand-written documents, printed books, photographic images and the likes is being replaced by digital files so our social and cultural legacy to future generations will depend more and more on the permanence of digital information.
However, not all this information is worth saving for any length of time; sometimes its value can be very short-lived. Other data, such as the contents of the Wikipedia we might like to keep around ... well, forever. This article describes how reliable different types of storage media are at storing data over time and factors affecting this reliability.
Librarians and Archivists responsible for large repositories of information take a deeper view of electronic archives.
-
- Data format : Data must be stored in a format which can be meaningfully accessed now and in the future.
- Technology reliance : If data requires a special program to view it, say, as an image, then software must also be available to both interpret the basic data file and also render it appropriately. In some cases, this might also require special hardware.
- Archival strategy : Data must remain available in the long term.
- At present a growing problem is the time taken to reproduce an archive, for instance following a hardware or system upgrade. Since the sheer volume of archive data continues to grow, new hardware is always required to maintain the archive and so regular migration of data to a new system must be performed on a regular basis. The time taken to migrate data is starting to approach the frequency of system upgrade such that archive transfer will become a continuous, never-ending process.
- Digital rights management : Maintaining digital information in an accurate and accessible format over an extended retention period also must address the requirements of the authors' digital rights.
- In many cases the data may include proprietary information that should not be accessible to all, but only to a defined group of users who understand or have legally agreed to only utilize the information in limited ways so as to protect the proprietary rights of the original authoring team. Maintaining this requirement over decades can be a challenge that requires processes and tools to ensure total compliance.
- Reproducibility : Digital information must be able to be reproduced as originally intended or available.
- This is significant especially where the original data was produced on technology at a lower level than currently possible. For example, archivists try to maintain the distinction between listening to gramophone record played on a gramophone as opposed to a digitally cleaned version of the same recording though a modern hi-fi system.
Given that individuals' personal data also seems to be growing at an alarming rate, these archiving issues affecting professional repositories will soon be manifest in small organisations and even the home.
Solid-state memory devices
Digital computers, in particular, make use of two forms of memoryComputer memory
In computing, memory refers to the physical devices used to store programs or data on a temporary or permanent basis for use in a computer or other digital electronic device. The term primary memory is used for the information in physical systems which are fast In computing, memory refers to the...
known as RAM
Ram
-Animals:*Ram, an uncastrated male sheep*Ram cichlid, a species of freshwater fish endemic to Colombia and Venezuela-Military:*Battering ram*Ramming, a military tactic in which one vehicle runs into another...
or ROM
Read-only memory
Read-only memory is a class of storage medium used in computers and other electronic devices. Data stored in ROM cannot be modified, or can be modified only slowly or with difficulty, so it is mainly used to distribute firmware .In its strictest sense, ROM refers only...
and although the most common form today is RAM, designed to retain data while the computer is powered on, this was not always the case. Nor is active memory the only form used; passive memory devices are now in common use in digital cameras.
- Magnetic, or ferrite core, data retention is dependent on the magnetic properties of iron and its compounds.
- PROMPROMPROM may refer to:*Phosphate rich organic manure*Premature rupture of membranes, an obstetric term*PROM-1 land mine*Programmable read-only memory, related to electronics...
, or programmable read-only memory, stores data in a fixed form during the manufacturing process, with data retention dependent on the life expectancy of the device itself. - EPROMEPROMAn EPROM , or erasable programmable read only memory, is a type of memory chip that retains its data when its power supply is switched off. In other words, it is non-volatile. It is an array of floating-gate transistors individually programmed by an electronic device that supplies higher voltages...
, or erasable programmable read-only memory, is similar to PROM but can be cleared by exposure to ultravioletUltravioletUltraviolet light is electromagnetic radiation with a wavelength shorter than that of visible light, but longer than X-rays, in the range 10 nm to 400 nm, and energies from 3 eV to 124 eV...
light. - EEPROMEEPROMEEPROM stands for Electrically Erasable Programmable Read-Only Memory and is a type of non-volatile memory used in computers and other electronic devices to store small amounts of data that must be saved when power is removed, e.g., calibration...
, or electrically erasable programmable read-only memory, is the format used by flash memoryFlash memoryFlash memory is a non-volatile computer storage chip that can be electrically erased and reprogrammed. It was developed from EEPROM and must be erased in fairly large blocks before these can be rewritten with new data...
devices and can be erased and rewritten electronically. These devices tend to be extraordinarily resilient; in a 2005 destructive test, a USB key survived boiling in a custard pie, being run-over by a truck and fired from a mortar at a brick wall. Although physically damaged after the final test, some deft soldering restored the device and data was successfully retrieved.
Magnetic media
Magnetic tapeMagnetic tape
Magnetic tape is a medium for magnetic recording, made of a thin magnetizable coating on a long, narrow strip of plastic. It was developed in Germany, based on magnetic wire recording. Devices that record and play back audio and video using magnetic tape are tape recorders and video tape recorders...
s consist of narrow bands of a magnetic medium bonded in paper or plastic. The magnetic medium passes across a semi-fixed head which reads or writes data. Typically magnetic media has maximum lifetime of about 50 years although this assumes optimal storage conditions; life expectancy can decrease rapidly depending on storage conditions and the resilience and reliability of hardware components.
- magnetic tape reels
- magnetic stripe cards
- magnetic cards
- cassette tapes
- video cassette tapes
Magnetic disks and drums include a rotating magnetic medium combined with a movable read/write head.
- floppy diskFloppy diskA floppy disk is a disk storage medium composed of a disk of thin and flexible magnetic storage medium, sealed in a rectangular plastic carrier lined with fabric that removes dust particles...
s - zip driveZip driveThe Zip drive is a medium-capacity removable disk storage system that was introduced by Iomega in late 1994. Originally, Zip disks launched with capacities of 100 MB, but later versions increased this to first 250 MB and then 750 MB....
s - hard diskHard diskA hard disk drive is a non-volatile, random access digital magnetic data storage device. It features rotating rigid platters on a motor-driven spindle within a protective enclosure. Data is magnetically read from and written to the platter by read/write heads that float on a film of air above the...
s and drums
Non-magnetic media
- punched paper-tapePunched tapePunched tape or paper tape is an obsolete form of data storage, consisting of a long strip of paper in which holes are punched to store data...
- punched cards
- optical media (rotating media combined with a moveable read/write head comprising a laser), such as:
- pressed CD-ROMCD-ROMA CD-ROM is a pre-pressed compact disc that contains data accessible to, but not writable by, a computer for data storage and music playback. The 1985 “Yellow Book” standard developed by Sony and Philips adapted the format to hold any form of binary data....
s - WORMs, CD-R
- DVDDVDA DVD is an optical disc storage media format, invented and developed by Philips, Sony, Toshiba, and Panasonic in 1995. DVDs offer higher storage capacity than Compact Discs while having the same dimensions....
s - multi-layer DVDs
- pressed CD-ROM
Printing technology
Although not a digital storage medium in itself, printing hard-copies of documents and images remains a popular means of representing digital data and possibly acquires the qualities associated with original documents especially their potential for endurance. More recent advances in printer technology have raised the quality of photographic images in particular. Unfortunately the permanence of printed documents cannot be easily discerned from the documents themselves.- wet-ribbon inked printers
- heat sensitive papers, such as FAX rolls
- NCR and other carbon technologies
- ink-jet printers
- wax-based inks eg. DataProducts SI810
- water-based inks
- other bases
- mono laser printers
- colour laser printers
Soft storage technology
The short-comings of some storage media is already well recognised and various attempts have been made to supplement the permanence of an under-lying technology. These "soft storage technologies" enhance their base technology by applying software or system techniques often within quite narrow fields of data storage and not always with the explicit intention of improving digital permanence.- RAID systems
- Distributed systems, such as bitTorrent
- networked backup services
- public archive repositories
- web-site archives