Public library ratings
Encyclopedia
There are several national systems for rating the quality of public libraries
.
A commercial product, Hennen’s American Public Library Ratings Information (HAPLR), is prepared by Thomas J. Hennen Jr. http://www.haplr-index.com/ResumeLong.htm, Director of Waukesha County Federated Library System in Wisconsin. It is published annually in the November edition of American Libraries
, and rates over 9,000 public libraries
in the United States based on this data. Libraries are ranked on 15 input and output measures with comparisons in broad population categories.
An alternative system (the LJ Index of Public Library Service) developed by Keith Curry Lance and Ray Lyons, was introduced in the June 15th 2008 issue of Library Journal
. Libraries are rated on four equally weighted per-capita statistics with comparison groups based on total operating expenditures. The four statistics, library visits, circulation, program attendance, and public internet computer uses, were chosen based on correlation analysis. The system awards 5-star, 4-star, and 3-star designations rather than library ranks, due to recognized imprecision of the library statistical data. The LJ Index measures how the levels of services a library provides compares with other libraries. Creators of the LJ Index stress the fact that it does not measure service quality, operational excellence, library effectiveness, nor the degree to which a library meets existing community information needs.
In Library Journal
, Oregon State Librarian Jim Scheppke notes that the statistics that HAPLR relies on are misleading because they rely too much on output measures, such as circulation, funding, etc. and not on input measures, such as open hours and patron satisfaction. He adds "To give HAPLR some credit, collectively, the libraries in the top half of the list are definitely better than the libraries in the bottom half, but when it gets down to individual cases, which is what HAPLR claims to be able to do, it doesn't work."
However, John Berry III, in a Library Journal editorial said "Unfortunately, when you or your library receives any kind of honor, it stimulates the flow of competitive hormones in your professional colleagues. This jealousy rears its ugly head in many ways. We've suffered endless tutorials on the defects in Hennen's rankings. So what? They work!"
In a 2008 article in Public Libraries Ray Lyons and Neal Kaske argue for greater recognition of the strengths and limitations of ratings. They point out that, among other factors, imprecision in library statistics make ratings scores quite approximate, a fact rarely acknowledged by libraries receiving high ratings. The authors also note that HAPLR calculations perform invalid mathematical operations using ordinal rankings, making comparisons of scores between libraries and between years meaningless.
A 2006 Library School Student Writing Award article questions HAPLR’s weighting of factors, and its failure to account for local factors (such as a library’s mission) in measuring a library’s success, the index’s failure to measure computer and Internet usage, and its lack of focus of on newer methods of evaluation, such as customer satisfaction or return on investment.
Keith Curry Lance and Marti Cox, both of the Library Research Service, take issue with HAPLR’s reasoning backwards from statistics to conclusion, point out the redundancy of HAPLR’s statistical categories, and question its arbitrary system of weighting criteria.
Hennen responded to Lance and Cox in the same issue of American Libraries
,saying their "thesis seems to be that the job of comparing libraries cannot be done, so I am at fault for having tried. Somehow, unique among American public or private institutions, libraries are just too varied and too local to be compared. Yet despite these assertions, the authors urge individuals to use the NCES Public Library Peer Comparison tool (nces.ed.gov/surveys/libraries/publicpeer/) to do this impossible task."
Public library
A public library is a library that is accessible by the public and is generally funded from public sources and operated by civil servants. There are five fundamental characteristics shared by public libraries...
.
United States
The basic public library statistics (not rankings) are published by the National Center for Educational Statistics; the most recent version was published in July 2006, using data from fiscal year 2005. As of October 1, 2007, the Institute of Museums and Library Services assumed responsibility for the publication of public library statistics.A commercial product, Hennen’s American Public Library Ratings Information (HAPLR), is prepared by Thomas J. Hennen Jr. http://www.haplr-index.com/ResumeLong.htm, Director of Waukesha County Federated Library System in Wisconsin. It is published annually in the November edition of American Libraries
American Libraries
American Libraries is the official news and features magazine of the American Library Association. Published six times per year, along with four additional digital-only supplements, it is distributed to all members of the organization...
, and rates over 9,000 public libraries
Public library
A public library is a library that is accessible by the public and is generally funded from public sources and operated by civil servants. There are five fundamental characteristics shared by public libraries...
in the United States based on this data. Libraries are ranked on 15 input and output measures with comparisons in broad population categories.
An alternative system (the LJ Index of Public Library Service) developed by Keith Curry Lance and Ray Lyons, was introduced in the June 15th 2008 issue of Library Journal
Library Journal
Library Journal is a trade publication for librarians. It was founded in 1876 by Melvil Dewey . It reports news about the library world, emphasizing public libraries, and offers feature articles about aspects of professional practice...
. Libraries are rated on four equally weighted per-capita statistics with comparison groups based on total operating expenditures. The four statistics, library visits, circulation, program attendance, and public internet computer uses, were chosen based on correlation analysis. The system awards 5-star, 4-star, and 3-star designations rather than library ranks, due to recognized imprecision of the library statistical data. The LJ Index measures how the levels of services a library provides compares with other libraries. Creators of the LJ Index stress the fact that it does not measure service quality, operational excellence, library effectiveness, nor the degree to which a library meets existing community information needs.
Controversy
The HAPLR ratings have drawn significant criticism and praise from members of the library community.In Library Journal
Library Journal
Library Journal is a trade publication for librarians. It was founded in 1876 by Melvil Dewey . It reports news about the library world, emphasizing public libraries, and offers feature articles about aspects of professional practice...
, Oregon State Librarian Jim Scheppke notes that the statistics that HAPLR relies on are misleading because they rely too much on output measures, such as circulation, funding, etc. and not on input measures, such as open hours and patron satisfaction. He adds "To give HAPLR some credit, collectively, the libraries in the top half of the list are definitely better than the libraries in the bottom half, but when it gets down to individual cases, which is what HAPLR claims to be able to do, it doesn't work."
However, John Berry III, in a Library Journal editorial said "Unfortunately, when you or your library receives any kind of honor, it stimulates the flow of competitive hormones in your professional colleagues. This jealousy rears its ugly head in many ways. We've suffered endless tutorials on the defects in Hennen's rankings. So what? They work!"
In a 2008 article in Public Libraries Ray Lyons and Neal Kaske argue for greater recognition of the strengths and limitations of ratings. They point out that, among other factors, imprecision in library statistics make ratings scores quite approximate, a fact rarely acknowledged by libraries receiving high ratings. The authors also note that HAPLR calculations perform invalid mathematical operations using ordinal rankings, making comparisons of scores between libraries and between years meaningless.
A 2006 Library School Student Writing Award article questions HAPLR’s weighting of factors, and its failure to account for local factors (such as a library’s mission) in measuring a library’s success, the index’s failure to measure computer and Internet usage, and its lack of focus of on newer methods of evaluation, such as customer satisfaction or return on investment.
Keith Curry Lance and Marti Cox, both of the Library Research Service, take issue with HAPLR’s reasoning backwards from statistics to conclusion, point out the redundancy of HAPLR’s statistical categories, and question its arbitrary system of weighting criteria.
Hennen responded to Lance and Cox in the same issue of American Libraries
American Libraries
American Libraries is the official news and features magazine of the American Library Association. Published six times per year, along with four additional digital-only supplements, it is distributed to all members of the organization...
,saying their "thesis seems to be that the job of comparing libraries cannot be done, so I am at fault for having tried. Somehow, unique among American public or private institutions, libraries are just too varied and too local to be compared. Yet despite these assertions, the authors urge individuals to use the NCES Public Library Peer Comparison tool (nces.ed.gov/surveys/libraries/publicpeer/) to do this impossible task."
Australia and New Zealand
There is some interest in developing an index in Australia and New ZealandGreat Britain
Great Britain adopted national standards, and in 2000 the Audit Commission began publishing both a summary annual reports of library conditions and individualized ratings of libraries. Audit Commission personnel base the reports on statistical data, long-range plans, local government commitment to the library, and a site visit. The Audit Commission is an independent body. Every library is assigned a score.Germany
Bertelsmann Publishing partners with the German library association to produce BIX, a library index quite similar to HAPLR. The main difference between BIX and HAPLR, is that BIX was designed to provide comparisons of one library to another in a given year as well as over time. HAPLR compares all libraries to one another only during a given year.See also
- International Federation of Library Associations and InstitutionsInternational Federation of Library Associations and InstitutionsThe International Federation of Library Associations and Institutions is the leading international association of library organisations. It is the global voice of the library and information profession, and its annual conference provides a venue for librarians to learn from one another...
- Library computer systemLibrary computer systemA library computer system is the software used to catalog, track circulation and inventory a library's assets. It is intended for home, church, private enterprise or other small to medium sized collections...