NAPLAN
Encyclopedia
NAPLAN, or National Assessment Program – Literacy and Numeracy, is a battery of tests administered to Australia
n student
s. These standardized test
s assess students' reading, writing, language (spelling, grammar, and punctuation), and numeracy, and are administered by the Australian Curriculum, Assessment and Reporting Authority [ACARA] (ACARA 2010a). The ACARA (ACADA 2010a) website states that the NAPLAN tests "broadly reflect aspects of literacy
and numeracy
common to curriculums in all States and Territories". It also notes that the test formats and questions are "chosen so that they are familiar to teachers and students across Australia
". The tests are also designed to be carried out on the same days all across Australia in any given year (ACARA 2010b).
There has been a great deal of contention in the educational community as to whether the tests are appropriate, whether teachers are teaching as they normally would or teaching to the test, and what the results of the test are being used for.
The data obtained from the NAPLAN tests are collated and used to show all schools' average performance against other schools in the country on the Government My School
website (Ferrari, 2010).
on Education, Employment, Training and Youth Affairs (MCEETYA) determined that "national testing in literacy and numeracy would proceed for the full cohort of students in years 3, 5, 7 and 9 from 2008 onward". The NAPLAN tests would be used to determine if students were performing either above, at or below the National Minimum Standard in the areas of reading, language conventions, writing and numeracy for their particular year level (Reference-NAPLAN-nd|NAPLANNMS, n.d.).
According to ACARA (ACARA 2010b) the main purpose of the NAPLAN tests is to measure whether literacy and numeracy skills and knowledge that provide the critical foundation for other learning
and for their productive and rewarding participation in the community. The introduction of national literacy and numeracy tests in 2008 has provided consistency, comparability and transferability of information on students’ literacy and numeracy performance nationally.
In essence the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) influence brought about a series of tests to determine whether students being prepared for later life appropriately in the present day school system.
in order to ensure that their students are achieving to a minimum standard, if not above it. Pre-service teachers not only need to be able to access curriculum documents that they can refer to guide their teaching but also a means of assessing the standards of their students against other students in their State and country as a whole. This allows them to guide not only what they are teaching but how well they are teaching.
s are stakeholders as they can use the results to make education policy
decisions, but their stake in NAPLAN is minimal compared to others. It can also be said that employers, or the schools themselves, are stakeholders in that schools can use the results to recruit ‘good teachers’ but as stakeholders go, the schools should not be performing this way in the first place. The Primary stakeholders are students, parents and teachers.
According to a Parent's Brochure the NAPLAN test results will be used to assist students and parents in discussing student progress with teachers, identifying students who require "greater challenges or additional support", identifying teaching program strengths and weaknesses and allow for school program review and support" (NAPLAN National Assessment Program – Literacy and Numeracy 2010 Information for Parents, 2010).
ACARA (ACARA 2010c) claims in their MySchool Fact Sheet that "processes have been put in place to ensure that NAPLAN is a valid and reliable measurement of students' literacy and numeracy ability". It further goes on to state that "NAPLAN has a number of purposes including reporting national and jurisdictional achievements in literacy and numeracy as well as providing accurate and reliable measures of student and school performance. These purposes are carefully considered during the NAPLAN development process".
This however can bring up an issue related to the validity of the tests and should possibly require a re-wording of the website as NAPLAN is supposed to help guide, assist and develop student performance, not just measure and report on it. As far as the government is concerned this could constitute an invalid test. Fortunately the tests are used for the right purpose within schools themselves and as the Victorian Curriculum and Assessment Authority
(2004) points out that the NAPLAN Data Service identify areas of strength or weakness within a school or classroom. At the classroom level, the Item Analysis Report, the Writing Criteria Report and (for numeracy in particular) the Assessment Area Report provide powerful diagnostic information which can be used to complement school assessment and to inform the planning of teaching and learning programs.
Unfortunately the down side of NAPLAN can be see when teachers are teaching to the test rather than teaching to the curriculum as can be seen in Victoria where according to Perkins (2010) teachers have been told to "teach explicitly for the national tests that are the cornerstone of the Federal Government's controversial My School website". Once again this could make the NAPLAN an invalid test as it encourages teachers away from holistic curriculum to a certain extent. Teachers should therefore keep in mind that if they are teaching appropriately to the curriculum then the students ‘should’ have no trouble with their NAPLAN tests as the ACARA (ACARA 2010b) website points out when it states that "The best preparation schools can provide for students is teaching the curriculum as the tests reflect core elements of state and territory curricula".
NAPLAN is also valid in that "special provisions which typically will reflect the support normally provided in the classroom may be provided to students with disabilities
or special needs
(ACARA 2010b)".
The Validity and Reliability in Quality Assessment in relation to NAPLAN can be summed up by ACARA (ACARA 2010c) in that they use an equating process to "provide a high level of assurance as to the reliability of comparisons between years" and that this process ensures that "any test difference has been taken into account before making statements about one year's results compared to the next".
Unfortunately in relation to the principle of Flexibility in Quality Assessment and NAPLAN the NAPLAN tests seem to fall down quite considerably. Not all students work at the same pace and some don't work well under test conditions.
On the point of fairness it is important not to just rate the fairness of the test itself but to also rate the procedure of giving the test as well. Apart from the fact that the test is given mid-year so not all learning may have been successfully completed as would be expected by the end of the year for that particular grade, Chilcott (2010) writes that Queensland Teachers Union
president Steve Ryan said some schools "probably have devoted too much time to NAPLAN (National Assessment Program – Literacy and Numeracy)". He goes on to say that "What is happening here is we have an overemphasis on the importance of the NAPLAN tests; they are simply a test that measure the literacy and numeracy levels of students at one point in time and what has developed from the Federal Government is a regime that is over-rated".
This makes the procedure of giving the test unfair in that too much time is being spent on test preparation
thereby neglecting other curriculum areas which are also important to the students.
Although the test itself is extremely fair in that all students perform the same test nationwide, it also does not seem to take into account the fact that students in schools don’t just comprise the average but also include the likes of special needs students. ACARA (ACARA 2010b) points out that "Students can be exempted from one or more NAPLAN tests if they have significant intellectual or functional disability or if they are from a non-English-speaking background and arrived in Australia less than one year before the tests". It is understood therefore that NAPLAN is designed to test Literacy and Numeracy levels in students considered to be normal (NAPLANNMS, n.d.)
If the NAPLAN tests were to be completely fair to all students in the education system then they should cater for the likes of those students mentioned above and perhaps have a collation of data for them separate from those considered to be within the normal range of intellect
. Instead of providing for a test that can be given to the likes of these students they are simply left out of the equation all together.
The data from NAPLAN, as previously mentioned, is collated onto the MySchool website. Bradbury (2010) wrote that Principal Larissa Treskin of the MySchool website’s top ranked school James Ruse Agricultural High School
said "I really don’t know what the purpose of the [MySchool] website is". She continued "the only idea I have is to possibly help parents choose schools. However, most parents don’t have a choice and the website does not give an accurate picture of what schools do offer". Highly ranked school Baulkham Hills High School
Principal Jeanna Bathgate added that the website was very unfair to comprehensive school
s (Bradbury, 2010).
There is also the consideration to be given to the fact that selective school
s can pick and choose which students attend their schools giving them unfair advantage in attaining higher scores in almost any national assessment and especially in NAPLAN. Baulkham Hills High School Principal Jeanna Bathgate further noted that "being a selective school, of course we would rank well, we have the top students attend the school. It can be expected" (Bradbury, 2010).
As far as authenticity is concerned in the NAPLAN tests there are elements of real-world application and there are elements that are not real-world. In the 2010 Year Three NAPLAN Numeracy test (ACARA 2010d) for example, there are questions that can relate to real-world
The students can easily see the relevance of these tasks and how they may have to complete them in the real world however others are a little more obscure in relation to real-world application.
One of the important points to consider however with the NAPLAN tests is that, especially in relation to numeracy, not all areas can have immediately foreseeable real-world application however that does not necessarily mean that the questions are unimportant. For the most part however, the NAPLAN tests do seem to have quite a bit of real-world authenticity about them.
Australia
Australia , officially the Commonwealth of Australia, is a country in the Southern Hemisphere comprising the mainland of the Australian continent, the island of Tasmania, and numerous smaller islands in the Indian and Pacific Oceans. It is the world's sixth-largest country by total area...
n student
Student
A student is a learner, or someone who attends an educational institution. In some nations, the English term is reserved for those who attend university, while a schoolchild under the age of eighteen is called a pupil in English...
s. These standardized test
Standardized test
A standardized test is a test that is administered and scored in a consistent, or "standard", manner. Standardized tests are designed in such a way that the questions, conditions for administering, scoring procedures, and interpretations are consistent and are administered and scored in a...
s assess students' reading, writing, language (spelling, grammar, and punctuation), and numeracy, and are administered by the Australian Curriculum, Assessment and Reporting Authority [ACARA] (ACARA 2010a). The ACARA (ACADA 2010a) website states that the NAPLAN tests "broadly reflect aspects of literacy
Literacy
Literacy has traditionally been described as the ability to read for knowledge, write coherently and think critically about printed material.Literacy represents the lifelong, intellectual process of gaining meaning from print...
and numeracy
Numeracy
Numeracy is the ability to reason with numbers and other mathematical concepts. A numerically literate person can manage and respond to the mathematical demands of life...
common to curriculums in all States and Territories". It also notes that the test formats and questions are "chosen so that they are familiar to teachers and students across Australia
Australia
Australia , officially the Commonwealth of Australia, is a country in the Southern Hemisphere comprising the mainland of the Australian continent, the island of Tasmania, and numerous smaller islands in the Indian and Pacific Oceans. It is the world's sixth-largest country by total area...
". The tests are also designed to be carried out on the same days all across Australia in any given year (ACARA 2010b).
There has been a great deal of contention in the educational community as to whether the tests are appropriate, whether teachers are teaching as they normally would or teaching to the test, and what the results of the test are being used for.
The data obtained from the NAPLAN tests are collated and used to show all schools' average performance against other schools in the country on the Government My School
My School
My School is a website administered by the Australian Curriculum, Assessment and Reporting Authority which provides access to information about Australian schools...
website (Ferrari, 2010).
Background of NAPLAN
According to New South Wales Public Schools (National Assessment Program – Literacy and Numeracy National Minimum Standards [NAPLANNMS], n.d.) the NAPLAN tests, which commenced in 2008, were instigated after the Ministerial CouncilMinisterial Council
Ministerial Council or Joint Ministerial Council can refer to:* EU-GCC joint ministerial council, officially the EU-GCC Joint Council and Ministerial Meeting, the regular joint ministerial meeting between the European Union and the Cooperation Council for the Arab States of the Gulf* Franco-German...
on Education, Employment, Training and Youth Affairs (MCEETYA) determined that "national testing in literacy and numeracy would proceed for the full cohort of students in years 3, 5, 7 and 9 from 2008 onward". The NAPLAN tests would be used to determine if students were performing either above, at or below the National Minimum Standard in the areas of reading, language conventions, writing and numeracy for their particular year level (Reference-NAPLAN-nd|NAPLANNMS, n.d.).
According to ACARA (ACARA 2010b) the main purpose of the NAPLAN tests is to measure whether literacy and numeracy skills and knowledge that provide the critical foundation for other learning
Learning
Learning is acquiring new or modifying existing knowledge, behaviors, skills, values, or preferences and may involve synthesizing different types of information. The ability to learn is possessed by humans, animals and some machines. Progress over time tends to follow learning curves.Human learning...
and for their productive and rewarding participation in the community. The introduction of national literacy and numeracy tests in 2008 has provided consistency, comparability and transferability of information on students’ literacy and numeracy performance nationally.
In essence the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) influence brought about a series of tests to determine whether students being prepared for later life appropriately in the present day school system.
The relevance of a study of NAPLAN for pre-service primary teachers
An understanding of the NAPLAN tests provides pre-service teachers with an understanding of the importance of teaching well and to the curriculumCurriculum
See also Syllabus.In formal education, a curriculum is the set of courses, and their content, offered at a school or university. As an idea, curriculum stems from the Latin word for race course, referring to the course of deeds and experiences through which children grow to become mature adults...
in order to ensure that their students are achieving to a minimum standard, if not above it. Pre-service teachers not only need to be able to access curriculum documents that they can refer to guide their teaching but also a means of assessing the standards of their students against other students in their State and country as a whole. This allows them to guide not only what they are teaching but how well they are teaching.
Relevant stakeholders in NAPLAN
There are several stakeholders in the NAPLAN tests. It can be said that governmentGovernment
Government refers to the legislators, administrators, and arbitrators in the administrative bureaucracy who control a state at a given time, and to the system of government by which they are organized...
s are stakeholders as they can use the results to make education policy
Education policy
Education policy refers to the collection of laws and rules that govern the operation of education systems.Education occurs in many forms for many purposes through many institutions. Examples include early childhood education, kindergarten through to 12th grade, two and four year colleges or...
decisions, but their stake in NAPLAN is minimal compared to others. It can also be said that employers, or the schools themselves, are stakeholders in that schools can use the results to recruit ‘good teachers’ but as stakeholders go, the schools should not be performing this way in the first place. The Primary stakeholders are students, parents and teachers.
According to a Parent's Brochure the NAPLAN test results will be used to assist students and parents in discussing student progress with teachers, identifying students who require "greater challenges or additional support", identifying teaching program strengths and weaknesses and allow for school program review and support" (NAPLAN National Assessment Program – Literacy and Numeracy 2010 Information for Parents, 2010).
The validity and reliability of NAPLAN
According to Dawson (2010b) "the validity of a test or measurement instrument is reflected in the extent to which the test or instrument measures the behaviour or performance which it is supposed to measure, allowing teachers to make appropriate decisions as a result" and that "reliability means consistency of the instrument in measuring whatever it measures. It is the degree to which an instrument will give similar results for the same individuals at different times".ACARA (ACARA 2010c) claims in their MySchool Fact Sheet that "processes have been put in place to ensure that NAPLAN is a valid and reliable measurement of students' literacy and numeracy ability". It further goes on to state that "NAPLAN has a number of purposes including reporting national and jurisdictional achievements in literacy and numeracy as well as providing accurate and reliable measures of student and school performance. These purposes are carefully considered during the NAPLAN development process".
This however can bring up an issue related to the validity of the tests and should possibly require a re-wording of the website as NAPLAN is supposed to help guide, assist and develop student performance, not just measure and report on it. As far as the government is concerned this could constitute an invalid test. Fortunately the tests are used for the right purpose within schools themselves and as the Victorian Curriculum and Assessment Authority
Victorian Curriculum and Assessment Authority
The Victorian Curriculum and Assessment Authority is a statutory authority of the Government of Victoria responsible for the provision of curriculum and assessment programs for students in Victoria, Australia...
(2004) points out that the NAPLAN Data Service identify areas of strength or weakness within a school or classroom. At the classroom level, the Item Analysis Report, the Writing Criteria Report and (for numeracy in particular) the Assessment Area Report provide powerful diagnostic information which can be used to complement school assessment and to inform the planning of teaching and learning programs.
Unfortunately the down side of NAPLAN can be see when teachers are teaching to the test rather than teaching to the curriculum as can be seen in Victoria where according to Perkins (2010) teachers have been told to "teach explicitly for the national tests that are the cornerstone of the Federal Government's controversial My School website". Once again this could make the NAPLAN an invalid test as it encourages teachers away from holistic curriculum to a certain extent. Teachers should therefore keep in mind that if they are teaching appropriately to the curriculum then the students ‘should’ have no trouble with their NAPLAN tests as the ACARA (ACARA 2010b) website points out when it states that "The best preparation schools can provide for students is teaching the curriculum as the tests reflect core elements of state and territory curricula".
NAPLAN is also valid in that "special provisions which typically will reflect the support normally provided in the classroom may be provided to students with disabilities
Disability
A disability may be physical, cognitive, mental, sensory, emotional, developmental or some combination of these.Many people would rather be referred to as a person with a disability instead of handicapped...
or special needs
Special needs
In the USA, special needs is a term used in clinical diagnostic and functional development to describe individuals who require assistance for disabilities that may be medical, mental, or psychological. For instance, the Diagnostic and Statistical Manual of Mental Disorders and the International...
(ACARA 2010b)".
The Validity and Reliability in Quality Assessment in relation to NAPLAN can be summed up by ACARA (ACARA 2010c) in that they use an equating process to "provide a high level of assurance as to the reliability of comparisons between years" and that this process ensures that "any test difference has been taken into account before making statements about one year's results compared to the next".
The flexibility and fairness of NAPLAN
Hart (2000) noted in relation to flexibility in assessment that "the most innovative, problem-based, constructivist and flexible curriculum can be brought to its knees by a three hour invigilated examination. Assessment needs to be based on competency rather than time, on achieving targets rather than normal distribution, on providing feedback as well as judgement".Unfortunately in relation to the principle of Flexibility in Quality Assessment and NAPLAN the NAPLAN tests seem to fall down quite considerably. Not all students work at the same pace and some don't work well under test conditions.
On the point of fairness it is important not to just rate the fairness of the test itself but to also rate the procedure of giving the test as well. Apart from the fact that the test is given mid-year so not all learning may have been successfully completed as would be expected by the end of the year for that particular grade, Chilcott (2010) writes that Queensland Teachers Union
Queensland Teachers Union
The Queensland Teachers' Union is an Australian trade union with a membership of more than 44,000 teachers and principals in the Queensland Government's primary schools, secondary schools, special schools, senior colleges, TAFE colleges and other educational facilities. More than 96 per cent of...
president Steve Ryan said some schools "probably have devoted too much time to NAPLAN (National Assessment Program – Literacy and Numeracy)". He goes on to say that "What is happening here is we have an overemphasis on the importance of the NAPLAN tests; they are simply a test that measure the literacy and numeracy levels of students at one point in time and what has developed from the Federal Government is a regime that is over-rated".
This makes the procedure of giving the test unfair in that too much time is being spent on test preparation
Test preparation
Test preparation or exam preparation primarily refers to educational courses, tutoring services, and educational materials/learning tools designed to increase students' performance on standardized tests, particularly entrance examinations used for admissions to institutions of higher education,...
thereby neglecting other curriculum areas which are also important to the students.
Although the test itself is extremely fair in that all students perform the same test nationwide, it also does not seem to take into account the fact that students in schools don’t just comprise the average but also include the likes of special needs students. ACARA (ACARA 2010b) points out that "Students can be exempted from one or more NAPLAN tests if they have significant intellectual or functional disability or if they are from a non-English-speaking background and arrived in Australia less than one year before the tests". It is understood therefore that NAPLAN is designed to test Literacy and Numeracy levels in students considered to be normal (NAPLANNMS, n.d.)
If the NAPLAN tests were to be completely fair to all students in the education system then they should cater for the likes of those students mentioned above and perhaps have a collation of data for them separate from those considered to be within the normal range of intellect
Intellect
Intellect is a term used in studies of the human mind, and refers to the ability of the mind to come to correct conclusions about what is true or real, and about how to solve problems...
. Instead of providing for a test that can be given to the likes of these students they are simply left out of the equation all together.
The data from NAPLAN, as previously mentioned, is collated onto the MySchool website. Bradbury (2010) wrote that Principal Larissa Treskin of the MySchool website’s top ranked school James Ruse Agricultural High School
James Ruse Agricultural High School
James Ruse Agricultural High School is one of four New South Wales Government agricultural high schools. It is a selective, co-educational public high school located at Carlingford, New South Wales, Australia...
said "I really don’t know what the purpose of the [MySchool] website is". She continued "the only idea I have is to possibly help parents choose schools. However, most parents don’t have a choice and the website does not give an accurate picture of what schools do offer". Highly ranked school Baulkham Hills High School
Baulkham Hills High School
Baulkham Hills High School is an academically selective high school located in Baulkham Hills. The school was established in 1971 by the New South Wales Department of Education and Training, and currently caters for approximately 1200 students from Years 7 to 12.The school is noted for its...
Principal Jeanna Bathgate added that the website was very unfair to comprehensive school
Comprehensive school
A comprehensive school is a state school that does not select its intake on the basis of academic achievement or aptitude. This is in contrast to the selective school system, where admission is restricted on the basis of a selection criteria. The term is commonly used in relation to the United...
s (Bradbury, 2010).
There is also the consideration to be given to the fact that selective school
Selective school
A selective school is a school that admits students on the basis of some sort of selection criteria, usually academic. The term may have different connotations in different systems....
s can pick and choose which students attend their schools giving them unfair advantage in attaining higher scores in almost any national assessment and especially in NAPLAN. Baulkham Hills High School Principal Jeanna Bathgate further noted that "being a selective school, of course we would rank well, we have the top students attend the school. It can be expected" (Bradbury, 2010).
The authenticity of NAPLAN
Dawson (2010a) notes that Authentic Assessment "attempts to recreate the conditions under which an activity will occur" and has "greater emphasis is on what students can do, rather than on what they know".As far as authenticity is concerned in the NAPLAN tests there are elements of real-world application and there are elements that are not real-world. In the 2010 Year Three NAPLAN Numeracy test (ACARA 2010d) for example, there are questions that can relate to real-world
The students can easily see the relevance of these tasks and how they may have to complete them in the real world however others are a little more obscure in relation to real-world application.
One of the important points to consider however with the NAPLAN tests is that, especially in relation to numeracy, not all areas can have immediately foreseeable real-world application however that does not necessarily mean that the questions are unimportant. For the most part however, the NAPLAN tests do seem to have quite a bit of real-world authenticity about them.