Free Essay

Criterion Referenced Test

In: Social Issues

Submitted By tmudambo
Words 1927
Pages 8
INTRODUCTION
In the educational psychology, one of the basic themes is the realization that nobody in this world is exactly like somebody else. Individual differences are notable in differences in performance at school .These are intra-individual variables which reflect differences in an individual’s abilities from one situation to another ,for example ,between numerical ,reading ,sporting abilities and inter-individual variables which reflect differences between individuals at any given point in time .Individual differences which are related to academic achievement that may affect performance may include age ,cognitive style ,home background ,ability to remember given information ,level of confidence and amount of previous learning experiences. In order to identify these pupils, assessment tests of both scholastic aptitude and achievement are used to assess pupil variability. This discussion focuses on the role of criterion referenced tests and norm referenced tests in the teaching and learning process.

Definition of key terms
Criterion referenced test
According to Popham and Hesek (1969),a criterion referenced test is a measure used to identify an individual’s status with respect to an established standard of performance .Similarly ,Mpofu E (1991),says a criterion referenced test measures whether a student has or has not reached the criterion or specific level of achievement .This means that criterion referencing as the name implies ,involves determining a student ‘s grade by comparing his or her achievements with clearly started criteria for learning outcomes and clearly stated standards for particular levels of performance. The major focus is on how pupils’ skills and abilities are measured and tested in the classroom.
Norm Referenced test Popham and Husek (1969), define a norm –referenced test as a measure used to identify an individual’s performance of others in the same measure .Glaser (1963), defines norm –referenced tests as measures of students ’performances against the scores achieved by others completing the same test. These definitions lead us to focus on the ability of norm referenced tests to be useful for classification, selection and making decisions as to how much a student has learnt in comparison to others.

BODY
Criterion referenced test can be used to evaluate individualized learning programmes , diagnosing student difficulties ,estimating student abilities in a particular area ,measuring what a student has learned ,certification of competency ,controlling entry to successive units of construction and selection. Such test scores depend upon the specifying of an absolute standard of quality .This standard is independent of scores achieved by other students attempting the same test and completing the same course. Criterion referencing is worth aspiring towards .Criterion referencing requires giving thought to expected learning outcomes ,therefore, it is transparent for students ,and the grades derived should be defensible in reasonably objective terms .Though criterion referenced tests, students are able to trace their grades to the specifics of their performance on set tasks.
Criterion referencing lays an important framework for student engagement with learning process and its outcomes. Recognizing, however, that some degree of subjectivity is inevitable in higher education, it also worthwhile to monitor the grade distribution, that is ,to use a modest process of norm-referencing to watch outcomes of a pre-dominantly criterion-referencing grading model. In doing so, if it is believed too many students are receiving high grades, or the distribution is some way oddly spread, then this might suggest something is amiss and the assessment process needs looking at. There may be , for instance, a problem with the overall degree of difficulty of the assessment tasks for example, not enough challenging examination questions , or too few or assignment tasks that fail to discriminate between students with differing levels of knowledge and skills. There might also be inconsistencies in the way f different assessors are judging student’s work.
Leo M. Schell (1981), views the essential characteristic of norm referencing as that students are awarded their grades on the basis of their ranking within a particular cohort. Norm referencing involves fitting a ranked list of students ‘raw-scores ’to pre-determined distribution for awarding grades. Usually, grades are spread to fit a’ bell curve’ or a’ normal distribution curve’, either by quantitative, informal rough –reckoning or by statistical techniques of varying complexity. For large students’ cohorts, such as in senior secondary education, statistical moderation processes are used to adjust or standardize students scores to fit a normal distribution .This adjustment is necessary when comparability to scores across different subjects is required, such as when subject scores are added to create an aggregate ENTER score for making university selection decisions.
Norm referencing is based on the assumption that roughly similar range of human performance can be expected for any student or group .There is a strong culture of norm referencing in higher education .It is evident in many common place practices, such s the expectation that the mean of a cohort‘s results should be a fixed percentage year in ,year out. It can also be seen when first class honors is awarded sparingly to a set number of students .In contrast ,criterion referencing has no pre-determined grade distribution to be generated and a student’s grades is in no way influenced by the performance of others. Theoretically, all students within a particular cohort could receive very high or very low grades depending solely on the levels of individual’s performances against the established criterion and standard. Thus, the goal of criterion referencing is to report student achievement against objective or reference points that are independent of the cohort being assessed.
Raymond Sumner and T.Robertson (1977), discovered that criterion referencing can lead to simple pass-fail grading schema, such as in determining fitness to practice in professional fields. Criterion referencing can lead to reporting student achievement or progress on a series of key criteria rather than as a single grade or percentage .Logically ,norm referencing must rely on some initial criterion -referencing can lead to reporting student achievement or progress on a single grade or percentage .Logically ,norm –referencing must v rely on some initial criterion –referencing ,since students ’’ raw’ scores must presumably be determined in the first instance by assessors who have some objective criteria in mind . Criterion referencing, on the other hand, appears more educationally defensible but it may be very difficult, if not impossible, to implement in a pure form in many disciplines. It is not always possible to be entirely objective and to comprehensively articulate criteria for learning outcomes .Some subjectivity in setting and interpreting levels of achievement is inevitable in higher education. This being the case, sometimes the best we can hope for is to compare individuals’ achievements relative to their peers.
Norm referencing on its own, if strictly and narrowly implemented, is undoubtedly unfair. With norm referencing, a student’s grade depends, not only on his or her level of achievement, but also on the achievement of other students. This might lead to obvious inequalities if applied without thought to any other considerations, for example, a student who fails in one year may well have passed in other years. The potential for unfairness of this kind is most likely in smaller student cohorts, where norm referencing may force a spread of grades and exaggerate differences in achievement. Alternatively, norm referencing might artificially compress the range of difference that actually exists.
Linn Gronlund (2000) regards a criterion referenced test as “a test or other type of assessment designed to provide a measure of performance that is interpretable in terms of a clearly defined or delimited domain of learning tasks”. The goal of a criterion referenced test is to obtain a description of the specific knowledge and skills each student can demonstrate. This information is useful for planning both group and individual instruction. Criterion referenced tests can be scored in the way of checklists, rating scales, grades, rubrics and percent accurate. This matches Mpofu. E (1991) observation that a criterion referenced test is one that provides for translating test scores into a statement about the behavior to be expected of a person with that score or their relationship to a specified subject matter. The objective is simply to see whether the student has learned the material.
The criterion is the domain of subject matter that the test is designed to assess, for instance, “students should be able to calculate the mean temperature for a given weather station” and the cut score maybe that students should correctly answer a minimum of 80 percent of the questions to pass. However, a number of criticisms have been leveled against criterion referencing. Some scholars say criterion referencing tells us what a student knows or can do, but not the degree of excellence or deficiency of the student’s performance in relation to peers. Some say it is unrealistic to expect teachers to provide the degree of detail necessary in writing instructional objectives for good and reliable criterion reference measures to be obtained. Moreover, knowledge and understanding do not lend themselves to clear definition and, hence, it is extremely difficult to establish adequate criterion for achievement. Criterion referencing measures discourage the use of problem solving questions and instead, encourage right and wrong solutions, with a tendency towards teachers determining various answers while student is constrained to choose from the teacher’s selection.
Tests constructed to provide norm referencing will not adequately sample the course objectives. A final grade received by a student in any one subject conceals the student’s misunderstandings, inadequate study skills and potential limitations in that subject. To have meaning for such interpretation, any individual’s score needs to be related to the content of the test. Over a period of time, some students who are continually exposed to norm reference tests will suffer diminishing level of motivation. This is because any given mark does not signify a definite amount of knowledge, and hence has little relevance for content or absolute framework reference. Black and Dockwell (1980) noted that most cases where formative or continuous assessment took place, feedback was in the form of general attainment grade or real and no real information about specific strengths and weaknesses. Furthermore, assessment took place at the end of each unit of work by which time it was too late to take remedial action. Therefore , if students are helped when and where they have learning difficulties, given sufficient time to achieve mastery, and there is some clear criterion of what constitutes mastery, a high level of learning will be achieved (Bloom, 1976).

Conclusion
Both criterion reference test and norm reference tests are essential components of teaching strategies. There is need for feedback of information to students as to their progress thus making each test part of a learning experience. In my own point of view, best practice in grading in education involves striking balance between criterion referencing and norm referencing. This balance should be strongly oriented towards criterion referencing as the primary and dominant principle.

References
Black and Dockrell (1980) Diagnostic Assessment in Secondary Schools. Scottish Council for Research in Education.
Bloom, B.S (1976) Handbook on Formative and Summative Evaluation of Student Learning. McGraw-Hill.43-60. New York.
Glaser,R (1963) Instructional Technology and Measurements of Learning Outcomes, American Psychologist,Vol.18:519-521
Linn, R.L and Gronhund, N.E (2000) Measurement and Assessment in Teaching (8th ed) Upper Saddle River, NJ: Prentice Hall
Mpofu, E (1991) Testing for Teaching. Harare: Longman
Popham, W.J and Husek, T.R (1969) Implications of Criterion Referenced Measurement. Journal of Educational Management. Wiley.
Robertson, T.S and Sumner, R (1977) Criterion Referenced Measurement and Criterion Referenced Tests. NFER Publishing Co.
Schell, L.M (1981) Diagnostic and Criterion Referenced Reading Tests: Review and Evaluation, IRA. The University of Michigan.

Similar Documents

Free Essay

Test

...Quantitative research methods in educational planning Series editor: Kenneth N.Ross Module John Izard 6 Overview of test construction UNESCO International Institute for Educational Planning Quantitative research methods in educational planning These modules were prepared by IIEP staff and consultants to be used in training workshops presented for the National Research Coordinators who are responsible for the educational policy research programme conducted by the Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ). The publication is available from the following two Internet Websites: http://www.sacmeq.org and http://www.unesco.org/iiep. International Institute for Educational Planning/UNESCO 7-9 rue Eugène-Delacroix, 75116 Paris, France Tel: (33 1) 45 03 77 00 Fax: (33 1 ) 40 72 83 66 e-mail: information@iiep.unesco.org IIEP web site: http://www.unesco.org/iiep September 2005 © UNESCO The designations employed and the presentation of material throughout the publication do not imply the expression of any opinion whatsoever on the part of UNESCO concerning the legal status of any country, territory, city or area or of its authorities, or concerning its frontiers or boundaries. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means: electronic, magnetic tape, mechanical, photocopying, recording or otherwise, without permission ...

Words: 13966 - Pages: 56

Premium Essay

Eda 577

...efficient school goal. GOALS ACCEPTED REJECTED REASONING PREFERENCE • Model for preference: 1- Relevant 2- Achievable 3- Statistically Significant Brainstorm Questions Important for Change Very Important Immediate Change School Plan • Rating Scale: 1- High 2-Medium 3-Low Once the goals have been determined, responsibility of what testing needs to be administered and who is held accountable for collecting-analyzing the data. An example of finding the right data that Camden City Accelerated Academy decided upon was to increase the number of 11th grade students who meet or exceed the HSPA State Test by 5% each year. The goal-brainstormed questions included if the HSPA State Test scores would increase if we included benchmark assessment questions that were structured like the ones on the state test. Who will be in charge of establishing the...

Words: 532 - Pages: 3

Free Essay

How Can We Fix Academically Failing Schools

...In 2000, President George Bush signed into law the no child left behind act. This act was supposed to help get children caught up to grade level math, reading, and science test scores. After 12 years about 82 percent of all the nations’ schools are considered to be failing academically (Dillon).What is a failing school? A failing school is a school where the majority of its students failed to do well on standardized tests that were provided during the school year. The problem is that these schools are found all over the United States. What can be done? How can we fix these failing schools? Who is to blame? Most people would blame the teacher first and foremost, but I disagree. In this paper I will discuss what we can do to fix schools that are failing academically. I will argue that adding early childhood education classes, changing curriculum, and modifying standardized tests are all effective steps in correcting the problems that failing schools continually face. I will support my argument by using the views of authors such as Alfie Kohn and his ideas of making the curriculum more entertaining to make learning easier, Fred Lunenburg’s ideas that preschool is a critical point to achieve success later on in school, Sam Dillon’s views about how the No child left behind act has hurt more public schools than helped them, and other researchers as well. One step I feel that could help with fixing schools that are failing academically is by adding free early childhood education to...

Words: 3368 - Pages: 14

Premium Essay

Busi 4940 Final Exam

...COMPREHENSIVE EXAM Business Policy (BUSI 4940) TEAM #: _________ STUDENT NAME: ________________________________________ STUDENT ID: ________________________________________ INSTRUCTIONS: o Please read the supplemental material provided by the instructor on the day of the exam, and answer the following questions in the context of the industry and the firm discussed in the supplemental material. o Answer all questions on the exam. Maximum points for the exam = 200 points (each question is worth 40 points). o There is no limit to the length of your answers. However, recognize that this is a time-constrained examination, and brevity is critical to complete the exam in the allotted time. o This exam begins at 6:30 pm and ends at 9:20 pm, at the physical location provided by the instructor. o At the end of the exam, please remember to hit the submit button. You must complete the submission before 9:20 pm. GOOD LUCK! GIVE IT YOUR BEST SHOT! 1. Identify forces prevalent in the environment a) Conduct a PEST analysis. Identify and describe 2 to 3 of the most influential forces in the broad environment. b) Conduct a 5-forces analysis. Identify and describe 2-3 of the most influential forces in the competitive (industry) environment. 2. Use your response to questions 1a & 1b above, and the theory taught in class, to answer the following questions: ...

Words: 607 - Pages: 3

Premium Essay

Wdqd

...provide a total of 120 credits, which is equivalent to two GCE’s. The Units you will be completing are as follows: Unit: | Name: | 1 | The Business Environment (M) | 2 | Business Resources (M) | 3 | Introduction to Marketing (M) | 4 | Business Communication (M) | 5 | Business Accounting (O) | 10 | Market Research in Business (O) | 12 | Internet Marketing in Business (O) | 13 | Recruitment and Selection in Business (O) | 15 | Development Planning for a Career in Business (O) | 16 | Human Resource Management in Business (O) | 29 | Understanding Retailing (O) | 36 | Starting a Small Business (O) | Assessment and Grading: In BTEC Nationals all units are internally assessed. All assessment for BTEC Nationals is criterion referenced, based on the achievement of specified learning outcomes. Each unit within the qualification has specified assessment and grading criteria which are to be used for grading purposes. A summative unit grade can be awarded at pass, merit or distinction: * To achieve a ‘pass’ a learner must have satisfied all the pass assessment criteria * To achieve a ‘merit’ a learner must additionally have satisfied all the merit grading criteria * To achieve a ‘distinction’ a learner must additionally have satisfied all the distinction grading criteria. * Learners who complete the unit but who do not meet all the pass criteria are graded ‘unclassified’. How do I calculate my grade? To calculate your final grade you must times...

Words: 386 - Pages: 2

Free Essay

How I Met Your Mother Today

...interested in education reform or education policy could also be included as part of the audience. Writer’s background: Ravitch is an educational researcher and a former professor. Writer’s angle: Any discussion regarding how to best implement education reform in our schools is arguable, especially when the subject of standardized testing is involved. Individuals will hold different views on the topic depending on their political backgrounds, affiliations with education policy, and position on standardized testing. Ravitch is opposed to the use of standardized tests and believes they have a negative effect on schools. Part 1: The one-sentence summary Ravitch (2011), U.S. Department of Education’s Assistant Secretary of Education, criticizes the Obama administration for following Bush’s No Child Left Behind policy, explaining that the government places an overreliance on standardized test scores and teaching to the test over rich curriculum and true reform for underachieving schools. Part 2: The one-paragraph summary Ravitch (2011), U.S. Department of Education’s Assistant Secretary of Education, warns that the Obama administration’s control over education reform continues much of the same agenda introduced by the Bush administration’s No Child Left Behind policy. Ravitch argues...

Words: 719 - Pages: 3

Free Essay

Assessment Matrix

...Assessment Matrix Grand Canyon University SPE-359 | Norm Referenced | Criterion Referenced | Descriptions | * Norm referenced tests are most often used for placement * Designed to create distinctions amongst students * Tests are scored as a percentage or percentile ranking(EdGlossary, 2015) | * Criterion tests are better known as Standardized tests * Designed by a specific committee of experts * Tests are scored as percentages. * Teachers create this type of test to determine content retention. (EdGlossary.2014) | Purpose | * These tests are to determine where a student ranks amongst peers. * Compare students to peers of the same age or grade level * Used for placement such as college or academic grouping(EdGlossary.2015) | * These tests are designed to determine if a student has achieved a specific goal or skill. * Identify any learning disabilities. * Identify any gaps among students of different groups. * To hold teachers accountable.(EdGlossary.2014) | Content | These tests are typically based on national standards.(EdGlossary.2015) | These tests measure a broad skill area based on text books or specific criterion chosen by the school district (EdGlossary.2014). | Characteristics | Often use multiple choice format. Some may include open ended questions or short answer questions (EdGlossary.2015). | Typically tests with multiple choice questions to determine content knowledge and scored by a percentage (EdGlossary.2014)...

Words: 470 - Pages: 2

Free Essay

Issues Facing Curriculum Alignment

...knowledge/content. This orientation posits that the learner is in the best position to assess his or her needs and what content meets those needs. The personal relevance orientation emerges from the projects that each student selects, designs and evaluates. The project based approach enables learners to set their own objectives, direct the learning experiences needed to meet those objectives, and evaluate when those objectives have been met successfully (Chiarelott, 2006). Examine the elements of norm-referenced and criterion-referenced testing, and determine how to apply these methods in the proposed curriculum design. Norm-referenced tests (NRT) help compare the performance of one student with the performances of a large group of students, while criterion-referenced tests (CRT) focus on "what test takers can do and what they know, not how they compare to others." Both types of test can be standardized so that scores can be interpreted the same way for all students and schools. Test content for an NRT is selected according to how well it ranks...

Words: 1720 - Pages: 7

Premium Essay

Psychology

...or its affiliate(s). . . . . . . . . . ASSESSMENT REPORT Administration Practices for Standardized Assessments Administration Practices for Standardized Assessments Note: This report is based on “Appropriate Administration Practices with Standardized Tests” published in Testing Information Bulletin No. 3 by Harcourt Brace Educational Measurement, June 1996. Introduction Pearson Inc. (Pearson) develops and distributes a variety of assessments for educational and clinical purposes. To meet the goal of producing highly valid, reliable results for test users, each of these products is developed according to strict guidelines. For standardized tests, the way in which the test is administered is equally important. By carefully adhering to administration practices, a test user can contribute to the validity and reliability of each student’s results. Moreover, following appropriate administration practices satisfies widely accepted ethical standards and codes of responsibilities required for test administrators. This report discusses general and documented administration practices for standardized assessments, especially with regard to Pearson’s educational assessment products, such as the Stanford Achievement Test Series, Tenth Edition (Stanford 10). Assessment Standardization The way in which an assessment is administered to students is especially important for standardized assessments. During the development process, standardization establishes uniform...

Words: 4351 - Pages: 18

Premium Essay

Assessment of Reading

...Alma J. Bosket Curriculum, Methods and Assessment: Literacy and Language Arts-EED-470 Professor Katie G. Troub September 23, 2012 Assessment of Reading Chart |Assessments |Characteristics |Compare and | | | |Contrast | | | | | |Developmental Reading |A set of individually administered criterion |Modeled after an informal reading inventory that is | |Assessment |referenced reading assessments for students |intended to be administered, scored, and interpreted by | |(DRA) |in Kindergarten through 8th Grade. |classroom teachers. | | | |In addition, its purposes include identifying students’ | | | |reading strengths and weaknesses, planning instruction, | | | |monitoring reading growth, for preparing students to meet| | | ...

Words: 813 - Pages: 4

Premium Essay

Standardized Testing Informative Essay

...The first standardized tests appeared in America during World War I as a means of placing U.S. Army recruits into military roles that suited their skills. Later the psychologists that created those tests created the Scholastic Aptitude Test, or SAT. The objective was to create a full-length test to judge the overall intelligence of a student applying to college. The ACT was later created in 1959 with a similar goal. The two tests today contain sections for reading, writing, math, and in the ACT, science. Today, standardized tests are defined as any examination that is managed and scored in a standard way. Throughout time standardized tests have been progressively changing in their measurement of individuals. Today there are two noteworthy sorts...

Words: 1456 - Pages: 6

Premium Essay

Standardized Testing Annotated Bibliography

...Standardized Testing and Its Effects: An Annotated Bibliography The first standardized test was administered by Horace Mann in the nineteenth century as as a result of the concern with the educational reform in America (Gallagher, 2003). Although the students’ results were disappointing, this lead to the movement of using standardized tests throughout curriculum. In spite of the controversy, the popularity of this form of testing has increased greatly over time. The debate on standardized tests has been an ongoing issue throughout history. While some believe that these tests are an unjust, incorrect way to measure intelligence, others suggest that standardized testing is a vital part of the educational process. In order to gather an unbiased...

Words: 1428 - Pages: 6

Premium Essay

Pro Standardized Testing

...in the 7th Century Imperial China where the test was administered to people seeking jobs in the government (Mathews). The tested used by the Chinese tested the applicants' knowledge of Confucian philosophy and were used up until 1898 (Crozier). For the Western world, the Industrial Revolution brought about the movement to bring school aged kids working in factories and on farms to the classroom. Standardized testing allowed the newly expanded student body to be tested efficiently (Jehlen). The use of standardized testing exponentially rose after the passing of the No Child Left Behind Act in 2002 which mandated annual testing in all 50 states (Coulson). The use of standardized testing is now split into a like or dislike because of the amount of achievement, the reliability, and the amount of discrimination they bring. Achievement brings about the sense of accomplishment and opponents of standardized testing believe that standardized testing does not bring about a sense of accomplishment because standardized testing has not improved student achievement. After the No Child Left Behind Act passed in 2002, the United States decreased from 18th in the world in math on the Programme for International Student Assessment to 31st place in 2009 and with a lesser decrease in science but no change in the ranking for reading (Walker). Opponents of standardized testing use a National Research Council report from 2011 that found no evidence that test-based incentive programs are working as a...

Words: 1713 - Pages: 7

Premium Essay

Standardized Testing And Student Achievement

...grades kindergarten through 12th grade combined take about 113 mandated tests annually (Strauss). This staggering statistic has led to the debate on whether standardized testing should be used by school districts across the United States to determine student achievement. As a result of this onslaught of tests to the rising generation of students, it has led to an uproar of angry parents, students, and even educators. Why do we still continue to overload our students with these immeasurable, redundant standardized tests every school year? Standardized testing should not be used to determine student achievement. These needless mandated tests damage the learning...

Words: 1164 - Pages: 5

Free Essay

Hows My Child Doing

...a developmental test for children from birth-eight years old. The test takes about one or two hours if you do a complete BDI-2, and only 10–30 minutes for a screening test. This assessment can be used by an individual service provider or by a team of professionals. The BDI-2 can also be administered to children who have a variety of handicapping conditions by using modifications stated for the assessment tool (Newborg, 2004). The BDI-2 test is best for several uses: to identify children with disabilities; to evaluate groups of children with disabilities in Early Education Programs; to assess the typical developing child; to assess children for school readiness; and to evaluate the program for accountability. This new edition offers many new features. There are more child-friendly manipulatives and more colorful items for all ages of children. It offers new comprehensive norms, which are sympathetic to the quick development of children. It also offers a clear, all-inclusive scripted interview items that offer probes for follow-up (Newborg, 2004). This assessment can be scored via computer or hand scored processing. This test also offers an increased range of items that measure development from birth to eight years in all domains. Administration of this assessment can start in any of the five domains with the starting point for every subdomain being distinctly marked and defined by age or the approximated ability level of the child. Administers of the test progress through...

Words: 301 - Pages: 2