Free Essay

# Analyze the Results of Linker Scale

In:

Submitted By thanhck
Words 1356
Pages 6
EDITORIAL

Analyzing and Interpreting Data From
Likert-Type Scales

L

ikert-type scales are frequently used in medical education and medical education research. Common uses include end-of-rotation trainee feedback, faculty evaluations of trainees, and assessment of performance after an educational intervention. A sizable percentage of the educational research manuscripts submitted to the
Journal of Graduate Medical Education employ a Likert scale for part or all of the outcome assessments. Thus, understanding the interpretation and analysis of data derived from Likert scales is imperative for those working in medical education and education research. The goal of this article is to provide readers who do not have extensive statistics background with the basics needed to understand these concepts.
Developed in 1932 by Rensis Likert1 to measure attitudes, the typical Likert scale is a 5- or 7-point ordinal scale used by respondents to rate the degree to which they agree or disagree with a statement (T A B L E). In an ordinal scale, responses can be rated or ranked, but the distance between responses is not measurable. Thus, the differences between ‘‘always,’’ ‘‘often,’’ and ‘‘sometimes’’ on a frequency response Likert scale are not necessarily equal. In other words, one cannot assume that the difference between responses is equidistant even though the numbers assigned to those responses are. This is in contrast to interval data, in which the difference between responses can be calculated and the numbers do refer to a measureable ‘‘something.’’ An example of interval data would be numbers of procedures done per resident: a score of 3 means the resident has conducted 3 procedures. Interestingly, with computer technology, survey designers can create continuous measure scales that do provide interval responses as an alternative to a Likert scale. The various continuous measures for pain are well-known examples of this (F I G U R E 1).

Gail M. Sullivan, MD, MPH
Anthony R. Artino Jr, PhD

converted to numbers, can be treated as interval data.2 That is, can means, standard deviations, and parametric statistics, which depend upon data that are normally distributed (F I G U R E 2), be used to analyze ordinal data?
When conducting research, we measure data from a sample of the total population of interest, not from all members of the population. Parametric tests make assumptions about the underlying population from which the research data have been obtained—usually that these population data are normally distributed. Nonparametric tests do not make this assumption about the ‘‘shape’’ of the population from which the study data have been drawn.
Nonparametric tests are less powerful than parametric tests and usually require a larger sample size (n value) to have the same power as parametric tests to find a difference between groups when a difference actually exists. Descriptive statistics, such as means and standard deviations, have unclear meanings when applied to Likert scale responses. For example, what does the average of ‘‘never’’ and ‘‘rarely’’ really mean? Does ‘‘rarely and a half’’ have a useful meaning?3 Furthermore, if responses are clustered at the high and low extremes, the mean may appear to be the neutral or middle response, but this may not fairly characterize the data. This clustering of extremes is common, for example, in trainee evaluations of experiences that may be very popular with one group and perceived as unnecessary by others (eg, an epidemiology course in medical school). Other non-normal distributions of response data can similarly result in a mean score that is not a helpful measure of the data’s central tendency.
Because of these observations, experts over the years have argued that the median should be used as the measure of central tendency for Likert scale data.3 Similarly, experts have contended that frequencies (percentages of responses in each category), contingency tables, x2 tests, the

The Controversy

In the medical education literature, there has been a longstanding controversy regarding whether ordinal data,
Gail M. Sullivan, MD, MPH, is Editor-in-Chief of the Journal of Graduate
Medical Education, and Anthony R. Artino Jr, PhD, is Associate Professor of
Medicine and Preventive Medicine and Biometrics, Uniformed Services
University of the Health Sciences.
Corresponding author: Gail M. Sullivan, MD, MPH, University of Connecticut,
253 Farmington Avenue, Farmington, CT 06030-5215, gsullivan@nso1.uchc.edu DOI: http://dx.doi.org/10.4300/JGME-5-4-18

FIGURE 1

Continuous Measure Example

Please tell us your current pain level by sliding the pointer to the appropriate point along the continuous pain scale above.

Journal of Graduate Medical Education, December 2013 541

EDITORIAL

TABLE

Typical Likert Scales

1

2

3

4

5

Never

Rarely

Sometimes

Often

Always

Completely disagree

Disagree

Neutral

Agree

Completely agree

Spearman rho assessment, or the Mann-Whitney U test should be used for analysis instead of parametric tests, which, strictly speaking, require interval data (eg, t tests, analysis of variance, Pearson correlations, regression).3
However, other experts assert that if there is an adequate sample size (at least 5–10 observations per group) and if the data are normally distributed (or nearly normal), parametric tests can be used with Likert scale ordinal data.3
Fortunately, Dr. Geoff Norman, one of world’s leaders in medical education research methodology, has comprehensively reviewed this controversy. He provides compelling evidence, with actual examples using real and simulated data, that parametric tests not only can be used with ordinal data, such as data from Likert scales, but also that parametric tests are generally more robust than nonparametric tests. That is, parametric tests tend to give
‘‘the right answer’’ even when statistical assumptions— such as a normal distribution of data—are violated, even to an extreme degree.4 Thus, parametric tests are sufficiently robust to yield largely unbiased answers that are acceptably close to ‘‘the truth’’ when analyzing Likert scale responses.4
Educators and researchers also commonly create several Likert-type items, group them into a ‘‘survey scale,’’ and then calculate a total score or mean score for the scale items. Often this practice is recommended, particularly when researchers are attempting to measure

less concrete concepts, such as trainee motivation, patient satisfaction, and physician confidence—where a single survey item is unlikely to be capable of fully capturing the concept being assessed.5 In these cases, experts suggest using the Cronbach alpha or Kappa test or factor analysis technique to provide evidence that the components of the scale are sufficiently intercorrelated and that the grouped items measure the underlying variable. The Bottom Line

Now that many experts have weighed in on this debate, the conclusions are fairly clear: parametric tests can be used to analyze Likert scale responses. However, to describe the data, means are often of limited value unless the data follow a classic normal distribution and a frequency distribution of responses will likely be more helpful.
Furthermore, because the numbers derived from Likert scales represent ordinal responses, presentation of a mean to the 100th decimal place is usually not helpful or enlightening to readers.
In summary, we recommend that authors determine how they will describe and analyze their data as a first step in planning educational or research projects. Then they should discuss, in the Methods section or in a cover letter if the explanation is too lengthy, why they have chosen to portray and analyze their data in a particular way.

References

FIGURE 2

A Normal Distribution

542 Journal of Graduate Medical Education, December 2013

1 Likert R. A technique for the measurement of attitudes. Arch Psychology.
1932;22(140):55.
2 Carifio L, Perla R. Resolving the 50-year debate around using and misusing
Likert scales. Med Educ. 2008;42(12):1150–1152.
3 Jamieson S. Likert scales: how to (ab)use them. Med Educ. 2004;38(12):1217–
1218.
4 Norman G. Likert scales, levels of measurement and the ‘‘laws’’ of statistics.
Adv Health Sci Educ Theory Pract. 2010;15(5):625–632.
5 Rickards G, Magee C, Artino AR Jr. You can’t fix by analysis what you’ve spoiled by design: developing survey instruments and collecting validity evidence. J Grad Med Educ. 2012;4(4):407–410.

### Similar Documents

#### Assignment 1

...German based family owned global discount chain of supermarkets. Aldi constitutes of two independent groups, that are Aldi Nord (North) and Aldi Sud (South) legally and economically independent but family related (Aldi Sud Business, 2013). It is the market leader in the industry of international grocery retailing and owns and operates chain of discount grocery stores in Europe, Australia and United States. It’s stores retail and supply general merchandise and food including meat products, fresh meat, frozen and refrigerated foods, sweets and snacks, dairy and bakery products, beverages and pantry items in addition to home care and personal care products (Report Linker, 2013). In the present Aldi Inc.’s strategic analysis is carried out to identify and evaluate its strategies against its business environment to critically analyze whether the strategies pursued by Aldi are effective in maintaining its market leader position or not. In doing so environmental analysis of international grocery retailing industry is carried out to bring about the opportunities and threats the industry is facing and SWOT...

Words: 4027 - Pages: 17

#### Biometric

...http://link.springer.com/chapter/10.1007/978-3-642-01793-3_20 Eigenvalue estimation plays an important role in biometrics. However, if the number of samples is limited, estimates are significantly biased. In this article we analyse the influence of this bias on the error rates of PCA/LDA based verification systems, using both synthetic data with realistic parameters and real biometric data. Results of bias correction in the verification systems differ considerable between synthetic data and real data: while the bias is responsible for a large part of classification errors in the synthetic facial data, compensation of the bias in real facial data leads only to marginal improvements. https://www.eff.org/wp/biometrics-whos-watching-you September 14, 2003 September 2003 Introduction Among the many reactions to the September 11 tragedy has been a renewed attention to biometrics. The federal government has led the way with its new concern about border control. Other proposals include the use of biometrics with ID cards and in airports, e.g. video surveillance enhanced by facial-recognition technology. The purpose of this document is to sketch out EFF's concerns about biometrics. In today's public arena, biometric technologies are being marketed as a "silver bullet" for terrorism; however, very little independent, objective scientific testing of biometrics has been done. Deploying biometric systems without sufficient attention to their dangers makes them likely to be used in a...

Words: 7685 - Pages: 31

#### Amino Acids

...Protein Engineering Programme: B.Tech (Biotech) 6th Semester Course code: BIT 317 (3 credits) Unit 1 – Introduction Winter 2012-13 Dr. Everette Jacob Remington N, Ph.D Associate Professor & Ramalingaswami Fellow Biomedical Sciences Division & Gene Therapy Laboratory School of Biosciences and Technology VIT University, Vellore - 632 014, TN 1 Course objective  To make the student familiarize with the basics, concepts and application of protein engineering Expected course outcome   Explain the principles involved in the maintenance of protein structure Analyze the given protein structure and predict the sites to be engineered for altering/introducing a specific property 2 Course Outline  Unit 1 – Introduction (9 hrs) Unit 2 – Protein Sequences and Properties (9 hrs) Unit 3 – Conformation of Proteins (9 hrs) Unit 4 – Principles and Approach (9 hrs) Unit 5 – Probing Structure for Molecular Recognition (9 hrs)     3 Unit 1 Introduction (9 hrs)       Amino acid structure and properties Detection of the size of proteins Covalent structures in proteins Overview of chemical and biosynthesis of proteins Topogenesis Post-translational covalent modification of polypeptide chains 4 Amino Acids     Amino acids are molecules containing an amine group, a carboxylic acid group, and a side-chain that is specific to each amino acid The amino group is attached to the carbon atom immediately adjacent to the carboxylate...

Words: 3947 - Pages: 16

Free Essay

Words: 79060 - Pages: 317

#### Strategic Positioning

...Strategic Positioning and Sustainable Competitive Advantage in Food Industry Abstract Purpose – This paper examines the concepts of sustainable competitive advantage (SCA) and strategic positioning (SP) and seeks to develop a framework on determinants of SP and SCA in the food industry following the case study approach. Design/methodology/approach – This paper analyzes the concepts of strategic positioning and sustainable competitive advantage and their interrelation. The qualitative study of three beverage producers is conducted. Cases are analyzed based on the theoretical models discussed in the first part of the paper. Findings - This paper provides comparison of positioning strategies and SCA of three international beverage producers. The theoretical framework on determinants of these concepts was developed and applied for case study. The concepts of SCA and SP are interchanging, but from the case study it was not possible to conclude whether one leads to another. There is no single theory found which would be universal in explaining the success of the brands. Companies are complex structures and their success depends on many different elements which should be analyzed in combination. Research limitations/implications – The findings are based solely on the case analysis of three unique beverage companies. To generalize conclusions the research of other companies in food industry on possession of SCA and their positioning strategies is needed. Not all firsthand information...

Words: 22733 - Pages: 91

#### Mr.Doc

...Management Information Systems Course Notes Compiled by: Stephen Katoto For: MASINDE MULIRO UNIVERSITY OF SCIENCE & TECHNOLOGY Table of Contents 1.0 The Information Systems Revolution 1 A. Why Information Systems? 1 B. Contemporary approaches to Information Systems 2 C. Other current Trends in Information Technology 4 2.0 The Information systems Revolution 9 A. The New Role of Information Systems in Organization 9 B. Learning to use information systems: New Opportunities with technology 10 3.0 The Strategic Role of Information Systems 14 A. Organizations and Information Systems 14 B. Information systems & Business Strategy 20 4.0 Information Systems, Organizations and Business Strategy 28 A. Organizations and Information Systems 28 B. How Organization Affect Information Systems 33 C. How Information Systems Impact organizations and Business firms 35 5.0 Information, Management & Decision Making 39 A. Introduction to Decision Making 39 B. Individual Models of Decision Making 42 C. Organizational Models of Decision Making 43 D. The Impact of IT Management Process 44 6.0 Ethics & Social Impact of Information systems 46 A. The Importance of Ethics in Information Systems 46 B. Electronic Networks 46 C. The Moral Dimensions of Information Systems 50 7.0 Computer and Computer Processing 57 A. What is a Computer? 57 B. Systems Approach 58 C. Classification of computers 64 8.0 Information Systems Software 66 ...

Words: 28751 - Pages: 116

#### Social Network Sites: Definition, History, and Scholarship

...Social Network Sites: Definition, History, and Scholarship  danah m. boyd  School of Information University of California-Berkeley  Nicole B. Ellison  Department of Telecommunication, Information Studies, and Media  Michigan State University    ------------------------------------------------- Top of Form                         Bottom of Form Abstract Social network sites (SNSs) are increasingly attracting the attention of academic and industry researchers intrigued by their affordances and reach. This special theme section of theJournal of Computer-Mediated Communication brings together scholarship on these emergent phenomena. In this introductory article, we describe features of SNSs and propose a comprehensive definition. We then present one perspective on the history of such sites, discussing key changes and developments. After briefly summarizing existing scholarship concerning SNSs, we discuss the articles in this special section and conclude with considerations for future research. Introduction Since their introduction, social network sites (SNSs) such as MySpace, Facebook, Cyworld, and Bebo have attracted millions of users, many of whom have integrated these sites into their daily practices. As of this writing, there are hundreds of SNSs, with various technological affordances, supporting a wide range of interests and practices. While their key technological features are fairly consistent, the cultures that emerge around SNSs are varied. Most sites...

Words: 14098 - Pages: 57

Free Essay

#### Bsb Sick Rehabilitation

...Internship Report ON [pic] YOUR INVESTMENT PARTNER. Internship Report ON Sick Industry Rehabilitation Of Bangladesh Shilpa Bank Submitted To Mr: Mamtazuddin Ahmed Professor Department of Accounting & Information Systems University of Dhaka Submitted By Md. Zakir Hossain BBA (AIS), 8th Batch Roll-161 Department of Accounting & Information Systems University of Dhaka. DEPARTMENT OF ACCOUNTING & INFORMATION SYSTEMS UNIVERSITY OF DHAKA May 10, 2007 LETTER OF TRANSMITTAL Date: 10/05/2007 Mr: Mamtazuddin Ahmed Professor Department of Accounting & Information Systems University of Dhaka Sub: Submission of internship report on “Sick Industry Rehabilitation Of Bangladesh Shilpa Bank” Dear Sir, Here is my internship report on “Sick industry Rehabilitation of Bangladesh Shilpa Bank.” While preparing this report, I tried my best to follow the instructions that you have given me. This report is prepared for the fulfillment the requirement of the BBA Program. The entire report is based on my practical experiences in bank. I have furnished all the things what I have learnt during the internship program at Bangladesh Shilpa Bank, Head Office, Dhaka. I shall be highly encouraged if you are kind enough to receive this report. Thanking you. Sincerely yours, -------------------------- Md. Zakir Hossain BBA (AIS), 8th Batch Roll-161 Department of...

Words: 14124 - Pages: 57

#### Analysis

...SEVENTH EDITION PROBLEM SOLVING AND PROGRAM DESIGN in C This page intentionally left blank SEVENTH EDITION PROBLEM SOLVING AND PROGRAM DESIGN in C Jeri R. Hanly, University of Wyoming Elliot B. Koffman, Temple University Boston Columbus Indianapolis New York San Francisco Upper Saddle River Amsterdam Cape Town Dubai London Madrid Milan Munich Paris Montreal Toronto Delhi Mexico City Sao Paulo Sydney Hong Kong Seoul Singapore Taipei Tokyo Editorial Director, ECS: Marcia Horton Editor-in-Chief: Michael Hirsch Senior Project Manager: Carole Snyder Director of Marketing: Patrice Jones Marketing Manager: Yezan Alayan Senior Marketing Coordinator: Kathryn Ferranti Director of Production: Vince O’Brien Managing Editor: Jeff Holcomb Associate Managing Editor: Robert Engelhardt Production Manager: Pat Brown Creative Director: Jayne Conte Designer: Suzanne Behnke Media Editor: Daniel Sandin Media Project Manager: John Cassar Cover Image: (c) michael Holcomb/Shutterstock.com Full-Service Project Management: Mohinder Singh/ Aptara®, Inc. Composition: Aptara®, Inc. Printer/Binder: Edwards Brothers Cover Printer: Lehigh-Phoenix Credits and acknowledgments borrowed from other sources and reproduced, with permission, in this textbook appear on appropriate page within text. Photo Credits: Page 4: Fig. 0.1: akg-images/Paul Almasy/Newscom. Page 11: Fig. 0.4: © 2008 IEEE/Journal of Microelectromechanical Systems (2006). Page 15:...

Words: 158087 - Pages: 633

Free Essay

#### An Overview of Computer Viruses in a Research Environment

...in general, pose to computer systems. Finally, a brief examination of the vulnerabilities of research and development systems that malicious logic and computer viruses may exploit is undertaken. 1. Introduction A computer virus is a sequence of instructions that copies itself into other programs in such a way that executing the program also executes that sequence of instructions. Rarely has something seemingly so esoteric captured the imagination of so many people; magazines from Business Week to the New England Journal of Medicine [39][48][60][72][135], books [20][22][31][40][50][67][83][90][108][124], and newspaper articles [85][91][92][94][114][128] have discussed viruses, applying the name to various types of malicious programs. As a result, the term “computer virus” is often misunderstood. Worse, many who do understand it do not understand protection in computer systems, for example believing that conventional security mechanisms can prevent virus infections, or are ﬂawed because they cannot. But computer viruses use a number of well-known techniques in an unusual order; they do not employ previously-unknown methods. So, although existing computer security mechanisms were not designed speciﬁcally to counter computer viruses, many of those mechanisms were designed to deal...

Words: 12539 - Pages: 51

#### Altibase

Words: 160935 - Pages: 644

#### Researching and Writing

Words: 142971 - Pages: 572

#### Ldr 531 Final Exam Prep

...LDR/531 isn’t available until Sep. 03 and has 30 questions. LDR 531 FINAL EXAM PREP 1) Mintzberg concluded that managers perform 10 different, highly interrelated roles. Which of the following is one of the broad categories into which these roles might be grouped? A) intrapersonal B) institutional C) decisional D) affective E) reflective 2) Over the past two decades, business schools have added required courses on people skills to many of their curricula. Why have they done this? A. Managers no longer need technical skills in subjects such as economics and accounting to succeed. B. Managers need to understand human behavior if they are to be effective. C. These skills enable managers to effectively lead human resources departments. D. A manager with good interpersonal skills can help create a pleasant workplace 3) Which of the following is best defined as a consciously coordinated social unit, composed of two or more people, which functions on a relatively continuous basis to achieve a common goal or set of goals? A. Party B. Unit C. Community D. Organization 4) Which of the following is not one of the four primary management functions? A) controlling  B) planning  C) staffing  D) organizing  E) leading 5) Determining how tasks are to be grouped is part of which management function? A. Leading B. Planning C. Controlling D. Organizing E. Contemplating 6) Which of the following is least likely to be considered a manager? A. A lieutenant leading an infantry...

Words: 96939 - Pages: 388

#### Irpm

...Human Resource Management (MGT501) VU MGT - 501 T his subject/course is designed to teach the basic principles of Human Resource Management (HRM) to diverse audience/students, including those who are studying this as a supporting subject for their bachelor degree program. This course is designed to provide you the foundations of HRM whether you intend to work in HRM or not, most of these elements will affect you at some point in your career. Either you will be working with some organizations or having people working for you, in both cases you will be dealing with people. To be understandable and lively means that we need to communicate you. We start every chapter with learning objectives. The most important thing you will get out of this course are the basic skills required to succeed in today’s environment which are, you must be able to communicate, think creatively, plan effectively and deal with people. Copyright © Virtual University of Pakistan 1 Human Resource Management (MGT501) INTRODUCTION TO HRM After studying this chapter, students should be able to understand the following: Describe HRM? Explain why are we concerned about HRM? Discuss Road-map of HRM VU Lesson 1 LESSON OVERVIEW This chapter introduces the students with the basic concepts of the human resource management (HRM). During the lecture, we will be discussing the three main things, i.e. the introduction to HRM, the importance of HRM, and a brief discussion of the Resource topics...

Words: 93280 - Pages: 374