Premium Essay

Assessing Research Performance

In: Philosophy and Psychology

Submitted By yaya76
Words 364
Pages 2
Theme: Assessing Research Performance

There are three focus areas in assessing research performance: reliability, validity, and credibility. Reliability itself defined as the degree to which a measure yields consistent results. Validity means the degree to which a study accurately reflects or assesses the specific concept that the researcher is attempting to measure. Credibility means a researcher’s ability to demonstrate that the object of a study is accurately identified and described based on the way in which the study was conducted.

We will discuss the research performance assessment in a paper by Rousseau titled Psychological Contract Inventory Technical Report (2000) based on those three areas I have mentioned previously. Rousseau use sample from US and Singapore in order to test the consistency of the test result.
- Reliability
Rousseau assessed whether PCI could lead researcher to consistent result. PCI use 5 scales questionnaire in four sets of question. These four sets are: relational, balanced, transactional, and transitional. Most of the scales have high reliability. Rousseau assesses it by using a statistics method. Rousseau state that “Initial analyses identified that several scales did meet the traditional standards for convergence and reliability (where a minimum Cronbach’s alpha coefficient is 0.7)”. Moreover, Rousseau identified some problematic scales such as Employer Narrow and Employer Security. As a conclusion, the PCI is a reliable tool.

- Validity
In order to test the validity of PCI, Rousseau use sample from US and Singaporean. PCI could be considered as a valid tool if the result for the US and Singaporean is similar. Factor analyses on the US-based sample are highly consistent with the total sample. On the other hand, Singaporean sample show some divergent pattern. Rousseau tried to identify the root cause of this divergence.…...

Similar Documents

Premium Essay

Ilm L5

...Institute of Leadership & Management Unit M5.29 Assessing your own leadership capability and performance A S P M E L Unit: M5.29 Assessing your own leadership capability and performance: Assessment with Session Plan M5.29 ‘Assessing your own leadership capability and performance’ Assessment with Session Plan Session Plan: M5.29 Assessing your own leadership capability and performance Session Length: 2 half-day sessions plus guided learning in the workplace set by tutor (16 glh total) Venue: TBC Tutor Resources to include: · · · · · Flip charts and pens Assessment M5.29 Sufficiency descriptor M5.29 NHS LQF NHS Leadership Framework. Additional information about the sessions: These two half-day sessions together with guided learning set by the tutor in the learners’ own workplace are designed to cover the minimum 16 glh for the ILM unit M5.29 ‘Assessing your own leadership capability and performance’ and to enable the learner to complete to a satisfactory standard the ILM assessment for the M5.29 unit. The sessions are intended to further develop the skills and knowledge of learners working in the NHS who are existing or aspiring middle managers with some previous knowledge of leadership and motivation theory. Time for tutorials are not included in the sessions. A S P M E L Page 2 of 11 M5.29 © ILM 2012 Copied under licence Unit: M5.29 Assessing your own leadership capability and performance: Assessment with Session......

Words: 946 - Pages: 4

Premium Essay

Perfomance Management Model

...Annales Universitatis Apulensis Series Oeconomica, 11(2), 2009 639 THE PERFORMANCE MANAGEMENT IN PUBLIC INSTITUTIONS OF HIGHER EDUCATION AND THE ECONOMIC CRISIS Rodica Gherghina 1 Florin Văduva 2 Mirela Anca Postole 3 ABSTRACT: The need to reduce public spending in the developin g process and funding of public services has led to the introduction of performance indicators in the public institutions. Moreover, the need to optimize the educational activity, the implementation of an efficient management, insuring the quality and the compatibility of the e ducational systems has led to numerous investigations in this area by adopting, as a theor etical reference framework some organizational models to explain the functionality of the educatio nal system and to define a performance appraisal system. Each model generated by default a certain p hilosophy regarding the evaluation methods of the institutional performance, design and use of th e performance indicators on education institutions . Key words: economic crisis, performance, indicators , education JEL codes: I21, H52 Introduction Changes in higher education in Romania, just as thr oughout Europe and elsewhere, were as many and radical as they were continuous. Since the early 1990s, the first private universities were established in Romania and the number of public uni versities, of the faculties or of the new......

Words: 3684 - Pages: 15

Premium Essay

Operations

...Operations Management MGT 203 MANAGING EFFICIENCY AND PRODUCTIVITY Week 11 Dr Pieris Chourides Productivity • A measure of performance. • Broadly a ratio of output to input, i.e. comparing amount produced (output) with resources used (input) • Materials, machinery, labour, capital, energy --- a combination • What improvements have there been over the last 50 years in – construction productivity – payroll processing – Car servicing – banking • How do we evaluate productivity levels and identify areas for improvement? Managing Productivity • Productivity – An economic measure of efficiency that summarizes the value of outputs relative to the value of the resources used to produce them. Levels of Productivity • The unit of analysis used to calculate or define: – Aggregate productivity—the total level of productivity for a country. – Industry productivity—the total productivity of all the firms in an industry. – Company productivity—the level of productivity of a single company. – Unit productivity—the productivity level of a unit or department. – Individual productivity—the productivity attained by a single person. Forms of Productivity • Total factor productivity–an overall indicator of how well an organization uses all of its resources (i.e., labor, capital, materials, and energy) to create all of its products and services. Outputs Productivity = Inputs Forms of Productivity • Labor productivity–a partial......

Words: 957 - Pages: 4

Premium Essay

Wcil Investments Limited

...9-12 December 2000 ASSESSING QUALITY, OUTCOME AND PERFORMANCE MANAGEMENT Dr Javier Martinez The Institute for Health Sector Development London World Health Organization Department of Organization of Health Services Delivery Geneva Switzerland 2001 © World Health Organization, 2001 This document is not a formal publication of the World Health Organization (WHO), and all rights are reserved by the Organization. The document may, however, be freely reviewed, abstracted, reproduced and translated, in part or in whole, but not for sale nor for use in conjunction with commercial purposes. Assessing quality, outcome and performance management Dr Javier Martinez The Institute for Health Sector Development London Contents Introduction ..................................................................................................................... 1 1. Background, objectives and methods ................................................................... 1 2. Mapping out the topic and this review .................................................................. 1 Chapter 1 1.1 1.2 1.2.1 1.2.2 1.2.3 1.2.4 1.2.5 1.2.6 1.2.7 1.2.8 What is performance management? How have the concept and practice of performance management evolved over time? ............................ 3 Definition .............................................................................................................. 3 How have the concept and practice of performance management evolved......

Words: 13906 - Pages: 56

Premium Essay

External Staffing

...methods should be reevaluated if organizations desired goals and expected outcomes of hires are not achieved. Business and staffing strategies will differ and may require multiple methods of assessing to accomplish staffing objectives. Methods provide effective and/or efficient means to identify applicants/candidates ability to be a successful hire. Factors employers should consider in determining if assessment methods may require evaluation; • High employee turnover rates • Poor performance related to new hires • Low applicant rates • Declines in organizational productivity • Screening of applicants effectively • Identification of competencies requirements (Person-job fit) • Identify development needs and/or capacity to obtain knowledge • Organization and cultural fit (Person-organizational fit) • Talent and HR philosophy alignment to business strategy • Other attributes; personality, attitude, motivations, teamwork and interests (Person–group fit) and (Person-vocation fit) • Validity/reliability and accuracy of method to achieve staffing goals • Minimize adverse impact, ethical and legal concerns • Maximize ROI/costs of hiring • Candidates reaction (fair, consistent and objective) Source: Strategic Staffing 2nd edition – Phillips and Gully. Chapter 9 Assessing External Candidates page 233- 240 2) Discuss the advantages and disadvantages of both structured and unstructured interviews. Which would you prefer to use? Why? Unstructured......

Words: 1127 - Pages: 5

Free Essay

Wgu Paper

...planning and team performance. Only two aspects, pre appraisal activities and steps the CEO and board of directors should take to implement the key points covered in the presentation require addition support. Detailed Results (Rubric used: JDT Task 3) Articulation of Response (clarity, organization, mechanics) (0) Unsatisfactory (1) Does Not Meet Standard (2) Minimally Competent The candidate provides limited articulation of response. (3) Competent The candidate provides adequate articulation of response. (4) Highly Competent The candidate provides substantial articulation of response. The candidate provides The candidate provides unsatisfactory articulation weak articulation of of response. response. Criterion Score: 4.00 A1. Optimal Results (0) Unsatisfactory The candidate does not present the optimal results of a well-prepared and well-delivered performance appraisal. (1) Does Not Meet Standard The candidate presents the optimal results, with no detail, of a wellprepared and welldelivered performance appraisal. (2) Minimally Competent The candidate presents the optimal results, with limited detail, of a wellprepared and welldelivered performance appraisal. (3) Competent The candidate presents the optimal results, with adequate detail, of a well-prepared and welldelivered performance appraisal. (4) Highly Competent The candidate presents the optimal results, with substantial detail, of a well-prepared and welldelivered performance......

Words: 2200 - Pages: 9

Premium Essay

Decision Making Case Study

...of a research study to aid managers with making evidence-based decisions that improve organizational performance. The IDT has an approach of six steps to decision-making (Rundell, et al, 2007): (1) framing the management question, (2) finding sources of information, (3) assessing the accuracy of the information, (4) assessing the applicability of the information, (5) assessing the actionability of the evidence, and (6) determining if the information is adequate (p. 325). As a facilitator for the use of evidence-based research in decision-making, the IDT assists decision-makers with estimating how operational and strategic decisions will have an effect on the organization. Evidence-based decision-making is not new to the health care industry. Clinicians have incorporated evidence-based research for years when making patient treatment determination. The use of evidence-based research for decision-making in other realms of healthcare is only logical. Case Study Example A manager of a Denton County, Texas, clinic that provides care to Medicaid clients has a department budget cut of 15%. A decision for eliminating or introducing clinical services to best address the healthcare needs of the Medicaid population is necessary. The decision should consider statewide health policy and a defined budget constraint. Framing the management question (Step 1) Framing the management question involves asking oneself a series of questions that will elicit a well-defined research......

Words: 1573 - Pages: 7

Premium Essay

-Assessing Emotional Intl in the Indian Workplace

...Rajendran, Downey & Stough :Assessing Emotional Intelligence in the Indian workplace: a preliminary reliability study. 55 Assessing Emotional Intelligence in the Indian workplace: a preliminary reliability study Diana Rajendran (drajendran@swin.edu.au) Department of Management Swinburne University, PO Box 218, Lilydale, Victoria, 3140, Luke A. Downey: (ldowney@swin.edu.au) Brain Sciences Institute Swinburne University, PO Box 218 (H99), Hawthorn Vic 3122, Australia. Professor Con Stough (cstough@swin.edu.au) Professor in Cognitive Neuroscience, Director, Brain Sciences Institute. Swinburne University, PO Box 218 (H99), Hawthorn Vic 3122, Australia. Abstract The concept of Emotional Intelligence (EI) has recently attracted a great amount of interest from HR practitioners and academics alike. Whilst the majority of research in this area has been conducted in Western countries, recent studies have begun to assess the generalisability and validity of the EI concept in cross-cultural settings. The purpose of this paper was to assess the reliability of the Workplace version of the Swinburne University Emotional Intelligence Test (Workplace SUEIT) in an Indian population. The Workplace SUEIT demonstrated adequate reliability in the sample of 110 participants in India, although the mean scores for the sub-scales were significantly lower than in the Australian normative population. The results are discussed in the context that EI tests need to......

Words: 3608 - Pages: 15

Free Essay

The Gollden Toungue

...the act of assessing. WHAT IS CONSTRUCTIVIST THEORY? Constructivist theory  is a theory to explain on how knowledge is constructed in the human being when information comes into contact with existing knowledge that has been developed by experiences. Constructivism as a theory of learning has  existed for over one hundred years but has no been widely accepted or applied in public schools.this theory is just a posed of behavioral theory. WHAT IS TECHNOLOGY-SUPPORTED LEARNING? It is used to encourage students especially in facilitating student centered  learning activities. It is more than technology enhance instruction. It recognizes that learning is supported in many different ways, even if there is no formal teaching involve. Students study and learn based on the way they are tested. The type of assessment anticipated appears to influence how and what they learn. therefore, the quickest way to change the way students learn is to change the way learning is assessed.  In a technology-supported classroom, the student learns from and with the technology. Technology is seen as a source of information that the students learn from in the same way that the teacher are the source of information.. the students master facts from the concepts from technology and with the aid of technology. Reflection:                It is said that traditional-paper-and pencil are not adequate to assess learning in a constructivist technology supported learning.  In assessing......

Words: 1142 - Pages: 5

Premium Essay

Business

...Implementing an Effective Performance Management Process Improving Performance Through Meaningful Feedback Performance management continues to be a challenge for many organizations. People believe in the value of the outcomes, but to many, giving (and receiving) feedback is a daunting task. Burke’s annual Workforce Perspective® survey shows that while 70% of employees receive an annual performance review, less than half believe the review effectively evaluates their performance. And, just over 60% find the feedback useful in helping them to improve job performance. To put this all in context, linkage research shows that employee engagement is linked to customer loyalty and organizational performance. Further, performance management and career development are both strong drivers of employee engagement. Giving these topics the attention they deserve is vital to individual and organizational success! Performance Management is more than just an annual review. It encompasses the entire process of employee performance evaluation and feedback and includes goal setting and coaching. Done effectively, it also includes the creation of development plans to address current performance issues as well as maximize future performance and career potential. “Feedback is the breakfast of champions.” Ken Blanchard What Are the Characteristics of a Successful Performance Management Program? An effective Performance Management program requires a structured process that includes: –......

Words: 786 - Pages: 4

Premium Essay

Week3

...college. It was reported that on average, a high school graduate brings home $630 a week wile a person with a bachelor’s degree earns $1140 a week (Research in Higher Education Journal Dec 2012). It was stated that college graduates earn more because they are smarter and societies reward smart people (Research in Higher Education Journal Dec 2012). For a college student to be a successful student they need to first go to college. The place that college preparation starts in high school at the point this is where fall short for college and decide that college is not for them for many reasons, some of these reasons are financial reason with other including not being able to hold good grades that would get them into the college that they would want to go to. A list of reasons that hinders college students can go on and on for a while. After reading this article I find that there is a lot information that should be considered when making that major decision on weather going to go to college or not. Something that really surprised me is the matter of how much alcohol and smoking can play a part in making a successful and not successful student. A lack of sleep also plays a huge role being a successful student or not, More than half of the respondents noted feeling tired in the morning, a prime time for academic performance (Research in Higher Education Journal Dec 2012). With this being stated it is a surprise to me that in the morning is the prime time for a college student......

Words: 836 - Pages: 4

Premium Essay

Field Study 5

...EXPERIENTAL LEARNING COURSES FS FIELD STUDY 5 * Your Tools As you observe a class, note down your significant observation of the performance-based activity in the classroom. Then, make a checklist of the important things you wish to consider in your assessment planning. For these tasks, please use the Activity Forms provided for you. For your proposed plan for process-oriented assessment, it is recommended that you use the format that you agreed in your Assessment-2 class. Please remember that the rubrics are part and parcel of your assessment plan. OBSERVATION NOTES | Name of the School Observed: Cagayan State University Andrews CampusYear level & Section: III-J Subject Area: Social ScienceSubject Matter: Micro and Macro Economics Topic: Four Production ProblemsObserved teacher: Mr. Roger Ramos Objective: Perform a simple role-play showing ways on how to solve the four production problems. | Describe in bullets the performance-based activity you observe. * The performance-based assessment task that was given to us portrays real-life situation wherein we were able to use and apply the information we acquired during the discussion. It was an authentic assessment task that is embedded in a context that has some meaning or purpose beyond school or beyond the bounds of the classroom lesson or unit. * It involves all domains of learning: * Cognitive- we are able to use the information that we acquired by thinking on what possible......

Words: 7101 - Pages: 29

Premium Essay

Assessing Human Resource Practices Alignment: a Case Study

...ASSESSING HUMAN RESOURCE PRACTICES ALIGNMENT: A CASE STUDY HERBERT G. HENEMAN III AND A N T H O N Y T. M I L A N O W S K I Research has established the link between HR practices and organizational performance, suggesting that the HR system has great strategic potential to drive organizational effectiveness. To capitalize on this potential, the organization must design and deliver HR practices that focus on necessary employee performance competencies, creating an HR system with vertical and horizontal alignment around those competencies. Doing this requires that the organization first assess how its HR practices are currently aligned and then develop ideas for improving HR practice that will be alignment enhancing. We call this diagnostic process Human Resource Alignment (HRA) assessment. We describe an HRA assessment process we developed and applied in a large public school district for the key job of teacher. The assessment was based on the district’s formal teacher performance competency model used, and was conducted by a group of human resources and instructional job experts from the district. These experts rated the degree of vertical and horizontal alignment and then developed suggestions for HR practice changes that would improve alignment. After describing the process and results, we present a series of lessons learned and directions for future research. © 2011 Wiley Periodicals, Inc. Keywords: strategic human resource management, human resource alignment......

Words: 10368 - Pages: 42

Free Essay

Study Notes for Netw 583

...price points. Research and Development Research can refer to both basic research and applied research. Basic research is effort directed at increasing understanding of a topic or field without a specific immediate commercial application in mind. This research advances scientific knowledge, which may (or may not) turn out to have long-run commercial implications. Applied research is directed at increasing understanding of a topic to meet a specific need. In industry, this research typically has specific commercial objectives. Development refers to activities that apply knowledge to produce useful devices, materials, or processes. Thus, the term research and development refers to a range of activities that extend from early exploration of a domain to specific commercial implementations. Innovation partnerships Firms' research and development is considered a primary driver of innovation. In the United States, firms spend significantly more on R & D than government institutions spend on R & D, and firms consider their in-house R & D their most important source of innovation. Firms often collaborate with a number of external organizations (or individuals) in their innovation activities. Firms are most likely to collaborate with customers, suppliers, and universities, though they also may collaborate with competitors, producers of complements, government laboratories, nonprofit organizations, and other research institutions. Many universities have a research mission,......

Words: 2306 - Pages: 10

Premium Essay

Assessing Corporate Culture

...ASSESSING CORPORATE CULTURE 1. Scheins approach to assessing organizational culture a. Strengths of scheins approach to assessing organizational culture Schein defines and describes culture as any one of many elements of organizational culture. The culture of an organization can be viewed and treated like other structures within an organization. Certain organizations such as by-laws, committees, and chain of command flow charts, may serve to answer basic questions such as “how do we interact with the external environment?” and “how do we order ourselves internally?” As an organization responds to these questions, the responses become core assumptions. These core assumptions become the frames through which the organization interprets the world round it. In place of questionnaire or instrument that utilizes typologies, Schein prefers clinical research model of assessing organizational culture. In this model of organizational culture investigation, the researcher gets much more directly involved within the organization by acting as participant observer or ethnographer. He suggests that members of the organization will more openly respond to the researcher and the investigation because the members of the organization think they have something to gain by collaborating with the researcher. Schein believes that valid data on the culture of the organization will only be collected when the researcher is perceived as the consultant who is seeking to help the organization and...

Words: 781 - Pages: 4