Free Essay

Standardized Survey Tools

In:

Submitted By arnijamili
Words 1429
Pages 6
Standardized Survey Tools for Assessment in Archives and Special Collections

Yakel, E., & Tibbo, H. (2010). Standardized survey tools for assessment in archives and special collections. Performance Measurement and Metrics, 11(2), 211-222. Retrieved March 11, 2013, from the Emerald database.

Abstract: User-based evaluation in archives and special collections is in its fancy, and this paper aims to discuss the conceptualization, development, and testing of Archival Metrics Toolkits. The development and adoption of standardized metrics to support the management of both analog and digital collections is a critical need in archives and manuscript collections. The Archival Metrics Toolkits were created, and comprised five user-based evaluation instruments for archives and special collections in colleges and universities such as researcher, archival web sites, online finding aids, student researchers, and teaching support. The Archival Metrics Toolkits, as developed, represent a first step toward standardized evaluation created specifically for archives. Now it is up to the community to adopt these tools and report their use. These are the first standardized questionnaires to target archives and special collections and take into consideration the unique environment of primary sources and the specific dynamics involved in connecting researches with archival and manuscript collections.
Keywords: Archiving, Collections management, Software tools

Summary Over the past five years, they have developed, tested, and deployed five standardized instruments, which archives and special collections in colleges and universities can utilize to conduct user-based evaluations of their services. These five questionnaires focus on researchers, archival web sites, online finding aids, student researchers, and teaching support. They have reported on the creation and scope of those tools, the development of standardized administration procedures, and findings from testing those tools. According to the author, creation of the tools involved an extensive literature review and interviews with instructors, students, and archivists/manuscripts curators, to identify the key evaluative concepts to test. In addition, in the second part of the conceptual framework they identify four areas which are the quality of the interaction with the archivist, quality of the access systems, the physical facilities, and learning outcomes. The Researcher questionnaire evaluates a user’s on-site experience in a repository based on the current visit. It is based administered after a researcher has done some work, not when a person first enters the facility. The Student Researcher and Teaching Support questionnaires are to be conducted at the end of an academic term. The Student Researcher questionnaire is for students who have had formal archival instruction. Furthermore, the orientation section asks about learning in the orientation. The Use of the Archives section has students assess how well the orientation prepared them for their subsequent use of the archives. The Teaching Support questionnaire asks instructors who have utilized the archives or special collections during the previous term to evaluate the service they received. The Online finding Aids instrument asks users to evaluate online finding aids which divided into three areas which are your research, evaluation of the online finding aids, and background information. In the other hand, each questionnaire has been thoroughly tested at different college and university archives or special collections in testing the surveys. They tested the questionnaires in two phases. They also held several focus groups to critique the tools. One of the most valuable parts of the development process was testing the survey administration procedures. Those procedures included the format of the questionnaire, targeting different populations for the survey, and generating a sufficient sample from that population. The authors stated that archives and special collections have far fewer users than libraries. This influenced their preferred administration methods. In both the Online Finding Aids and Archival Web site surveys, it took considerable time to accumulate 50 e-mail reference requestors at several sites. The testing methodology also identified clear differences between population samples. They found that there was little overlap between e-mail reference requestors and onsite reading room researchers from any of the sites. They have tested for reliability in several ways which are through traditional reliability testing of test administration, by examining the range and tenor of the answers to multiple choice and free text questions, and by examining the responses for consistency. The student survey represents an important type of assessment that college and university archives need to be doing to evaluate how well they are meeting the needs of the group and they supporting the mission of the larger institution. While they have developed some measures that show learning outcomes for students exposed to archives, they will be following the use the instrument closely to see whether the findings continue to follow the same patterns.
In short, The Archival Metrics Toolkits are an initial foray into the development of user-based evaluation tools for archives and special collections. The administration and use of primary sources are sufficiently different from libraries that they deserve tools that appropriately measure service to users. User expectations of archives are consistently inaccurate and archives cannot meet these due to the nature of the materials. Likewise, there are fewer users of archives and special collections so administration procedures must be specifically geared to generating a large enough responses rate on which archivists and curators can base decisions.

Authority Elizabeth Yakel, Ph.D. is a Professor at the University of Michigan School of Information where she teaches in the Archives and Records Management and Preservation of Information specializations. Her research interests include use and uses of archival materials and the development of standardized metrics to enhance repository processes and as a result the user experience. Dr. Yakel’s current research project is “Dissemination Information Packages for Information Reuse” where she is studying data reuse and digital preservation of research data in three academic communities which are quantitative social scientists, archeologists, and zoologists. Funded by the Institute for Museum and Library Services, the goal of this research is to identify the significant properties that support both preservation of the bits as well as the preservation of meaning overtime. Second author, Helen R. Tibbo, professor at the School of Information and Library Science (SILS) at the University of North Carolina at Chapel Hill (UNC-CH), teaches in the areas of archives and records management, digital curation, electronic retrieval, and reference. She has served on SAA committees and boards for over 20 years and was the co-founder of the SAA Research Forum. She is currently the PI for the IMLS-funded DigCCurr I that is developing an International Digital Curation Curriculum for master’s level students (2006-2009). In April of 2007 the DigCurr Conference attracted close to 300 participants with 100 speakers from 10 countries. DigCCurr2009 will be held April 1-3, 2009 in Chapel Hill, NC. She is also the PI for DigCCurr II (2008-2012) that extends the Digital Curation Curriculum to the doctoral level and will provide week-long summer workshops for digital curation practitioners. Dr. Tibbo is a co-PI with collaborators from the University of Michigan and the University of Toronto for a Mellon Foundation-funded project to develop standardized metrics for assessing use and user services for primary sources. She is also a co-PI with Drs. Gary Marchionini and Christopher Lee on the NSF-funded Preserving Video Objects and Context: A Demonstration Project and its continuation funded by NDIIPP of the Library of Congress. Dr. Tibbo earned her Ph.D. from the University of Maryland College Park in Library and Information Services and has Master's degrees in Library and Information Science and American Studies.
Scope
This article focus on user-based evaluation in archives and special collections is in its fancy, and this paper aims to discuss the conceptualization, development, and testing of Archival Metrics Toolkits. The development and adoption of standardized metrics to support the management of both analog and digital collections is a critical need in archives and manuscript collections. The Archival Metrics Toolkits, as developed, represent a first step toward standardized evaluation created specifically for archives. Now it is up to the community to adopt these tools and report their use.
Currency
This article was published on 2010.
Audience
Based on this article, it is suitable for the students, researcher, archivists, and public user. The authors used simple words and sentences to make the readers easy to read without any obstacles.
Conclusion
As conclusion, The Archival Metrics Toolkits represent a first step toward standardized evaluation created specifically for archives. Now it is up to the community to adopt those tools and give report on their used. They do ask the potential implementers register because they want to track usage as well as the utility of the instruments.

Similar Documents

Free Essay

Standardized Survey Tools for Assessment in Archives and Special Collections

...●●●ReadTheory.Org © 2010 EnglishForEveryone.Org © 2008 Name________________ Date________________ “Running” Reading Comprehension – Short Stories Directions: Read the story. Then answer the questions below. Dieter loves to run. He runs in the morning. He runs in the afternoon. He runs in the evening. He runs at night. Dieter loves to run, but it hurts to run. When Dieter runs, it hurts. His legs hurt. His arms hurt. His back hurts. His head hurts. When Dieter runs, his whole body hurts. Then, Dieter starts thinking. He starts dreaming. He dreams about his job. He dreams about his home. He dreams about his family. He dreams about his friends. He dreams about the world. At first, running hurts. No one likes it when it hurts. When it hurts, Dieter dreams about things that do not hurt. This is why Dieter loves running. Running gives him the best dreams. Sometimes, Dieter forgets that he is running. Sometimes, he runs all morning. Sometimes, he runs all afternoon. Sometimes, he runs all night. Dieter runs and dreams. Questions: 1) What does Dieter love to do? A. B. C. D. He loves to run. He loves to dream. He loves to think. He loves to hurt. 2) When Dieter runs, it hurts. What does this mean? A. He feels good. B. He feels bad. 3) What does Dieter do while he is running? A. B. C. D. He dreams. He sleeps. He eats. He drinks. 4) What does Dieter dream about? I. his job II. his family III. his future A. B. C. D. I only I and II II and III I, II, and III Answers...

Words: 500 - Pages: 2

Premium Essay

Oedipus Rex

...quantitative research methods Source: SEEP-AIMS 2000 Learning from Clients: Assessment Tools for microfinance practitioners. Washington, DC: AIMS/Management Systems International () Quantitative and Qualitative Methods As outlined in the previous chapter, the AIMS/SEEP approach to impact assessment by and for practitioners combines quantitative and qualitative techniques. The Impact Survey and Client Exit Survey are categorized as quantitative tools because they collect standardized information by asking exactly the same questions to clients and organizing their answers into quantifiable response categories. The individual Loan Use Strategies Over Time and Client Empowerment interviews and the Client Satisfaction focus group discussions are qualitative instruments that gather more detailed information through a more flexible, in-depth dialogue with clients. AIMS believes that these two categories of tools are complementary, each providing different types of information that enable evaluators to gain a more complete, richer picture of impact than would be possible with only one. This chapter's overview to quantitative and qualitative approaches presents the differences between the two techniques and provides general guidelines for their application. The interviewers' roles and responsibilities for both quantitative and qualitative techniques outlined here apply to all the corresponding tools presented in this manual. Quantitative? Qualitative? What Is the Difference? This section...

Words: 1670 - Pages: 7

Premium Essay

Mkt550 Marketing Research and Design Assignment 2

...momentum. The healthcare managers that endeavor to achieve excellence take patient perception into account when designing the strategies for quality improvement of care. Recently, the healthcare regulators shifted towards a market -driven approach of turning patient satisfaction surveys into a quality improvement tool for overall organizational performance. Recently, the healthcare regulators shifted towards a market -driven approach of turning patient satisfaction surveys into a quality improvement tool for overall organizational performance. In 1996, evaluation of patient satisfaction was mandatory for all hospitals. A study was conducted in a tertiary teaching hospital in aiming to assess the opinions of clinical staff towards the effect of in-patient satisfaction surveys on the quality improvement process. A favorable result of 94% revealed that the patient was able to judge hospital service quality, especially in its relational, organizational and environmental dimensions. In Germany, measuring satisfaction has been required since 2005 as an element of quality management reports. Since 2002, the Department of Health (DOH) has launched a national survey program in which all NHS trusts have to survey patient satisfaction on an annual basis and report the results to their regulators. Therefore, measurement of patient satisfaction is a legitimate indicator for improving the services and strategic goals for all healthcare organizations. There is no consensus between the...

Words: 1247 - Pages: 5

Premium Essay

Three Characteristics Of Handover

...3.3 CHARACTERISTICS OF HANDOVER Laxmisan et al (2007) conducted an ethnographic study involving analysis of emergency department handover in a US hospital. The study found that interruptions within the emergency department were prevalent and diverse in nature and that there were gaps in information flow due to multi-tasking and shift changes. The communication process is complex and cognitively taxing during and after team handover, that can compromise patient safety. The study also discusses the need to tailor generic electronic tools to support adaptive processes like multi-tasking and handoffs in time constrained environments. Arora et al (2005) conducted interviews using the critical incident technique to handover failures between inpatient physicians in a US hospital. The study interviewed 26 interns and found 25 discrete incidents. The 21 worst events are described. Omitted contents and failure prone communication processes were identified as a major category of failure in communication. These may result in inefficient or sub-optimal care, leading to patient harm....

Words: 1589 - Pages: 7

Premium Essay

Effects of Nndqi and Hhcaps on the Health Care Industry

...HCAHPS and NDNQI were examined to be familiarized about how these quality initiative surveys were structured including goals, methods, how they used their results and how they are impacting healthcare organizations specifically hospitals and nurses. Also the author personally reflects on HCAHPS and NDNQI. Keywords: HCAPS, NDNQI, quality initiative, survey, ` Rising health care costs and limited health care resources has produced a need of utilization of data. Moreover data management and monitoring is essential in order to ensure that implementations are being made to change and improve nursing practice and patient care and outcomes. One specific way that this was employed was when the health care system was transformed from a system that was based on the number of admissions to the quality of care (Sewell & Thede, 2013). This was made more evident in 2007, when the Centers for Medicare & Medicaid, (CMS) mandated required participation in improvement initiatives in order for hospitals to receive full reimbursements for patient care (Sewell et al. 2013). These mandated programs that determine quality and the achievement of best outcomes for healthcare organizations are Health Consumer Assessment of Health Providers and Systems (HCAHPS) and the National Database of Nursing Quality Indicators (NDNQI). The initiation and utilization of these tools has encompassed an environment where quality improvement is a goal to improve patient...

Words: 1600 - Pages: 7

Free Essay

Effects of Electronic Gadgets to Academic Performance

...Issues in Information Systems Volume 13, Issue 1, pp. 225-231, 2012 IS THE GROWING USE OF ELECTRONIC DEVICES BENEFICIAL TO ACADEMIC PERFORMANCE? RESULTS FROM ARCHIVAL DATA AND A SURVEY Taylor S. Drain, Washburn University, taylor.drain@washburn.edu Lakeisha E. Grier, Washburn University, lakeisha.grier@washburn.edu Wenying Sun, Washburn University, nan.sun@washburn.edu ABSTRACT In this study, we investigate the relationship between academic performance and the use of computer technology. We test our hypothesis which proposes that the growing use of electronic deveices is academically beneficial to high school students' standardized test scores and GPA. Our method of data collection includes both a survey of high school students in the Midwest area and an analysis of national SAT scores in the years before computing and in years with computing. Analysis of SAT archival data shows a negative correlation between scores pre-computing and scores post-computing (with computing influences), meaning that as scores before computing were decreasing, scores with prevalent computer technology are increasing. Our survey data also displayed a positive correlation between time spent on electronic devices for school purpose and GPA. Keywords: Computer Technology, Academic Performance, SAT, GPA, Electronic Devices INTRODUCTION The availability and use of electronic devices continues to grow. Over 420 million smart phones were sold worldwide in 2011 [6]. Almost 400 million computers were...

Words: 3261 - Pages: 14

Premium Essay

Balance Scorecard

...DEPARTMENT OF ENERGY FEDERAL PROCUREMENT SYSTEM BALANCED SCORECARD PERFORMANCE ASSESSMENT FY2003 2 MISSION To provide acquisition and assistance services to support accomplishment of the Department’ s programmatic goals and objectives. VISION To deliver on a timely basis the best value product or service to our customers while maintaining the public’trust and fulfilling public policy s objectives. STRATEGY To change the present system’culture, management s systems, and line processes consistent with the principles of Quality Management, in order to establish and maintain: a customer focus, a sense of urgency, continuous and breakthrough process improvement, and an emphasis on results. 3 BALANCED SCORECARD STRATEGIC PERSPECTIVES CUSTOMER What must we excel at? How do our customers see us? FINANCIAL MISSION VISION STRATEGY LEARNING AND GROWTH INTERNAL BUSINESS PROCESSES Do we get the best deal for the Government? Do we continue to improve and create value? CUSTOMER To Achieve Our Vision, How Should We Appear To Our Customers? 4 FINANCIAL To Succeed Financially, How Should We Appear To Our Stakeholders? MISSION VISION STRATEGY INTERNAL BUSINESS PROCESSES To Satisfy Our Stakeholders and Customers, What Business Processes Must We Excel At? LEARNING AND GROWTH To Achieve Our Vision, How Will We Sustain Our Ability To Change And Improve? BALANCED SCORECARD PERSPECTIVES AND OBJECTIVES CUSTOMER - Customer Satisfaction...

Words: 2162 - Pages: 9

Free Essay

O*Net

...occupational information. Central to the project is the O*NET database, containing information on hundreds of standardized and occupation-specific descriptors. The database, which is available to the public at no cost, is continually updated by surveying a broad range of workers from each occupation. Information from this database forms the heart of O*NET OnLine, an interactive application for exploring and searching occupations. The database also provides the basis for our Career Exploration Tools, a set of valuable assessment instruments for workers and students looking to find or change careers. The Occupational Information Network (O*NET) is being developed under the sponsorship of the US Department of Labor/Employment and Training Administration (USDOL/ETA) through a grant to the North Carolina Department of Commerce. Learn more about the O*NET project partners. About O*NET Data O*NET Applications Starting Points Content Model Anatomy of an occupation Every occupation requires a different mix of knowledge, skills, and abilities, and is performed using a variety of activities and tasks. These distinguishing characteristics of an occupation are described by the O*NET Content Model, Explore the interactive Content Model to see the range of occupational descriptors in the O*NET database. which defines the key features of an occupation as a standardized, measurable set of variables called "descriptors". This hierarchical model starts with six domains, describing...

Words: 529 - Pages: 3

Free Essay

Full Sentence Outline

...I. Are standardized tests fair and help evaluation tools. A. Not all standardized exams are helpful when it comes to students going on to the next level or even graduating high school. 1. Most tests are done in multiple choice format and they do not always measure the ability to think deeply or creatively in any field. 2. Sometimes these types of methods that are used during these type of testing are harmful practices and it can hurt the children when it comes to grade retention and tracking. B. Not all test scores are reliable and they should not be used to determine whether or not a child should graduate or pass to the next level. 1. Test scores are reliable if you get the same results the second time it is administered to you but all test do have measurement error. 2. Measurement error means that the individuals score may vary from day to day due to the testing conditions or the test takers mental or emotional state. The score on young children and scores on sub sections of tests are unreliable. II. Do multiple choice or short answers tests measure important student achievement? A. Multiple choice or short answer tests are very poor yardsticks for detecting whether a student is learning. 1. Multiple choice and short answer tests are weak measures of the ability of students being able to comprehend complex material, write, and apply math. 2. Multiple choice tests and short answers also do not measure thinking skills or assess what people can do on real world tasks...

Words: 469 - Pages: 2

Premium Essay

Educ 5504 Unit 4

... 1. Are the aims and objectives of the research clearly stated? Answer: Yes, aims and objectives of this research are to improve the relationship between classroom instruction and standardized test content and to see the effects these have on students,” parents and teachers. • What are the goals of the research? Answer: The goals of this research are: 1. To identify factors that affect student performance 2. To...

Words: 1758 - Pages: 8

Premium Essay

Systems Structures Overview

...delivery. As such, the Centers for Medicare and Medicaid Services (CMS) will use the Hospital Consumer Assessment of Health care Providers and Systems (HCAHPS) survey. The CMS website (2013) states, the HCAHPS survey is “the first national, standardized, publicly reported survey of patients’ perspectives of hospital care.” This data set is important to CMS in meeting the Triple Aims goal set by the Department of Health and Human Services National Quality Strategy (DHHS-NQS) of providing better care and improved health at affordable cost while making decisions on how reimbursements will be redistributed to institutions meeting these goals. Our group chose this system structure because the analysis generated by the use of HCAHPS will greatly help change delivery of quality care in the next five to ten years. How the Structure Applies HCAHPS is rapidly becoming the national standard on assessing patient experience. The survey is randomized to adult patients admitted to medical, surgical, and maternity care service lines; the survey is not limited to Medicare beneficiaries (Long, 2012). The survey asks recently discharged patients about characteristics of their stay that they are individually able to answer (Saxon & Finkelstein, 2012). The goal of HCAHPS is to be a more objective evaluation than traditional patient satisfaction tools. HCAHPS rates three aspects of care: 1. Processes of care 2. Outcomes of...

Words: 799 - Pages: 4

Premium Essay

The Impact of Onlile Marketing Polokwane Municipality Businesses

...marketers have been forced to reinvent themselves very often to remain relevant. Consumers are increasingly connected to companies and their opinions are highly influential. Markets and supply chains have become complex and require more integration and alignment with the field of consumers (CMO Council, 2011, P10). Online and digital marketing has created a platform of engagement between businesses and the consumers. 3. Background of the study: The internet has led to the creation of a new breed of consumers who are more connected, informed and educated about purchases they make (Kaur, 2012, P1). Instant access to information means the power to influence purchase was shifted from sales to marketers. Marketing became the resource, tool and process through which consumers are reached and converted through valuable content. Consumers research on the web before they make a decision on what to purchase or not purchase. 4. Significance of the study: Strategy, marketing creativity and resources are vital for a marketing strategy to be successful. Technology is part of the resources needed. With the technological advances, especially changes taking place in the internet, the B2B consumers have increased bargaining power while the seller is side lined. This is a digital age and businesses have to think of strategies that will reach potential consumers. This can be achieved by understanding technological changes that have occurred and those occurring and streamline...

Words: 1538 - Pages: 7

Premium Essay

What Role Should Standardized Testing Play in Texas' Public Education System?

...What role should standardized testing play in Texas' public education system? The methods by which children are educated and academically measured in Texas have evolved over the past few decades, due to federal and state directed education policies. In an effort to establish accountability and improve the nation's competitiveness on a global scale, standardized testing has become a driving component of curricula nationwide. Almost every state, including Texas, governs its public schools under a national policy directive known as the "No Child Left Behind Act" (NCLB). The NCLB requires all states to utilize assessments to determine and report if a school has made adequate yearly progress (AYP) in the proficiency levels of all students. This is a relatively recent shift from local control of schools to centralized governance which is intended to improve education and eliminate harmful disparities in education quality (Ricci 342). Instead of school districts determining education standards, the state and federal governments provide the policy direction. One method to assess education performance and compliance with the centralized policy is the use of accountability measures - i.e., standardized tests. The NCLB, coupled with state policy, is intended to decrease inequality and set an objective measurement in place where school districts, schools, teachers, and even students can be held accountable for their progress or lack thereof. However, there are arguments from opponents...

Words: 10323 - Pages: 42

Premium Essay

Milk Tea

...what it is. Surveys according to Hunt (1995) concentrate on asking set of standardized questions and a great help in determining the characteristics of a population such as its age, gender, etc. Respondents and Locale of the Study The respondents of the study are mostly high school students in Newland Center for Education. There are more than 300 students who are studying in the said school. Out of the population, only 50 students were taken as the respondents. Survey-questionnaires were given Second Year, Third Year, and Fourth Year with the help of their respective Class Advisers. Respondents in this study ages from 12 years old to 167 years old. Table 1 presents the respondents of the study. Table 1. Distribution of Respondents Respondents | | N | High School Students 2nd Year 3rd Year 4th Year | | 6 25 19 | Total | | 50 | The data on this research study will mostly derive from the high school students whose likes in eating chocolate cakes are remarkable. Instrumentation The main data gathering tool will be the questionnaire. It will be used to gather the data related in the study and will be employed to gather the significant information to answer specific problems stated in the study. The questionnaire is an instrument in the descriptive survey research that...

Words: 467 - Pages: 2

Premium Essay

Breakthrough in Organization Performance

...enhance productivity and quality, and to gain the competitive advantage of a workforce fully committed to the organization's goals. Organizations are increasingly recognizing that efforts to improve productivity and quality must include attention to the human organization - its motivation, commitment, and morale. For example, a major component of the scoring system for the Malcolm Baldrige award involves accounting for the state of the human organization. Increased attention is therefore being paid to developing tools for analysis and strategic management of the human organization. These tools may be used for measuring the condition of the human organization, evaluating its performance, and initiating corrective action when needed to bring performance in line with organizational objectives. A number of leading firms including General Electric, Texas Instruments, and Motorola have pioneered the development of survey systems which facilitate such measurement. The survey instrument used in this intervention to implement employee-centered management is the Human Resource Index (HRI). The HRI is a...

Words: 422 - Pages: 2