Free Essay

Usability Evaluation

In:

Submitted By thwea8
Words 816
Pages 4
Usability Evaluation
Professor Cox
CIS 375

Abstract
Online surveys are a great alternative to lavish mail or telephone surveys. There are a few requirements to online surveys however that you must be aware of. Using the Internet to conduct quantitative research presents challenges not found in conventional research. Some of our knowledge concerning the effective design and use of paper-based surveys does translate into electronic formats. However, electronic surveys have distinctive technological, demographic and response characteristics that affect how they should be designed, when they can be used and how they can be implemented. Survey design, subject privacy and confidentiality, sampling and subject solicitation, distribution methods and response rates and survey piloting are critical methodological components that must be addressed in order to conduct sound online research.

The easy and difficult aspects of creating and conducting an online questionnaire are a constraint, timeliness, important and the nature of the research requires it. While there are three types of questions have numerous versions. eSurveysPro, for example, offers a dozen different question types based on these three basic types. For example, you can have a multiple choice question that lets the customer choose from a dropdown list, a vertical (up/down) list of choices, or horizontal (left/right) choices. This may seem cosmetic but dropdown lists might delay participation because the customer may not see the question. And a horizontal list of choices might make your survey appear shorter than if the same choices are laid out vertically across the page and under the question.
In addition, the following are other ways to Ensure Valid Responses to an Online Survey are: * Avoid having a huge scrolling survey. Introduce page breaks as necessary. * Refrain from having one question per page, this increases the time to complete the survey as well as increases the chances for "drop outs". * Use attention filters which are trick questions that typically use a large block of text and in the center, it will ask the respondent to answer in a certain way or use skip logic to send anyone who answers incorrectly to the end of the survey. You can also track them and prevent “click throughs” from receiving any reward you offered for responding.
Then there one could use “Trap” Questions, Trap questions are designed to trap individuals who are speeding or cheating as they take the survey. The intent of the questions are obvious and if seen would be answered correctly. However, the questions are placed within a matrix question, thereby making them somewhat difficult for a speeder to spot. These questions are either answered correctly or not, and a speeder will rarely answer all of them correctly.
Examples of Trap questions are easy to design, as show below: * If you live in the U.S. select Strongly Agree (Strongly Disagree – Strongly Agree) * Please answer very unhappy (Very Unhappy – Very Happy) * How happy are you with receiving a very large bill from the IRS (Very Unhappy – Very Happy) timing.
Finally, there are timing questions which have two important uses: timing questions are very helpful in conducting experiments where it is important to track response times. It is also helpful in identifying respondents who speed through a survey, spending only a few second on each page. The timing question is valuable because you can see how long respondents were on a page. This is a powerful tool at your disposal to monitor the quality of your response data.

Assess the reliability of the collected data and include the survey report are very important validity refers to the essential truthfulness of a piece of data. By asserting validity, the researcher is asserting that the data actually measure or reflect the specific phenomenon claimed. Scientific history is full of examples of research findings that were discredited because they were shown to lack validity and reliability to me relates to researchers' claims regarding the accuracy of their data.

Assess the validity of the collected data and include the survey report.

Evaluating the usability of the online questionnaire Website and testing is critical because you should never change your survey once it is put up and advertised. Changing questions in mid-survey will distort your results, creating two surveys. Your goal is to ensure that the results you get the first time are adequate for your needs.

In Conclusion, the quality of your research boils down to the quality of your data. Use any of these 4 methods to ensure you get valid responses for your next online survey and online surveys are a great alternative to lavish mail or telephone surveys. Although there are a few requirements to online surveys you must be aware of using the internet to conduct quantitative research presents challenges not found in conventional research.

Reference

John Wiley & Son (2014) 3rd Edition, Interaction Design http://www.surveysystem.com/reports.htm http://www.sciencebuddies.org/science-fair-projects/project_ideas/Soc_survey.shtml

Similar Documents

Premium Essay

Nt1310 Unit 2.2 Usability Evaluation Techniques

...2.2 Usability Evaluation Techniques 2.2.1 Pluralistic Usability Walkthrough The Pluralistic Walkthrough (also called a Participatory Design Review, User-Centred Walkthrough, Storyboarding, Table-Topping, or Group Walkthrough) is a usability inspection method used to identify usability issues in a piece of software or website in an effort to create a maximally usable human-computer interface. The method centres on using a group of users, developers and usability professionals to step through a task scenario, discussing usability issues associated with dialog elements involved in the scenario steps. There are however limitations due to this technique being only as quick as the slowest person in the group. 2.2.2 Heuristic Evaluation A heuristic evaluation is a usability inspection method for computer software that...

Words: 1192 - Pages: 5

Premium Essay

Assignment#03 Usability Evaluation

...15 Assignment 3: Usability Evaluation 15 Assignment 3: Usability Evaluation Questionnaire is one of the most popular techniques for gathering data, where questions in a questionnaire are designed to be answered asynchronously, i.e. without the presence of the investigator. A goal must be set, before developing the questionnaire, as developer would like to have relevant reasons before starting working on something. Targeting the participants is another important element of collecting data through online questionnaire. In many ways questionnaire is similar to interviews as questions could be open or closed. Since interviewer is not present or in a word nobody is available to interpret the questions for the participant, making the questions clear and data collection efficient -- questions need to be clearly worded. Skilled people are needed to design a questionnaire especially to gather valid and reliable data. Easy and difficult aspects of creating and conducting an online questionnaire: First, I would explain the easy aspects of creating and conducting an online questionnaire. Online questionnaire is very effective when targeting a large number of people in terms of gathering valuable information. There are two ways of doing online questionnaire: email questionnaire and web based questionnaire. Email questionnaire is not that effective and hard to reach a maximum number of participants. On the other hand web-based questionnaire can reach any region in the world...

Words: 1248 - Pages: 5

Free Essay

Design

...User Experience ©Jeff Patton Five topics today: User Experience explained simply and then: Users and modeling what you know about them Usability evaluating & testing it Visual Design guidelines to help visual design to communicate what you intend Emotional Design how do users feel about your software? 2 3 4 User Experience is Built From Dependent Layers Jesse James Garrett’s Elements of User Experience: http://www.jjg.net/elements/ 5 The Surface Layer Describes Finished Visual Design Aspects Surface Skeleton Structure Scope Strategy 6 The Skeleton Describes Screen Layout and Functional Compartments in the Screen Surface Skeleton Structure Scope Strategy 7 Structure Defines Navigation from Place to Place in the User Interface Surface Skeleton Structure Scope modal wizards task panes modal dialogs Strategy 8 The Places in the User Interface are Built to Support User Task-Centric Scope Surface Skeleton Structure Scope Strategy user tasks: • enter numbers • enter text • enter formulas • format cells • sort information • filter information • aggregate information • graph data • save data • import data • export data • print • ….. 9 Business Goals Drive User Constituencies and Contexts Supported To Form Strategy Surface Skeleton Structure Scope Strategy business goals: • displace competitive products • motivate sale of other integrated products • establish file format as default information sharing format...

Words: 2870 - Pages: 12

Free Essay

Software Engineering

... software applications, and websites with the focus on theuser's experience and interaction. The goal of user interface design is to make the user's interaction as simple and efficient as possible, in terms of accomplishing user goals—what is often called user-centered design. Good user interface design facilitates finishing the task at hand without drawing unnecessary attention to itself. Graphic design may be utilized to support its usability. The design process must balance technical functionality and visual elements (e.g., mental model) to create a system that is not only operational but also usable and adaptable to changing user needs. OBJECTIVES: The main objectives of user interface design are: * To suggest some general design principles for user interface design * To explain different interaction styles and their use * To explain when to use graphical and textual information presentation * To explain the principal activities in the user interface design process (interaction activities) * To introduce usability attributes and approaches to system evaluation USER INTERFACE: * System users often judge a system by its interface rather than its functionality * A poorly designed interface can cause a user to make catastrophic errors * Poor user interface design is the reason why so many software systems are never used * Most users of business systems interact with these systems through graphical user interfaces (GUIs) * In some cases, legacy text-based...

Words: 1712 - Pages: 7

Free Essay

Business P4

...Phillips.Kieran | | | Purpose The purpose of this website is to be largely promotional and raise the status of Monmouth and the surrounding areas as a destination for overseas visitors. In achieving this, the website is designed to be informational, educational and to encourage tourists to visit and stay in the area. Availability and Accessibility Starting with the basic, yet key aspect of usability, I will be discussing the availability and accessibility of the site. If people try to access the website and it doesn’t work — for whatever reason –the website becomes worthless. An example is server uptime, it’s important to ensure the possible or current visitors don’t get an error trying to load the site therefore it will be wise to invest in good hosting which will be done. Another example is broken links, it is essential to double check that there are no dead links on the site. Another key aspect to consider is Mobile responsiveness, ensuring that the site can handle different screen sizes and slow connections. Clarity The second key aspect to usability is clarity. If you distract or confuse your visitors, they will either need more time to find what they came for, or they might forget their initial goal all together. Either way, they will not experience the website as user-friendly or chances are that they will leave dissatisfied and with no intention of coming back. This is why I have decided that a clear and usable design can be achieved through: ...

Words: 1222 - Pages: 5

Free Essay

Usability and Security

...Running Head: USABLE SECURITY THE IMPLEMENTATION Usable Security the Implementation Name Institution Abstract This project was about usability security and its implementation. It involved the designing and development of a suitable human computer interface to provide a log on module for the Kuwait armed forces computer system. The development focused on relieving the user from the load of creating, remembering and maintaining their passwords for the login process. Based on the fact that the Kuwait information and communication technology literacy levels are still in their infancy stage, the conventional authentication system was proved unfriendly to the user. This system was developed with this in mind. This proposed system relies on the user logging in to the system after identifying five pictures they uploaded earlier from among a grid of twenty five pictures. By selecting the five correct pictures which they uploaded, the system was able to successfully authenticate the user. Using these pictures greatly reduced the mental load on a user who was required to remember strong passwords that ended up being compromised (Badre 2002). The use of pictures or graphical images for authentication or access control is a practice called biometrics that is gaining popularity in establishing system security today. Due to the need to deliver a solution in the shortest time possible the...

Words: 17373 - Pages: 70

Premium Essay

Juju

...Page 1 Evaluating Web-Based Instructional Design © Copyright Harold Henke, 1997, 2001 all rights reserved Author’s note: This paper was written in 1997 as a project paper for a course on Human-Computer Interaction. This paper was reformatted in June, 2001. Page 2 Table of Contents List of Illustrations...................................................................................... 3 List of Tables............................................................................................... 3 Chapter 1: Introduction .............................................................................. 4 Problem Statement .................................................................................... 4 Chapter 2: Literature Review ...................................................................... 5 Definition of Web-Based Instruction............................................................. 5 Importance of Web-Based Instruction ........................................................... 5 Web-Based Instruction Design Issues ........................................................... 6 Chapter 3: Methodology Design .................................................................. 7 Top Ten Web Design Mistakes ..................................................................... 7 Interface Design for Computer-based Learning Environments........................... 8 Measurement Scores ........................................................

Words: 6250 - Pages: 25

Free Essay

Holiday Inn China Website Usability Study

...Qianying Liu, Niven Sellars, Michael Somer | Subject: | Usability Testing Findings Report for Chinese Holiday Inn website | Date: | April 25, 2008 | Included with this memo is team CBR China’s final report for our research project on the Holiday Inn’s Chinese website. The following are included within this report: * Project purpose * Goals set by Team CBR China * Processes followed during the project * Heuristic review * Test plan * Recruitment and screening * Real-time logging * Analysis * Categorized results and findings * Recommendations In addition to the aforementioned items included in this report, team CBR China also includes appendices of our test logs, participant consent forms, screeners, questionnaires, scenarios, and other materials in support of testing. Other research components include the team’s heuristic evaluation, personas, and test plan. Team CBR China would like to extend its gratitude to our sponsor, Karen Bennett, as well as our instructor Dr. Carol Barnum, who has assisted us throughout this project. Without both of you we would not have had the chance to engage in a real world usability experience. Thank you again, The members of team CBR China Table of Contents Executive Summary 3 Test Objective 3 Our Process 4 Our Results 4 Background 5 Report Overview 6 Methodology 7 Overview 7 User Profiles 7 Usability Criteria 8 Test Objectives 9 Findings and Recommendations...

Words: 8013 - Pages: 33

Free Essay

P4 Ad P5 Unit Business

...Phillips.Kieran | | | Purpose The purpose of this website is to be largely promotional and raise the status of Monmouth and the surrounding areas as a destination for overseas visitors. In achieving this, the website is designed to be informational, educational and to encourage tourists to visit and stay in the area. Availability and Accessibility Starting with the basic, yet key aspect of usability, I will be discussing the availability and accessibility of the site. If people try to access the website and it doesn’t work — for whatever reason –the website becomes worthless. An example is server uptime, it’s important to ensure the possible or current visitors don’t get an error trying to load the site therefore it will be wise to invest in good hosting which will be done. Another example is broken links, it is essential to double check that there are no dead links on the site. Another key aspect to consider is Mobile responsiveness, ensuring that the site can handle different screen sizes and slow connections. Clarity The second key aspect to usability is clarity. If you distract or confuse your visitors, they will either need more time to find what they came for, or they might forget their initial goal all together. Either way, they will not experience the website as user-friendly or chances are that they will leave dissatisfied and with no intention of coming back. This is why I have decided that a clear and usable design can be achieved through: ...

Words: 1222 - Pages: 5

Free Essay

Introduction to Information System Security

...& communication HCI: Statistical Methods for HCI HCI: Human factors & security HCI: Design-oriented HCI HCI: Mixed, Augmented and Virtual Reality 4 4 Core-Tier2 hours Includes Electives N N HC/Foundations [4 Core-Tier1 hours, 0 Core-Tier2 hours] Motivation: For end-users, the interface is the system. So design in this domain must be interaction-focussed and human-centred. Students need a different repertoire of techniques to address this than is provided elsewhere in the curriculum. Topics: • • • Contexts for HCI (anything with a user interface: webpage, business applications, mobile applications, games, etc.) Processes for user-centered development: early focus on users, empirical testing, iterative design. Different measures for evaluation: utility, efficiency, learnability, user satisfaction. Strawman draft version: February 2012 • • • • • • Physical capabilities that inform interaction design:...

Words: 1936 - Pages: 8

Free Essay

Online Rege

...Task analysis and human-computer interaction: approaches, techniques, and levels of analysis Abe Crystal School of Information and Library Science University of North Carolina at Chapel Hill acrystal@email.unc.edu Beth Ellington School of Information and Library Science University of North Carolina at Chapel Hill elliv@email.unc.edu ABSTRACT In this paper we critically review task analysis models and techniques. These approaches to task analysis are discussed in order to develop a richer picture of human activity, while analyzing their limitations, general weaknesses, and possibilities for improvement. We consider their ability to determine the appropriate set of atomic actions in a task, their effect on workers’ motivational needs, their support of users’ cognitive and sociocultural processes, and their effectiveness in supporting interface design. We note that the major approaches have focused on very different levels of analysis, and call for greater integration of these different levels in task analysis theory. Keywords Task analysis, cognitive modeling, activity theory. INTRODUCTION Practitioners and researchers routinely advocate building user-centered systems which enable people to reach their goals, take account of natural human limitations, and generally are intuitive, efficient and pleasurable to use (Preece, Rogers and Sharp, 2002). Central to the design of such systems is a clear understanding of what users actually want to do: What...

Words: 5335 - Pages: 22

Premium Essay

Business

...concepts of usability and user experience •  Understand fundamental design principles •  Develop –  awareness of how to apply them in design –  Critical ability to evaluate other people design 2 Usability •  “Extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.” –  ISO 9241-11:1998 Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability. 3 Usability •  Usability is a quality attribute that assesses how easy user interfaces are to use. •  Five quality dimensions: –  Learnability: How easy is it for users to accomplish basic tasks the first time they encounter the design? –  Efficiency: Once users have learned the design, how quickly can they perform tasks? –  Memorability: When users return to the design after a period of not using it, how easily can they reestablish proficiency? –  Errors: How many errors do users make, how severe are these errors, and how easily can they recover from the errors? –  Satisfaction: How pleasant is it to use the design? –  http://www.useit.com/ 4 Usability •  Quality = absence of problems –  discover usability problems and reduce their frequency and severity. –  It can be measured –  Objective data (performance data derived by behavioural data, user observations) –  Subjective data (self-report, questionnaire or interview) 5 •  Is usability all that matters...

Words: 1298 - Pages: 6

Premium Essay

Selecting Appropriate Assessment Procedure

...Teaching Script Objectives: 1. The student learner will accurately define the meaning of usability. 2. The student learner will describe the meaning of practicality. 3. The student will identify and explain four questions that help faculty in selecting appropriate assessment procedures. Usability is simplifying the use of a system or product with effective results. Practicality: Looks at the effectiveness and quality of the systems or products being used. For example, when testing the instructor uses a test pamphlet and scantrons. Using scantrons would make it easier for her to grade tests and would also provide accurate and consistent results. This is an example of both usability and practicality. Four questions/factors can be used to help guide faculty in selecting appropriate assessment procedures: 1.How easy is...

Words: 503 - Pages: 3

Free Essay

Usability

...Design Process and Evaluation • Understand and meet user expectations- there is no process to understand what the user experience is. They may have collected random samples and had them use the website but it would be more efficient to prompt the user to take a random survey during or after they have used the website. They may have this but I was never prompted to take a survey. It would be nice to have an entire section or link to identify problems or make recommendations. • Use Parallel design- although the design of the website is efficient (doesn’t have any flash or glamour) it is a little bland. It has a very “government website” feel to it. If they took multiple website designers opinions and ended up with this product, they chose the wrong website designers. The site could appeal to more users by choosing a more modern layout and color scheme. This site feels like it was created on Windows 95. Optimizing the User Experience • Format the information for reading and printing- when attempting to print a page about one of the nursing homes in my area, I found that there was a lot of fluff in the page. The title bar was far too big, they had the “information” symbol in the printed copy (not needed), hyperlinks where still in the printed copy, and pages were split right in the middle of certain charts. A more universal printing layout would be more ideal for this site. • Provide Assistance to Users- when accessing the website for the first time, I was not prompted to “start...

Words: 1044 - Pages: 5

Premium Essay

Mehehe

...Chapter 1 THE PROBLEM AND ITS BACKGROUND Introduction Now a day, computer is one of the technologies that most people use in their everyday lives. The use of computer is one of the fastest growing and most important developments in our time. People used computers to give easiest and fastest method of finding information. Most students used computers to their research work, assignments, projects, thesis and it is most effective technology because it gives us more knowledge and we can learn something from it. Computers are just known as a piece of equipment where awesome package of glass, plastic, metal and wires- use to make our work easier. It is one way to achieve changes, which we can create different things through using its features. Computers have actually transformed our lives- how we communicate, how we could work and learn things and even how we play. Computers are efficient tools in processing data into useful information. They are essential tools in almost every field of research and applied technologies because of their capabilities. And because of the widespread use and availability of computers, it is essential that everyone acquires an understanding to be ignorant of the important role of computers in any career or business of choice. Being computer literate it can give anyone great competitive advantages. One example of technology is internet, widely used for everyone and popular. Everything can be known in the internet. It is an international network...

Words: 7189 - Pages: 29