Premium Essay

Numerical Precision

In:

Submitted By tomdickharry
Words 1471
Pages 6
INTRODUCTION
The storage and representation of numbers in a computer can lead to costly mistakes because of precision errors. When using floating point numbers, one must make sure that the correct number of digits is used in a calculation because rounding errors can produce values that lead to errors. Consider the floating point format, exponential format, and binary coded decimal (BCD).

OBJECTIVE
1. Analyze the floating point format in order to: o Determine how floating point numbers are stored in memory. o Discuss the ease or difficulty of manipulating and using floating point numbers in arithmetic calculations. Determine whether or not you believe that the floating point format is memory efficient. Provide a rationale to support your answer. Analyze the format used to store numbers using the binary coded decimal format. Determine whether the BCD format is more or less memory efficient than the floating point format. Compare and contrast the BCD format to the floating point format in terms of: o precision o performance in calculations o memory usage Select the format (floating point format, binary coded decimal (BCD), or exponential format) that you would recommend for processing efficiency and explain why. Floating point numbers can introduce rounding errors in the banking industry, which may lead to financial benefit for the bank but not for the customer. Analyze the ethics of knowingly benefitting from rounding errors. Propose a plan on how the rounding error should be handled. Differentiate between the exponential format and the floating point format in terms of: o format o processing speed o accuracy

While programming computers, floating point describes a method of representing an estimate or an approximation of real numbers in a way that can support a wide range of different values. Numbers

Similar Documents

Free Essay

Numerical Precision

...Numerical Precision by John Nelems Professor Lu CIS512 Strayer University January 26th, 2014 Floating Point Format for storing floating numbers in memory Numeric precision and representation are very familiar discussions in computer science. The way that numbers are stored and represented in a computer system has to be represented correctly in order to avoid costly mistakes. Numbers are stored as binary numbers in computerized system. Floating point numbers are expressed as the product of two parts: the mantissa and a power of two. For example: ± mantissa x 2 exponent The mantissa represents the binary digits of the floating number. The power of two is represented by the exponent. The stored form of the exponent is an 8 –bit value ranging from 0-255. The mantissa is a 24-bit value (represents about seven decimal digits) that has a most significant bit (MSB) that is always 1 and not stored. Also, it has a sign bit that indicates if the floating point number is positive or negative. Floating point arithmetic is one of the most widely used ways of representing real numbers in today’s computer systems. The use of floating point arithmetic provides the following benefits: speed, accuracy, range, portability and ease of implementation and use for numerical applications. Floating point arithmetic uses IEEE 754 standard that is used by most computer manufacturers which makes it easy to use and manipulate floating numbers. Is the floating point format...

Words: 1244 - Pages: 5

Free Essay

Metrotecnia

...Práctica 1 1.- Descripción del aparato y principio de funcionamiento. [pic] • 1. Mordazas para medidas externas. • 2. Mordazas para medidas internas. • 3. Sonda para medida de profundidades. • 4. Escala con divisiones en centímetros y milímetros. • 5. Escala con divisiones en pulgadas y fracciones de pulgada. • 6. Nonio para la lectura de las fracciones de milímetros en que esté dividido. • 7. Nonio para la lectura de las fracciones de pulgada en que esté dividido. • 8. Botón de deslizamiento y freno. El calibre, también denominado cartabón de corredera o pie de rey, es un instrumento para medir dimensiones de objetos relativamente pequeños, desde centímetros hasta fracciones de milímetros (1/10 de milímetro, 1/20 de milímetro, 1/50 de milímetro). En la escala de las pulgadas tiene divisiones equivalentes a 1/16 de pulgada y en su nonio de 1/128 de pulgadas. El inventor de este instrumento fue el matemático francés Pierre Vernier (1580 - 1637 ), y la escala secundaria de un calibre destinada a apreciar fracciones de la unidad menor, se la conoce con el nombre de Vernier en honor a su inventor. En castellano se utiliza con frecuencia la voz nonio para definir esa escala. Consta de una "regla" con una escuadra en un extremo, sobre la cual desliza otra destinada a indicar la medida en una escala. Permite apreciar longitudes de 1/10, 1/20 y 1/50 milímetro utilizando el nonio. Mediante piezas especiales en la parte superior y en su...

Words: 1360 - Pages: 6

Free Essay

Numerical Recipes in C

...Sample page from NUMERICAL RECIPES IN C: THE ART OF SCIENTIFIC COMPUTING (ISBN 0-521-43108-5) Copyright (C) 1988-1992 by Cambridge University Press. Programs Copyright (C) 1988-1992 by Numerical Recipes Software. Permission is granted for internet users to make one paper copy for their own personal use. Further reproduction, or any copying of machinereadable files (including this one) to any server computer, is strictly prohibited. To order Numerical Recipes books or CDROMs, visit website http://www.nr.com or call 1-800-872-7423 (North America only), or send email to directcustserv@cambridge.org (outside North America). Numerical Recipes in C The Art of Scientific Computing Cambridge New York Port Chester Melbourne Sydney EXXON Research and Engineering Company Harvard-Smithsonian Center for Astrophysics Department of Physics, Cornell University CAMBRIDGE UNIVERSITY PRESS William T. Vetterling Saul A. Teukolsky Brian P. Flannery Second Edition William H. Press Polaroid Corporation Published by the Press Syndicate of the University of Cambridge The Pitt Building, Trumpington Street, Cambridge CB2 1RP 40 West 20th Street, New York, NY 10011-4211, USA 477 Williamstown Road, Port Melbourne, VIC, 3207, Australia Copyright c Cambridge University Press 1988, 1992 except for §13.10 and Appendix B, which are placed into the public domain, and except for all other computer programs and procedures, which are Copyright c Numerical Recipes Software 1987, 1988, 1992...

Words: 24819 - Pages: 100

Free Essay

Unknown

...getting a result that is close to the real answer. Precision means getting a similar result every time you try. Think of shooting at a target: Being accurate means you hit the bull's eye. Being precise means hitting the same spot on the target every time. "Accuracy" redirects here. For the song by The Cure, see Three Imaginary Boys. Accuracy is the proximity of measurement results to the true value; precision, the repeatability, or reproducibility of the measurement In the fields of science, engineering, industry, and statistics, the accuracy[1] of a measurement system is the degree of closeness of measurements of a quantity to that quantity's actual (true) value. The precision[1] of a measurement system, also called reproducibility or repeatability, is the degree to which repeated measurements under unchanged conditions show the same results.[2] Although the two words precision and accuracy can be synonymous in colloquialuse, they are deliberately contrasted in the context of the scientific method. A measurement system can be accurate but not precise, precise but not accurate, neither, or both. For example, if an experiment contains a systematic error, then increasing the sample size generally increases precision but does not improve accuracy. The result would be a consistent yet inaccurate string of results from the flawed experiment. Eliminating the systematic error improves accuracy but does not change precision. A measurement system is considered valid if it...

Words: 373 - Pages: 2

Free Essay

What Factors Affect the Resistance of a Wire?

...make sure I use them properly and read them with accuracy. The wire resistance experiment is more precise because the equipment I will use to measure all sorts of different factors in the experiment is more precise than in the parachute experiment mainly because everything is still and not moving in the resistance experiment. We have chosen to do the thickness of the wire because it is easy to control and keep accurate because of the micrometer, which is very precise. In the parachute investigation I would have to measure the distances with a ruler and the micrometers precision is 0.01mm which is a very high precision whereas the ruler has a lower precision of 1mm. We could have used the material as a variable but when we get a graph of results it will be a bar chart and you can’t get a numerical correlation because one side of the chart is not numbers and seen as we are trying to get a numerical correlation it would be pointless to use material as our input variable. The temperature is another variable we could have used but it is very hard to control the temperature and we didn’t really know how we could do it so we decided not to use this as our...

Words: 1998 - Pages: 8

Free Essay

Gaussian Quadrature Rule for Triangle and Tetrahedron

...Gaussian Quadrature rule for Triangle and Tetrahedron Qikun Wu, Liuxing Shen Introduction We demonstrate the position of the Gaussian points in 2D and 3D case, and finished task 2. 1. two dimension case in two dimension case, we will talk about square and triangle. 1.1 tensor products of the one dimensional formula intuitively, if we directly use tensor product of one-dimensional case, we can have a ‘Gaussian Quadrature’ scheme in two dimension, which is illustrated as follows:   1 1 1 1 1 f ( , )d d   1 1  1 1 f ( , )d  d  n 1  n      H i f (i , ) d   H i  f (i , )d 1 1  i 1  i 1 n  n  n n   H i   H j f (i , j )    H i H j f (i , j ) i 1  j 1  i 1 j 1 And this tensor product can extend to arbitrary dimension:   n 1 1 1 1 n  1 1 f ( x1 , x2 n i1 xm )d x1dx2 dxm xm( im ) )   i1 1 i2 1 im 1 H Hi2 Him f ( x1( i1 ) , x2( i2 ) However, we can see that this quadrature is not based on some ‘orthogonal polynomial in 2D’, which is not an optimal solution, so we can expect that we can choose less point to reach the same accuracy. So we should let the quadrature scheme with the following form: I  1 1 1  1 f ( , )d d  Wi f (i ,i ) i 1 n 1.2 non-tensor-product formula As stated before, the non-tensor product form can be made using only 7 points to achieve the same accuracy while the tensor...

Words: 2215 - Pages: 9

Premium Essay

Physics

...Measurement and Measurement Error PHYS 1313 S06 Prof. T.E. Coan Version: 16 Jan ’06 Introduction Physics makes both general and detailed statements about the physical universe and these statements are organized in such a way that they provide a model or a kind of coherent picture about how and why the universe works the way it does. These sets of statements are called “theories” and are much more than a simple list of “facts and figures” like you might find in an almanac or a telephone book (even though almanacs and telephone books are quite useful). A good physics theory is far more interested in principles than simple “facts.” Noting that the moon appears regularly in the night sky is far less interesting than understanding why it does so. We have confidence that a particular physics theory is telling us something interesting about the physical universe because we are able to test quantitatively its predictions or statements about the universe. Indeed, all physics (and scientific) theories have this “put up or shut up” quality to them. For something to be called a physics “theory” in the first place, it must be falsifiable and therefore must make quantitative statements about the universe that can be then quantitatively tested. These tests are called “experiments.” The statement, “My girlfriend is the most charming woman in the world,” however true it may be, has no business being in a physics theory because it simply cannot be quantitatively...

Words: 3271 - Pages: 14

Free Essay

Tata Nano Case Study

...MARK 957 ASSIGNMENT 1 Submitted by Avinash Gaikwad 5072827 The machine tool industry is large and fragmented in its own scope, it manufactures and supplies the machines to cut, shape, and shape metals where a large portion of the manufacturing industries are dependent. The precision in class of the machine tools themselves, their control frameworks and the association encompassing them to a great extent focus the profitability and intensity of designing commercial enterpries.(Marcuse, 2002) The machine tool industry faces two noteworthy difficulties today. One is that about innovation in machine tools has changed its own technology improvements. Over a century of transformative advancement, predominantly including phenomenal technology upgradations and enhanced control of large scale manufacturing, the primary advancement in machine tool industry over two decades has included computerization and automation of small and medium scale enterprises regarding the current scenario of numerical control and different parts of the microelectronic setup. This adjustment in the overall structure of the machines and innovative change is constraining significant changes both inside(internal) of the business and in its association with clients(external). The other issue is that the focused circumstance on the planet where business is evolving quickly, bringing about serious modification issues for most machine tool makers. Despite the fact that this is an industry in which remote exchange...

Words: 2007 - Pages: 9

Free Essay

Fdi and Asda

...MSc Management with Streams Strategy Assessment Brief Due: 4pm, 29 April 2014 Page 1 of 8 1. Background Information The purpose of this assignment is to give you an opportunity to present your understanding of the concepts in strategy, to identify and appreciate the challenges strategists face in real-life situations and to apply different frameworks and tools in order to analyse the strategic positions of a firm in an industry or market. A direct outcome of this last part is to demonstrate that you can diagnose any challenges or gaps that this firm can pursue or fill and, therefore, you can recommend alternative strategies. Instructions: 1. Pick a company you find interesting in any industry, market or country you like. Make sure that you choose a firm that meets the following criteria: a. It is not very small (10+ employees) b. It generates revenue of a few hundreds thousands pounds or equivalent (£100,000+ revenue) c. you can find enough information about it The last criterion is very important as your assignment is heavily based on the information you can collect and the level of accessibility you can get for this information 2. Read as much material as you can find about this firm. Try to understand the business, the strategies it follows and the challenges it faces in that industry 3. Then, proceed with the assignment questions 2. Assignment Questions You are a management consultant and you have been asked by the Board of Directors of your employer to prepare...

Words: 2133 - Pages: 9

Free Essay

Jonjonjon

...Industrial Robots and Engineering systems Task 2 One Japanese manufacturer, by installing a flexible manufacturing system, has reduced the number of machines in one facility from 68 to 18, the number of employees from 215 to 12, space requirements from 103000 square feet to 30000 and processing time from 35 days to a 1.5 days. “Ford has poured $4,400,000 into overhauling its Torrence Avenue plant in Chicago, giving it flexible manufacturing capability. This will allow the factory to add new models in as little as two weeks instead of two months or longer. The flexible manufacturing systems used in five of Ford Motor Company's plants will yield a $2.5 billion savings. By the year 2010, Ford will have converted 80 percent of its plants to flexible manufacturing.” (www.ford-motorcompany.com) Looking at local FMS systems, we have Nissan in Sunderland and Greggs in Longbenton. Both these companies have fantastic FMS systems, with virtually no human input, loading- manufacture-unloading is all completed by FMS, this removes the need for human input, which greatly improves quality and output. There are more benefits to FMS, using humans for repetitive work can be dangerous for the body, fatigue is a large part in human operation and if done for long periods of time (i.e. a 10-20 years of work) the human body begins to shut down, creating problems such as arthritis and repetitive strain injury. Industrial Robots and Engineering systems Task 2 One Japanese manufacturer...

Words: 4191 - Pages: 17

Free Essay

The History of Management

...What were the outcomes of your MyFoundationsLab Path Builder? The outcomes to MyFoundationsLab path builder were, I mastered 5 of 16 topics. One of the topics I mastered was the craft of writing which I mastered on assessment. There are five topics on the craft of writing which I mastered all. Not really too sure what it means but I received a gold star in study skills, which I’m guessing means I mastered a topic. How do the skills apply to your academic life? Well if I was fortunate enough to have been a master at the craft of writing, I can see that being very good in everything I do academically. I have always been a neat freak and like my words spelled right and my sentences readable which is why I probably am proficient in this area. In everything I do on the phoenix college courses I have to write to communicate, so being able to be clear and correct will be beneficial in my grades and clarity of substance. How do the skills apply to your professional life? I am a Military Policeman my duties are that of any civilian policeman except we wear the Army uniform and only have jurisdiction on post. Every day I use my writing skills on a slow day I still take a journal of the events throughout the day. On a busy day I would have to make a case which involves taking statements from subjects, witnesses, and victims and I would also have to make a statement. All that work has to be precise and good enough to present in a court of law. It is a lot of detail and accuracy to...

Words: 368 - Pages: 2

Free Essay

Hfkdhslufkcnf

...Chapter 1 student learning objectives (SLOs) Goal/Benchmark A: Students will be able to use dimensional analysis using appropriate SI and non SI units and apply their understanding of significant figures * Knowledge Focus A.1: Essential concepts Objectives-Students will be able to: * [Retrieval] * Define chemistry * Define and list each of the steps of the scientific method * Define physical and chemical properties * Define extensive and intensive properties * Define density * [Comprehension] * Explain in their own words or represent symbolically the meaning of: * Chemistry * Steps of the scientific method * Physical and chemical properties * Extensive and intensive properties * Density * [Analysis] * Identify and explain similarities and differences between the different steps of the scientific method * Analyze errors with the application of the steps of the scientific method * Identify and explain the similarities and differences between physical and chemical properties * Identify and explain the similarities and differences between extensive and intensive properties * Use the concept of density to solve chemical problems * Knowledge Focus A.2: Dimensional analysis Objectives-Students will be able to: * [Retrieval] * List/recognize the SI units...

Words: 431 - Pages: 2

Free Essay

Eyewitness Testimony and More.

...itEyewitness Testimony - Evidence given by a witness to a significant event such as a crime or serious accident. - The evidence usually takes forms of personal identification or verbal account of what happened. - Problems can occur at any point in the memory process: 1) Acquisition: Information the person perceives Poor viewing conditions Focus on weapons 2) Storage: Information the person stores in memory Misleading information Source misattribution errors 3) Retrieval: Information the person retrieves at a later time Best guesses in line-up identification Leading questions - Inaccurate eyewitness testimony can have very serious consequences leading to wrongful convictions. - Why eyewitness testimony may be unreliable? * The role of anxiety: Baddeley 1997 reported that 74% of suspects convicted in 300 cases where eyewitness identification was the only evidence against them. Anxiety may lead to unreliable remembering depends on number of factors. * Research on ‘weapon focus’ Loftus 1979: P were exposed to one of the 2 situations; 1- They overheard a low-key discussion about an equipment failure. A person then emerged holding a pen with grease on his hands. 2- They overheard a heated and hostile exchange between people in the lab. After the sound of breaking glass and crashing chairs, a man emerged from the lab holding a paper knife covered in blood. P were then given 50 photos to try and identify the person. Findings: 1- Accurately identified...

Words: 1193 - Pages: 5

Premium Essay

Decisions of Uncertainity

...areapplying for the open position, 26 are female and 26 are male. If the company assume that each of the 52 possibilities is equally likely, it is reasonable to expect that the company would select a male applicant that is qualified for the open position 0.50 of the time of a period of time ( 26/52 = ½ = 0.50 ). This illustrates the basic rule for obtaining probabilities in situations in which each of the possible outcomes is equally likely, the probability of the occurrence of an event is equal to the proportion of the possible outcomes characterized by the event. In the case of hiring a qualified male employee, 26, or 0.50, of the 52 possible outcomes will be characterized by the event “a qualified male employee.” Tradeoffs in accuracy and precision Conclusion References Duan, Li. “The uncertainity sensitivity index method (USIM) and its extension’, Naval Research Logistics, 1988. Haimes, Yacov Y. "Defining Uncertainty and Sensitivity Analysis", Risk...

Words: 341 - Pages: 2

Premium Essay

Personal

...Annual Performance Review Employee Name | Cathy Smith | Title | HR Receptionist | Date of Review Period | 2010 | Supervisor Name | Tiffany Reynolds | Department | Human Resource | Exceeds Expectations = 5[employee has exceeded objective, time and quality] | More Than Satisfactory = 4[employee has slightly exceeded either time and/or quality] | Satisfactory = 3[employee has met objective, may be just under objective on time and quality] | Less Than Satisfactory = 2[employee has not met objective on either time or quality] | Needs Improvement = 1[employee far below on both time and quality] | Task | Objective/Measurement | Results | Comments | Ranking | Typing | 96% accuracy | 90% | This is an opportunity for improvement. The required results are 96% and the your final result is 90%. | 2 | | Complete within 48 hours of submission | Within 24 hours | This is an area that you have continued to excel in. Continue to use best practices and efficient methods of concentration. You consistently provide service with 50% less of the required timeframe. Great job | 5 | Filing | 98% accuracy | 82% | This is an area of opportunity. It is important to ensure the quality of formatting information to provide productive services. The required goal is 98% and you obtained a final score of 82%. | 1 | | Complete by end of the day | By end of each week | The required assignments have a due date of the end of business.. In this metric you are not able to complete...

Words: 794 - Pages: 4