...Data Mining Algorithms for Classification BSc Thesis Artificial Intelligence Author: Patrick Ozer Radboud University Nijmegen January 2008 Supervisor: Dr. I.G. Sprinkhuizen-Kuyper Radboud University Nijmegen Abstract Data Mining is a technique used in various domains to give meaning to the available data. In classification tree modeling the data is classified to make predictions about new data. Using old data to predict new data has the danger of being too fitted on the old data. But that problem can be solved by pruning methods which degeneralizes the modeled tree. This paper describes the use of classification trees and shows two methods of pruning them. An experiment has been set up using different kinds of classification tree algorithms with different pruning methods to test the performance of the algorithms and pruning methods. This paper also analyzes data set properties to find relations between them and the classification algorithms and pruning methods. 2 1 Introduction The last few years Data Mining has become more and more popular. Together with the information age, the digital revolution made it necessary to use some heuristics to be able to analyze the large amount of data that has become available. Data Mining has especially become popular in the fields of forensic science, fraud analysis and healthcare, for it reduces costs in time and money. One of the definitions of Data Mining is; “Data Mining is a process that consists of applying data analysis and discovery...
Words: 5455 - Pages: 22
...Chapter 6: Binary Trees Objectives Looking ahead – in this chapter, we’ll consider • Trees, Binary Trees, and Binary Search Trees • Implementing Binary Trees • Searching a Binary Search Tree • Tree Traversal • Insertion • Deletion Data Structures and Algorithms in C++, Fourth Edition 2 Objectives (continued) • • • • • • Balancing a Tree Self-Adjusting Trees Heaps Treaps k-d Trees Polish Notation and Expression Trees Data Structures and Algorithms in C++, Fourth Edition 3 Trees, Binary Trees, and Binary Search Trees • While linked lists, stacks, and queues are useful data structures, they do have limitations – Linked lists are linear in form and cannot reflect hierarchically organized data – Stacks and queues are one-dimensional structures and have limited expressiveness • To overcome these limitations, we’ll consider a new data structure, the tree • Trees consist of two components, nodes and arcs (or edges) • Trees are drawn with the root at the top, and “grow” down – The leaves of the tree (also called terminal nodes) are at the bottom of the tree Data Structures and Algorithms in C++, Fourth Edition 4 Trees, Binary Trees, and Binary Search Trees (continued) • Trees can be defined recursively as follows: 1. 2. 3. A tree with no nodes or arcs (an empty structure) is an empty tree If we have a set t1… tk of disjoint trees, the tree whose root has the roots of t1… tk as its children is a tree Only structures...
Words: 11443 - Pages: 46
...the number of it levels in tacked. There is a few terms that we must know, key. A key is a value of data that is searched from an index. A rid is what is call or referred to as a record ID. The nodes are broken down in to two categories; those are referred to as internal index nodes and leaf nodes. The internal index nods stores each value of keys and page identifiers. The leaf node stores the actual keys. Question 2) Explain the details of a binary tree A binary tree is a data structure that was nodes that have two nodes called child nodes. These nodes are located on the left and right side. On a binary tree the parent nodes was two children nodes and that is the max for each parent. There are different types of binary trees and some of them are called; full binary tree, rooted binary tree and complete binary tree just to name a few. Question 3) What are real world examples of tree implementations One example that I can give is 3D games. There are many games out there and on many different systems. Not only are there games on the WII or X-Box but there are becoming more popular on media sites like facebook. How does it work,...
Words: 590 - Pages: 3
... Garry Jefferson hated his stay-at-home job. Day in and day out, he read and re-read essays written by illiterates hoping to scrape up a grade in his Psychology class. Fortunately, he never saw the acne pocked faces of the students he graded, and he could only imagine the facial horrors that roamed Blue River Community College’s halls. Blue River was a small town in central Colorado, inhabited by filthy rich old folk, and their grandchildren. The streets were clean, but the buildings that flanked the pavement were as dirty as could be. Inside the stone monoliths existed drug operations, brothels, cult gatherings, you name it. When the sun set is when the roles reversed, the filth being purged from their halls by police, and their hired mercenaries. This wasn’t a daily occurrence, maybe a bi-weekly one if things got heated between local gangs, but it was enough to create a tense atmosphere that lay in the air for all of time. Garry’s hand grew tired from typing at a maddening pace, correcting horrible grammatical errors, spelling errors and general un organization. He didn’t notice it at first, and when he did, panic began to set in. Sore hands slid from his keyboard as he slowly turned in his chair, and noticed the lights outside his office room were off. What he had noticed wasn’t the droning electrical sounds emitting from the lights that suddenly stopped when the fluorescent bulbs dimmed, but the slithering sound from the hallway. Then, dead silence, so quiet he could hear...
Words: 708 - Pages: 3
...i SASTRA UNIVERSITY Shanmugha Arts, Science, Technology and Research Academy Thirumalaisamudram Thanjavur – 613 402 BCSCCS705 PARALLEL COMPUTING AND ALGORITHMS LAB B.TECH (COMPUTER SCIENCE AND ENGINEERING) 7TH SEMESTER ii List of Exercises: 1. Basic arithmetic operations in parallel 2. Find out factorial of a number 3. Generation of Fibonacci series, finding prime numbers in an interval. 4. Evaluate the integral of a function 5. Merging of two sorted lists 6. Parallel tree traversals 7. Matrix multiplication 8. Enumeration sort 9. Odd-Even transposition sort 10. Bitonic merge 11. Quick sort 12. Single source shortest path iii Exercise 1 Aim: Basic Arithmetic Operations in parallel To perform a set of arithmetic operations in parallel using a cluster of computers Procedure: Step 1: Identify a set of numbers over which arithmetic operations are to be done Step 2: Identify the rank in the cluster Step 3: Split the set of numbers into domains and assign each domain to their corresponding processor Step 4: Get the result from each computer in the cluster and assimilate them at the master Step 5: Verify the time taken for the completion of each task. Algorithm:function sum(+,identity,a) = if #a == 1 then [identity] else let e = even_elts(a); o = odd_elts(a); s = scan_op(op,identity,{op(e,o): e in e; o in o}) in interleave(s,{op(s,e): s in s; e in e}); iv Input:- An array of integers Output: - The sum 3,2,7,6 P1 18 0,5,4,8 P2 17 62 2,0,1,5 P3 8...
Words: 1116 - Pages: 5
...Hannah Muller ENVR 102 Book Report For this book report, I read Teaching the Trees by Joan Maloof. Joan Maloof studied Plant Science at the University of Delaware, Environmental Science at the University of Maryland Eastern Shore, and Ecology at the University of Maryland College Park. Maloof is a professor at Salisbury University who teaches biology and environmental studies at Salisbury University. Aside from being a professor, Maloof is a biologist. She was always very interested in forests so from very early on Maloof has been exploring forests all over the eastern United States. She puts a lot of focus on the intertwined connections between specific tree species and the specific animals and insects that need to tree to live and in turn the tree needs them as well. Maloof possesses great enthusiasm for the woods and everything that they contain and is working on developing networking old growth forests across the United States. Teaching the Trees starts out with Joan Maloof saying how we would lose the “Magical Web” of relationships between organisms and trees (Maloof xiii). She begins talking about the services that trees provide for us. She also talks about how the benefits of trees equal healthier air for us to breathe. Japanese researchers have even found that there are 120 chemical compounds in mountain forest air that are good for us (Maloof 3). Inhaling this air can even be cancer preventing. Perhaps by trying to save the forests we are actually trying to save...
Words: 1949 - Pages: 8
... Garry Jefferson hated his stay-at-home job. Day in and day out, he read and re-read essays written by illiterates hoping to scrape up a grade in his Psychology class. Fortunately, he never saw the acne pocked faces of the students he graded, and he could only imagine the facial horrors that roamed Blue River Community College’s halls. Blue River was a small town in central Colorado, inhabited by filthy rich old folk, and their grandchildren. The streets were clean, but the buildings that flanked the pavement were as dirty as could be. Inside the stone monoliths existed drug operations, brothels, cult gatherings, you name it. When the sun set is when the roles reversed, the filth being purged from their halls by police, and their hired mercenaries. This wasn’t a daily occurrence, maybe a bi-weekly one if things got heated between local gangs, but it was enough to create a tense atmosphere that lay in the air for all of time. Garry’s hand grew tired from typing at a maddening pace, correcting horrible grammatical errors, spelling errors and general un organization. He didn’t notice it at first, and when he did, panic began to set in. Sore hands slid from his keyboard as he slowly turned in his chair, and noticed the lights outside his office room were off. What he had noticed wasn’t the droning electrical sounds emitting from the lights that suddenly stopped when the fluorescent bulbs dimmed, but the slithering sound from the hallway. Then, dead silence, so quiet he could hear...
Words: 2007 - Pages: 9
...By mid-October, I doubted much vibrant foliage would remain on the trees outside of the valley. My drive up to Piñon Mesa seemed to confirm this assumption. Dusty aspens, all completely barren, lined the dirt road leading to Turkey Flats, the trail I planned on hiking. Crows squawked overhead as they flew from pine tree to pine tree. Stepping outside at the trailhead, I looked down to see limp brown leaves and sparse tall grasses spreading across all of the ground I could see. However, as I started walking into the forest, the brown leaves on the ground gradually had a growing number yellow leaves amongst them like bold polka dots. I was shocked; the hills looked lifeless from the road that lead me there. Looking ahead among pines were aspens...
Words: 399 - Pages: 2
...Chapter 1 INTRODUCTION 1.1 Background of the Study It has been said that modeling the learner is the central aspect of intelligent tutoring systems. This realization spurred the development of student modeling systems or systems that diagnose student errors. These systems proved to be effective in areas like mathematics (subtraction, highschool algebra, differentiation) and computer programming (Pascal, Lisp,C++). The essential elements in constructing a student model are the background knowledge and the student behavior. The first component which is the background knowledge is difficult to acquire automatically and to extend, and in fact one of the major bottlenecks in the development of student modeling systems. The difficulty lies in constructing the bug library, which is the collection of common errors made by the students in a particular domain (Sison,1998). This implies that the background knowledge is a critical component in student modeling construction. Indeed, few systems are able to construct and extend bug libraries. The second component, which is the student behavior can be classified as simple and complex (Sison, 1998). Simple behavior involves classification and complex behavior involves problem solving task. Traditionally, in domains wherein the student behavior is simple (subtraction), student modeling systems used multiple behaviors as the primary input. This is known as synthetic student modeling. One drawback of this is that, the modeling system might construct...
Words: 17544 - Pages: 71
...ABSTRACT Trees are an important part of every community. Trees increase our quality of life by bringing natural elements and wildlife habitats into urban settings. Many neighborhoods are also the home of old trees that serve as historic landmarks. The tree observations goal is to help people maintain the health of their community and their state’s trees and forest. INTRODUCTION Trees have supported and sustained life throughout our existence. Different species display an endless variety of shapes and forms. In this experiment I had tested the ability to present information about factors affecting the health and measurements of trees. METHODS I used a Biltmore stick to measure the diameter (DBH) of the tree. I also had to find an area with at least twenty trees for measurements, recorded the information I obtain on a tree observation sheet. MATERIALS Biltmore stick, tree observation sheets, an area with twenty trees, pencil RESULTS The species of trees was from a neighborhood called Green Acres. Measurements taken at the site; shown that Maple/Boxelder trees in the site was identified as a more common species in the area and illustrated in good health with minor problems. For the other selected trees, no significant difference in circumference was found between all other trees because of the weather. DISCUSSION Overall the best time to measure trees is between June and September other observations can be made anytime during...
Words: 396 - Pages: 2
...Data Structures & Algorithms Coursework Assignment 1 Q1. (a) Algorithm swap(x, y): Node n head While (n.getNext () != x ) do n n.getNext() Node v y.getNext () n.setNext(y) y.setNext(x) x.setNext(v) (b) Algorithm swap Doubly(x, y): DNode n x.getPrev() DNode v y.getPrev() n.setNext(y) y.setPrev(n) y.setNext(x) x.setPrev(y) x.setNext(v) v.setPrev(x) (c) The run time complexity for the singled linked algorithm is O (n) and for the doubly linked algorithm is O (1). Doubly linked list has the best time complexity. Time complexity in singly linked list take more time because we have to move from head to the node before x Q2. (b) RedBlueStack implements Stack{ protected Object A[]; Int capacity; int top = -1; RedBlueStack(int cap) { A = new Object [capacity]; capacity = cap; } int size() { return (top + 1); } void push(Object obj) throws FullStackException { if (size() == capacity) throws new FullStackException("Stack is full."); A[++top] = obj; } Object top() throws EmptyStackException { if (isEmpty()) throws new EmptyStackException("Stack is empty."); return A[top]; } Boolean isEmpty() { return (top < 0); } Object top() throws EmptyStackException { if (isEmpty()) throws new EmptyStackException("Stack is empty."); return A[top]; } Object pop() throws EmptyStackException { Object elem; if (isEmpty()) throws new EmptyStackException("Stack...
Words: 551 - Pages: 3
...Solution: Number Of Nodes: 1. /* 2. * C Program to Find the Number of Nodes in a Binary Tree 3. */ 4. #include <stdio.h> 5. #include <stdlib.h> 6. 7. /* 8. * Structure of node 9. */ 10. struct btnode 11. { 12. int value; 13. struct btnode *l; 14. struct btnode *r; 15. }; 16. 17. void createbinary(); 18. void preorder(node *); 19. int count(node*); 20. node* add(int); 21. 22. typedef struct btnode node; 23. node *ptr, *root = NULL; 24. 25. int main() 26. { 27. int c; 28. 29. createbinary(); 30. preorder(root); 31. c = count(root); 32. printf("\nNumber of nodes in binary tree are:%d\n", c); 33. } 34. /* 35. * constructing the following binary tree 36. * 50 37. ...
Words: 1523 - Pages: 7
... Garry Jefferson hated his stay-at-home job. Day in and day out, he read and re-read essays written by illiterates hoping to scrape up a grade in his Psychology class. Fortunately, he never saw the acne pocked faces of the students he graded, and he could only imagine the facial horrors that roamed Blue River Community College’s halls. Blue River was a small town in central Colorado, inhabited by filthy rich old folk, and their grandchildren. The streets were clean, but the buildings that flanked the pavement were as dirty as could be. Inside the stone monoliths existed drug operations, brothels, cult gatherings, you name it. When the sun set is when the roles reversed, the filth being purged from their halls by police, and their hired mercenaries. This wasn’t a daily occurrence, maybe a bi-weekly one if things got heated between local gangs, but it was enough to create a tense atmosphere that lay in the air for all of time. Garry’s hand grew tired from typing at a maddening pace, correcting horrible grammatical errors, spelling errors and general un organization. He didn’t notice it at first, and when he did, panic began to set in. Sore hands slid from his keyboard as he slowly turned in his chair, and noticed the lights outside his office room were off. What he had noticed wasn’t the droning electrical sounds emitting from the lights that suddenly stopped when the fluorescent bulbs dimmed, but the slithering sound from the hallway. Then, dead silence, so quiet he could hear...
Words: 1347 - Pages: 6
...part of my childhood. This place is in the country in an old region named Appalachia, a small piece of the Appalachian Mountains, in a town named Pikeville. Pikeville is a polluted town because of the coal industry. People live in apartment or condominium buildings because of its little space available. I grew up in one of the many buildings in Pikeville admiring from my bedroom window the beauty of the mountains, always exploring with my eyes the forest or the meadows, looking for a clean and quiet place. And, I found one on a hill in the back of the town. It is about 100 feet square, it has seven old trees, wild flowers and a lot of bugs and ants during summer time. I used to go there to sit down on a rock and watch the town and my trees. There was a very old tree, a maple tree, with a huge trunk. The others were smaller, three in the back, three on my left side and the old maple tree on my right. There were flowers, many kinds, white, yellow, purple and blue. It was nobody's place. Nobody owned that hill, but it was beautiful and peaceful and I dreamed many times about a white house over there. I think that, these kinds of places are meaningful to people because they are natural and people can be there alone, away from their everyday life. I used to go there to be alone or to dream with my eyes open admiring the blue sky or the...
Words: 704 - Pages: 3
...Selection By Using Data mining Tseng Ling Chun (1155005610) Supervisor: Professor Chan Lai Wan Marker: Professor Xu Lei 1 Table of Contents Table of Contents………………………………………….…………………………………………………2 1. Introduction………………………………………….…………………………………………................4 1.1 Financial Portfolios.......................................................................................................4 1.2 Data Mining and Decision Trees………………………………………..................….4 1.3 Flow of Report……………………………………….....................................................….5 2. Classification and Regression Trees (CART) …………………………………..........……….6 2.1 Detailed description of CART……………………………………................................6 2.2 Tree Construction………………………………………..............................................….8 2.2.1 Application of Impurity Function in CART……………………...…...9 2.3 Splitting Rules…………........……………...………….………………………….......……11 3. Optimizing Size of Tree……………………………....………..................................................….12 3.1 Parameterization of Trees…………………………………...........................……….13 3.2 Cost – Complexity Function……………………………………....….........................14 3.3 V – Fold Cross – Validation……………………………………..........................…….15 4. Iterative Dichotomiser 3 (ID3) …………………………………....…..................................….18 4.1 Entropy and Information Gain……………....……………..................…………….19 5. Data Used…………………………………..................……….…………………………………………...
Words: 10967 - Pages: 44
