### Order Description

Overview

This project consists of two tasks. The goal is to apply what we have learned to solve real problems in Data Science. Glance at “What to Submit” when you start working on a task so that you know what information to provide from each task.

Submission Example

What to Submit

1. One doc file “csci333-project-XX.doc” including the text source code and screenshots of the outputs of all programs. Please replace XX with your first name and last name. You can copy/paste the text source code from Pycharm or other IDEs into the doc file. Hopefully, based on the screen snapshots of the output, you can show that your programs passed tests and were well.
2. Python files for all programs. In well-defined programs, proper comments are required. For programs without comments, they will be deducted greatly in grade.
3. Note that if any program or code does not work, you can explain the status of the program or code and then attach your explanation and description in a file “README.txt”.
4. Optional. Anything you want to attract the attention.

Task 1 (50 points): (Intro to Data Science: Survey Response Statistics) Twenty students were asked to rate on a scale of 1 to 5 the quality of the food in the student cafeteria, with 1 being “awful” and 5 being “excellent”. Place the 20 responses in a list.

1, 2, 5, 4, 3, 5, 2, 1, 3, 3, 1, 4, 3, 3, 3, 2, 3, 3, 2, 5

Write a program that does the following:

(a) Determine and display the frequency of each rating.

(b)Usethebuilt-infunctions,statisticsmodulefunctionsandNumPy orPandafunctionscov- ered in the course materials to display the following response statistics: minimum, maximum, range, mean, median, variance and standard deviation.

(c) Display a bar chart showing the response frequencies and their percentages of the total responses.

– 10 points for defining functions.  – 15 points for finishing Task1(a)-(c).  – 5 points for appropriate comments.  – 10 points for a runnable python program with correct data visualization. – 10 points for screenshots of the program.

Task 2 (50 points): (Classification with k-Nearest Neighbors and the Digits Dataset) Read the file “09-02-MachineLearning.pdf” and the python program “CaseStudy1.py” to learn the algorithm of k-Nearest Neighbors with the Digits dataset for recognizing handwritten digits.

Re-write the python program by doing the following subtasks:

(a) Write code to display the two-dimensional array representing the sample image at index 24 and numeric value of the digit the image represents.

(b) Write code to display the image for the sample image at index 24 of the Digits dataset.

(c) For the Digits dataset, what numbers of samples would the following statement reserve for training and testing purposes?

(d) Write code to get and display these numbers.

(e) Rewrite the list comprehension in snippet [50] using a for loop. Hint: create an empty list and then use the built-in function “append”.

– 15 points for finishing Task2(a)-(e).  – 5 points for appropriate comments.  – 20 points for a runnable rewritten python program – 10 points for screenshots of the program.

Challenges in This Project

1. For 10% extra credit, you are welcome to explore the design of each task. Note: You still have to finish all tasks required by this project.

2. You should configure your machine and PyCharm properly to facilitate the project develop- ment.