Hello, dear friend, you can consult us at any time if you have any questions, add WeChat: daixieit

School of Computing and Information Systems

COMP30027 Machine Learning, 2024 Semester 1

Project 1: Wine quality classification with K-NN

Data

The  data  for  this  assignment  is  a  modified  sub- set  of  the  “Wine  Quality”  dataset  from  the  UCI  Ma- chine  Learning  Repository   [1].     The  original  dataset can be found at https://archive.ics.uci.edu/ dataset/186/wine+quality. The dataset consists of 11 chemical properties for 2700 wine samples (e.g., pH, density, citric acid, alcohol). The class label for each sam- ple is quality, which has beencoded as a boolean vari- able (0 = low quality, 1 = high quality).

Separate training and test datasets are provided, with a 50/50 stratified train/test split.  Please use the provided train/test split for this assignment, unless a question asks you to create your own splits.

1. K-NN classifier [4 marks]

Figure 1: AI-generated image from sta- blediffusionweb.com

4. Model extensions [4 marks (individual) or 12 marks (group of 2)]

If you are working in a group of 1, answer 1 of the questions below for 4 marks. If you are working in a group of 2, answer 3 of the questions below for 12 marks. Each question response should be no more than 250 words and include figures and/or tables as appropriate.

1.  Compare the performance of your best 1-NN model from Question 3 to a Gaussian naıve Bayes(¨) model on this dataset (you may use library functions to implement the Gaussian naıve Bayes(¨) model).  In your write-up, state the accuracy of the na¨ıve Bayes model and identify instances where the two models disagree. Why do the two models classify these instances differently? [4 marks]

2.  Implement two additional distance measures for your K-NN model: cosine similarity and Ma- halanobis distance (you may use library functions for these distance measures). Do 1-NN clas- sification using each of these new distance measures and the three normalization options from Question 3. Discuss how the new distance metrics compare to Euclidean distance and explain how each metric is affected by normalization. [4 marks]

3.  Implement either of the two K-NN weighting strategies discussed in lecture (inverse linear distance or inverse distance).  Compare the performance of the weighted and majority vote models for a few different values of K. In your write-up, discuss how weighting strategy and the value of K affect the model’s decisions. [4 marks]

4.  Measure the empirical distribution of class labels in the training dataset (what percentage of the training data comes from each class). Then evaluate the distribution of labels predicted by your K-NN model for the test data, for a range of values for K. Does the class distribution of the predicted labels match the class distribution of the training data?  Explain why or why not. [4 marks]

Implementation tips

K-NN can be computationally expensive, so it’s a good idea to look for ways to make your code as efficient as possible. For example, doing matrix operations using numpy will generally be faster than doing operations with scalars in for loops.

Submission

Submission will be made via the LMS. Please submit your code and written report separately:

.      Your code submission should use the provided .ipynb notebook template.  Your submission must include comments or a README section that explain how to run your code so we can reproduce your results.

.  Your written report should be uploaded separately as a .pdf, using the Turnitin submission link.

If you are working in a group, please include both group members student id numbers on the written report and in your code file (in the README file or a group.txt file).

Late submission

The submission mechanism will stay open for one week after the submission deadline. Late submis- sions will be penalised at 10% per 24-hour period after the original deadline.  Submissions will be closed 7 days (168 hours) after the published assignment deadline, and no further submissions will be accepted after this point.

Assessment

4 of the marks available for this assignment will be based on the implementation of the K-NN classifier (Question 1); no write-up is required for this question.  The remaining questions (2-4) should be answered in a written .pdf report, and will be marked as indicated above.  We will be looking for evidence that you have a correct implementation that allows you to explore the problem, but also that you have thought deeply about the data and the behaviour of the relevant classifier(s).

Because the number of questions depends on the group size, individual projects can receive a total of 16 marks and group projects can receive a total of 24 marks.  In both cases, the project will contribute 20% of the final mark in this subject.  In group projects, both members of the group will receive the same mark.

Updates to the assignment specifications

If any changes or clarifications are made to the project specification, these will be posted on the LMS.

Academic misconduct

You are welcome — indeed encouraged — to collaborate with your peers in terms of the conceptual- isation and framing of the problem.  For example, we encourage you to discuss what the assignment specification is asking you to do, or what you would need to implement to be able to respond to a question.

However, sharing materials beyond your group — for example, plagiarising code or colluding in writing responses to questions — will be considered cheating. We will invoke University’s Academic Misconduct policy (http://academichonesty.unimelb.edu.au/policy.html) where inappropriate levels of plagiarism or collusion are deemed to have taken place.

References

[1] P. Cortez, A. Cerdeira, F. Almeida, T. Matos and J. Reis. Modeling wine preferences by data min- ing from physicochemical properties.  In Decision Support Systems, Elsevier, 47(4):547-553, 2009. ISSN: 0167-9236.