Hello, dear friend, you can consult us at any time if you have any questions, add WeChat: daixieit

ELEC9741 - Electrical Engineering Data Science

Part II

Exam, 2023

μℎ = {100mm, standaTd cylindeT

          102mm, affected cylindeT

μd  = {40mm, standaTd cylindeT

           41mm, affected cylindeT

μw  = {1000g, standaTd cylindeT

           1010g, affected cylindeT

b.    The quality assurance team does not know how many factories are producing affected cylinders, but they suspect it might be one or two. Give the equations for the optimal decision surface for both assumptions  (one  factory  is  producing  affected  cylinders,  two  factories  are  producing  affected cylinders) and based on this, provide a classification rule of the form

̂(y) = {affe(stan)c(d)ted cylindeT(aTd cylindeT)         f(f)x(x) 0(0)

where, x = [xℎ, xd, x w]T  isa vector of measurements. (i.e., give an expression for f(x)). [3 marks]

c.    Implement a suitable simulation (of the measured data) in  MATLAB and use it to demonstrate that your classification rule works. [5 marks]

2. Machine Learning Pipeline (25 marks)

You have been provided with the health records of 58,976 patients who were admitted to critical care units (CCU). Each patient's record is represented by 16 numerical values and stored in a CSV file called " MedicalRecords.csv" (You can download this from the course webpage). The first line of the file contains the header, while the subsequent lines hold individual patient records separated by commas.

Among the  16 numerical values, "LOSdays" represents the number of days each patient stayed in the CCU, from admission to discharge. The other 15 values represent the daily average counts of various medical events, such as callouts, diagnoses,  procedures,  CPT events,  input  events,  labs,  microbiology  labs,  notes,  output  events,  medical prescriptions, procedural events, transfers between care units, chart events, and the summary of all the daily averages.

Part1: Regression Problem

Your task is to design a machine-learning pipeline for regression to predict the number of days a patient is expected to stay in the CCU (LOSdays) based on the other 15 values.

a.    Design and implement the pipeline. You may use the following steps as a guideline:

Prepare your data for the model training. Define your target and features and split the data into training and testing subsets.

Chose the appropriate regression model to train: You may select any regression model, such as Linear Regression, Support Vector Regression, Random Forest Regression, etc. You can utilize MATLAB built-in functions for these models. Use the training subset in the training of the model.

Chose the appropriate evaluation metric(s) for the task and evaluate the performance of your trained model on the test subset. Note that you are expected to implement them with your own code. The use of MATLAB built-in functions for evaluation metrics is not allowed. [10 marks]

b.    Compute the mean, median, standard deviation, minimum, and maximum of all features. What do you observe? [1 mark]

c.    Based on the statistics computed in (b), is a feature normalisation step needed? Justify your answer. [1 mark]

d.    Train and evaluate the model with and without feature normalisation step. Analyze the influence on performance. [1 mark]

e.    Compute the correlation between each input feature and the target output (LOSdays). What do you observe? Note: use your own code to compute the correlation. using MATLAB’s built-in functions is not allowed. [1 mark]

f.     Based on the correlation values computed in (e), reduce the dimension of features (number of

features) to 10, 4, and 2. Retrain the model for each feature size and compare the performance. What do you observe? [1 mark]

Part 2: Classification Problem

In this part, your objective is to design a machine-learning pipeline for classification to predict whether a patient will have a long, medium, or short stay based on the 15 numerical values used in Part 1.

The duration classifications are defined as follows:

Short period: When the patient is expected to stay for less than 6 days.

Medium period: When the patient is expected to stay for 6 days or more but less than 12 days. Long period: When the patient is expected to stay for 12 days or more.

g.   Prepare your data for the classification task and replace the regression model from Part 1 with a

classification model, utilizing any suitable method like Logistic Regression, Support Vector Machine classifier, Random Forest classifier, etc. You can use MATLAB's built-in functions for training the classification model. [5 marks]

h.   Justify whether the same training/testing split used in Part 1 is valid for training the classification model. If not re-split the data appropriately.[1 mark]

i.    Determine whether the evaluation metric used in Part 1 is still valid for assessing the classification model. If not, suggest and implement other evaluation metrics. [1 mark]

j.    Perform binary classification of patients who are expected to stay only one day or less and patients who are expected to stay more than one day. Re-split the data into training/testing, retrain the model, and compute the model's performance. [1 mark]

k.    Compute the confusion matrix of the test set for the binary model in (j). How many samples there for each class? Analyse the observations. [1 mark]

l.     For the system in (j). Compute accuracy, balanced accuracy, and F1. Which metric you would use to report the system performance in this case? Justify your answer. [1 mark]