Hello, dear friend, you can consult us at any time if you have any questions, add WeChat: daixieit

Assessment Task 2: Data exploration and preparation

Due Thursday by 23:59
Points 100
Available 2Marat 10:00-5 Aprat 23:59
Submitting a file upload
Scenario

You have just started working as a data miner/analyst in the Analytics Unit of a company. The Head of the Analytics Unit has brought you a dataset [a welcome present;-))]. The dataset includes two files: a description of the attributes and a table with the actual values of these attributes. The Head of the Analytics Unit has mentioned to you that this is some sort of loan data that a potential client has provided for analysis. The Head of the Analytics Unit would like to have a report with some insights about the data, that he/she could deliver to the client. Your tasks include:

  • Understanding the specifics of the dataset;
  • Extracting information about each of the attributes, possible associations between them and other specifics of the dataset.
The tasks in the assignment are specifed below.
Tasks
A. Initial data exploration

A1. Identify the attribute type of each attribute in your dataset {age, income, credit-scor..... an_default} (nominal, ordinal, interval or ratio). If it's not clear, you may need to justify why you chose the type.

A2. Identify the values of the summarising properties for the attributes, including frequency, distributions, min,max, medians, means, variances, standard deviation, percentiles, etc. - the statistics that have been covered in the lectures and materials given. Note that not all of these summary statistics will make sense for all the attribute types, so use your judgement! Where necessary, use proper visualisations for the corresponding statistics.NOTE:

If there are missing values, demonstrate their impact on the summary statistics of the attributes.

A3.Using KNIME or other tools, explore your dataset and identify any outliers, clusters of similar instances, "interesting" attributes and specific values of those attributes. Note that you may need to 'temporarily' recode attributes to numeric or from numeric to nominal. The report includes the corresponding snapshots from the tools and an explanation of what has been identifed there. NOTE: If there are missing values, demonstrate their impact on the data exploration.

Present your findings in the assignment report.

Perform each of the following data preparation tasks (each task applies to the original data) using your choice of tool:
B. Data preprocessing

Perform each of the following data preparation tasks (each task applies to the original data) using your choice of tool:
B1. Use the following binning techniques to smooth the values of the "income" attribute:


  • Equi-width binning
  • Equi-depth binning.
In the assignment report, for each of these techniques, you need to illustrate your steps. In your Excel workbook file place the results in separate columns in the corresponding spreadsheet. Use your judgement in choosing the appropriate number of bins - and justify this in the report.


B2. Use the following techniques to normalise the attribute "loan_amount":

  • min-max normalization to transform the values onto the range[0.0-1.0).
  • z-score normalization to transform the values.

The assignment report provides an explanation of each of the applied techniques. In your Excel workbook file place the results in separate columns in the corresponding spreadsheet. B3. Discretise the "credit_score" attribute into the following categories: Very Good, Good,Fair,and Poor. Provide the frequency of each category in your dataset.

The assignment report explains each of the applied techniques. In your Excel workbook file, place the results in a separate column in the corresponding spreadsheet.

B4. Binarise the "region" variable [with values "0" or "1"].

The assignment report explains the applied binarisation technique. In your Excel workbook file place the results in separate columns in the corresponding spreadsheet.

C.Summary

At the end of the report include a summary section in which you summarise your findings. The summary is not a narrative of what you have done, but a condensed informative section of what you have found about the data that you should report to the Head of the Analytics Unit. The summary may include the most important findings (specific characteristics (or values) of some attributes, important information about the distributions, some clusters identified visually that you propose to examine, associations found that should be investigated morerigorously, etc.).

Datasets
For this dataset, you only have the attribute headings and a brief of what they mean, which you can find here: Assignment2-Dataset-Attribute-Description.pdf↓.Each student is assigned an individual dataset with the actual values of these attributes. You will find your individual dataset in this zip file: Assignment2-Individual- Dataset.zip上,with your student ID as the filename.


Deliverables
The deliveries are:


  • A report, for which the structure should follow the tasks of the assignment
  • An Excel workbook file with individual spreadsheets for each task (spreadsheets should be labelled according to the task names, for example, "B"). Each of the results of parts (B1) through (B4) in task B should bepresented in a separate spreadsheet (and respectively table in the assignment report).
  • A Knime workflow (ida_xooc.knwf) or Python notebook (ida_xoox.ipynb) .


In the report, include a section (starting with a section title) for each of the tasks in the assignment.

Assessment Weight

This assignment is assessed as individual work. This report contributes 35%, marked out of 100 of your final mark.

Marking Criteria

Your assignment will be assessed according to the Assignment2-Marking.Criteria.pdf↓

Length

The task requires a report of about 20 pages with the information and sections described above. Use 11 or 12 point Times or Arial fonts.

Submission format

Submit a report in AdobePDF(preferable) or MS Word Doc with Filename ida_a2_xxx.pdf or ida_a2_xox.doc and an Excel workbook with ida_a2_xxx.xls, where xoox is your student id.

Submit to

The task requires a report of about 20 pages with the information and sections described above. Use11 or 12point Times or Arial fonts.
UTS Canvas assignment submission button.

Submission format

Submit a report in AdobePDF (preferable) or MS Word Doc with Filename ida_a2_xxxx.pdf or ida_a2_xoox.doc and  an Excel workbook with ida_a2_xxx.xls, where xox is your student id.

Submit to

UTS Canvas assignment submission button.

Due Date

11.59 pm Thursday, 02 Apr.2026.

Feedback

We plan to retur marked assignments within 2-3 weeks of submission. Feedback on the report will be given only to students requesting it. Emails will be sent when marking is complete.

Relationship to objectives

This assessment task addresses the following subject learning objectives (SLOs): 3, 4, 5 and 6.
This assessment task contributes to the development of the following course intended learning outcomes (CILOs):A.1,B.1,B.2,B.3 and E.1.

Academic Integrity
Please refer toAcademic Support.