Data Preparation for Data Analysis, Part 2Training

by Matthias Täschner

Thursday Jun 1, 2023, 1:00 PM → 4:00 PM Europe/Berlin

online (Data Science Center ScaDS.AI Dresden/Leipzig)

The term Data Analysis or Data Mining describes the systematic application of statistical methods to identify structures, dependencies, and relationships in sometimes very large data sets and to gain new knowledge, where computer-aided methods are used in the individual process steps. The content and scope of the respective steps depend, among other things, on the problem domain, the analysis goal, and other technical aspects like the available data sources or the representation of the data. A relevant process step is the preprocessing of these data (data preparation) to increase their quality for the subsequent analysis. 

In this part of the training, the detection and handling of outliers, the imputation of missing values as well as a final comparison of the analysis results based on different variants of preprocessing will be covered.

---

Agenda

• Introduction to general aspects of Data Mining and the process of data preparation (10%)
• Hands-on tutorial on data preparation with focus on outlier detection and handling, imputation of missing values and comparison of preprocessing steps (90%)

Handouts

The following documents (slides, sample applications) will be provided to the participants:

• PDF of the slides for “Introduction to Data Mining and data preparation"
• CSV file (world bank data on development and health indicators)
• Jupyter Notebooks on data preparation with tasks and solutions

Prerequisites

• Participants should have at least intermediate up to advanced knowledge in Python 3.x
• Basic knowledge on how to use Jupyter Notebooks
• Basic knowledge of the Python packages NumPy and Pandas recommended
• Laptop with internet access - equipment can be provided on site if required (please enquire as numbers are limited)

Learning Outcomes: After the training, participants will be familiar with theoretical considerations and practical approaches to data preparation using Python with NumPy, Pandas and other packages.

Course language: English/German

Target group: Anyone regularly working with data and an interest in learning about various data preprocessing steps to improve analysis results.