Data Engineering Project (5op)

Arviointiasteikko

H-5

Sisällön jaksotus

The course consists of an end-to-end data engineering project. We will use the concepts learnt on previous courses to work as a group to extract, pre-process, transform and load realtime data into a system. The data is AI-enriched and shared through different interfaces. The work is documented throughout the project and a data management plan is produced for long-term use.

Version control (Gitlab) will be used to manage the produced code and documents.

The project will be completed in roughly the following steps:
1. System high-level architecture
2. Data architecture design
3. Data management plan
3. ETL pipeline
4. Vessel movement prediction model
5. Visualizing data on a sea map
6. Visualizing predictions on the same map
7. Implementing API for querying collected enriched data
8. Finalizing documentation

Tavoitteet

After completing the course, the student can:
- run data engineering projects

Sisältö

Data Engineering pipeline in practice

Oppimateriaalit

Teacher provided lecture material
Supporting public online material
All needed material (or at least a link to them) will be available in itslearning.

Opetusmenetelmät

Project work as a group of 3 students.

Tenttien ajankohdat ja uusintamahdollisuudet

There's no exam.

Pedagogiset toimintatavat ja kestävä kehitys

Project-based-learning. Theory is introduced by the teacher during the contact lessons and then the students apply the theory to a given project. The project is there to support learning the concepts introduced on theory lessons.

Support for the project is available during the weekly contact classes.

Participation on the contact classes is obligatory. Attendance records will be collected.

Toteutuksen valinnaiset suoritustavat

Not applicable.

Opiskelijan ajankäyttö ja kuormitus

Contact hours 33 h
Independent studying 102h, including:
- Studying the theory
- Applying theory to the group work project

Arviointimenetelmät ja arvioinnin perusteet

Assessment is based on 0-100 scale of points.

Group work project is worth 78 points in total.

There are weekly reports each individual student makes to report the work they have done for the project during that week. These reports are worth 11 points in total.

Attendance on the weekly contact classes is worth 11 points in total.

Following conditions need to be met to pass the course:
>50% group work project points
>50% weekly report points
>50% attendance points

Hylätty (0)

< 50 total points
OR
< 6 points from weekly reports
OR
< 6 points from attendance
OR
< 39 points from the group work

Arviointikriteerit, tyydyttävä (1-2)

50-59 total points -> grade 1
60-69 total points -> grade 2

Arviointikriteerit, hyvä (3-4)

70-79 total points -> grade 3
80-89 total points -> grade 4

Arviointikriteerit, kiitettävä (5)

90-100 total points -> grade 5

Lisätiedot

Itslearning and contact classes are the main communication channels used on this course.

The student is required to have a computer capable of running a simple Ubuntu virtual machine and basic skills to work with Ubuntu command line.