Modelação e Gestão de Big Data

Objectives

The exponential growth in data production brought two major problems for traditional data storing systems. First, they have shown limitations to cope with the large volumes of data generated at a such rapid pace and under a reasonable price and resilience. Secondly, they offered challenges to both the computation of and the handling of non-structured data.

In the Big Data Modelling and Management (BDMM) curricular unit we will discuss the limitations of traditional storage systems, explore existing database solutions offered through distributed storage systems. We will cover the main data models present in NO-SQL databases and exemplify the type of applications each solution has been tailored to. Finally, we will look into more detail into Document based databases, in particular MongoDB, due to it's high and increasing popularity in big data systems. We look at how build, use, and optimise MongoDB databases.

Participation Requirements

It is strongly recommended that students have familiarity with Python programming language, Terminal/Shell commands, and SQL.

Classes will be delivered in English. As such students are expected to have a good level of comprehension and communication in English