
MEIC-A · Instituto Superior Técnico
Análise e Integração de Dados
Data Analysis and Integration
- 6 ECTS
- P1
- Exame: Obrigatório
Feedback
há 2 semanas
Theoretical Classes
Professor Paulo Carreira makes classes really enjoyable, he is pretty enthusiastic. I also felt like the slides were enough to study for the exam.
Regardless, there are notes in https://leicmybox.org/MEIC/1%C2%BA%20Semestre/AID/Resumos/ and in https://github.com/ana-mc-almeida/meic/tree/main/courses/dai.
Additionally, at least in Tagus, for half the quarter the theoretical classes would end way early, sometimes we would only have 40m classes whereas the class is supposed to be 2h (or 1h:40m) long, which is always nice.
Labs
The labs are VERY easy to follow...
há 3 meses
O projeto é um monte de tasks simples
O exame também se faz bem
As tasks é basicamente só seguir os guiões dados
há 11 meses
Unlike almost all the other courses, this one is super possible to follow, week after week, and you don't have to study that much to keep yourself up to date. The project and labs are easy, however I did struggle quite a lot with the exam (should have studied a bit every week) and managed to get a 12, which was fine for me. The subjects are somewhat interesting. I'd recommend going to the theoretical classes, even though the slides could be much more interesting and, as a recurring complaint I have about ist courses, things could be put under a much more practical and engaging lense, instead...
ano passado
One of the easiest and most enjoyable courses I've taken. No classes are mandatory, and it's very easy to follow along without attending any.
The theoretical classes are taught by professor Paulo Carreira. They were light and interactive.
The labs are to help you do the project and the lab assignments, which you can easily just do at home by following the very detailed step by step instructions that are given to you.
Project was very similar to the labs.
My only complaint is that there weren't many exam examples for us to study for the exam.
ano passado
Overall, this is a very straightforward and enjoyable course. If you’re into Data Science, it barely feels like work.
Theory
The theoretical classes aren’t essential if you already know the topics, but it’s worth attending at least the first ones to refresh your SQL basics, which you’ll definitely need later (both for regular queries and MDX).
The teacher, prof. Paulo Carreira, is excellent. He’s not your typical Técnico lecturer - he interacts a lot, explains clearly, and keeps a good pace. Even if you usually skip theory, try attending one or two of his classes. You’ll probably like...
ano passado
This is quite an interesting course and not too difficult.
The theoretical classes are good but I would not say they are a must go. Professor Paulo Carreira is always cheerful, a good teacher who explains the material well and sometimes gave us useful tips for the project.
The assessment is fairly simple: 15% comes from the lab assignments, which are very basic, you just need to take pictures of your work to prove you completed the exercises. The project, worth 35%, isn’t very interesting in my opinion. It’s one of those cases where you really need close guidance from the professor to avoid...
ano passado
Labs
Weekly labs (15% evaluation), easy to get a good grade since you can just follow the script and ask the teacher for help
Project
The project basically requires you to use concepts that you already went through in the labs, and some others that you may have not touched yet.
Even though the project was not that complicated, it was kind of confusing since details (sometimes vital) were kind of hidden or not clear, and the teacher from the lecture and lab gave contrary tips.
Lectures
It's notorious that the teacher likes to teach a lot and is passionate on giving classes...
há 11 meses
ano passado
ano passado
As avaliações abaixo deste ponto podem estar desatualizadas. O conteúdo, os métodos de ensino e os requisitos da cadeira podem ter mudado desde então.
há 5 anos
One of the easiest and least time-consuming courses I’ve taken at Técnico. It was also one of my favorites, though my preferences are quite different from most people in the course, so take that with a grain of salt.
Course overview
The first half of the course deals with Data Integration. Most of your work involves using graphical tools (mainly Pentaho Data Integration) to learn how to integrate data from heterogeneous sources (databases, XML, etc.) and load it into a Data Warehouse. You’ll also use the tool for tasks like string matching,...
Sobre a cadeira
Objetivos
Compreender e implementar processos de extração, transformação e carregamento de dados utilizando métodos e ferramentas de ponta. Estudar os diferentes tipos de arquitetura e opções de desenho para grandes data warehouses. Aplicar métodos e ferramentas de análise multidimensional sobre data warehouses.
Programa
Revisão de SQL. Processos e ferramentas de ETL. Fontes de dados e integração de dados. Correspondência e mapeamento de dados. Correspondência de cadeias de caracteres. Perfilagem e limpeza de dados. Deteção e remoção de duplicados. Data warehousing. Desenho lógico e físico para data warehouses. Processos de ETL para data warehouses. Análise multidimensional sobre data warehouses. Extensões da linguagem SQL e linguagem MDX. Ferramentas de reporting. Indicadores-chave de desempenho.
Pré-requisitos
Bases de Dados; SQL
Componente de Competências Transversais
Durante o desenvolvimento do projeto, os estudantes irão melhorar o seu pensamento crítico, as estratégias de resolução de problemas, o trabalho em equipa e as competências de comunicação interpessoal.
Componente Laboratorial
Serão disponibilizados guias de laboratório, juntamente com uma máquina virtual que contém todo o software e ferramentas necessários. Haverá um projeto sobre data warehousing e análise multidimensional.
Componente de Programação e Computação
Esta unidade curricular requer a implementação de processos de integração de dados e de data warehouses com recurso a ferramentas de programação específicas e software de integração de dados, garantindo as componentes de programação e computação necessárias.
Princípios Éticos
Todos os membros de um grupo são responsáveis pelo trabalho do grupo. Em qualquer avaliação, cada estudante deve divulgar honestamente qualquer ajuda recebida e as fontes utilizadas. Numa avaliação oral, cada estudante deve ser capaz de apresentar e responder a perguntas sobre todo o trabalho e a respetiva solução.
Traduzido automaticamente do inglês
Falta algo ou está desatualizado?
Avaliação
Nota Final = 40% Projeto + 60% Exame. Nota mínima de 9,5 em ambas as componentes. Avaliação por exame em casos especiais.
Traduzido automaticamente do inglês
A avaliação mudou ou falta alguma coisa?
Bibliografia
Bibliografia Principal
- Principles of Data Integration: Anhai Doan, Alon Halevy and Zachary Ives 2012 Morgan Kaufmann
- Data Warehouse Systems: Design and Implementation: Alejandro Vaisman and Esteban Zimányi 2014 Springer
- Data Warehouse Systems: Vaisman/Zimány 2022 Data Warehouse Systems, Vaisman/Zimányi, Springer (2022)
Falta algum livro ou material?