Tentamen (uitwerkingen)
Answers Exam questions Data Engineering
- Vak
- Data Engineering
- Instelling
- Universiteit Antwerpen (UA)
Answers Exam questions Data Engineering
[Meer zien]Voorbeeld 4 van de 65 pagina's
Voorbeeld 4 van de 65 pagina's
In winkelwagenGekoppeld boek
Titel boek:
Auteur(s):
- Uitgave:
- ISBN:
- Druk:
Voorbeeld van de inhoud
Exam Questions Data EngineeringExam Questions Data Engineering 1
Introduction and file formats 2
Computer architecture and operating systems 12
Networks 16
Regular expressions exercises 19
Cloud services 20
Linux 26
Algorithms 28
Data structures 32
Algorithm and datastructure exercises 37
Relational databases 39
Sql exercises 44
Data warehousing 45
Nosql 47
Visualization 50
Parallel and distributed computing 53
Map-Reduce 59
Map-Reduce exercises 61
Recommender systems 61
1
,Introduction and file formats
How are integer, decimal numbers, text and images stored in a computer? Give an
example of binary encoding for each type.
Computers works with bits or boolean values (0/1).
1) For integers:
First bit for the sign: 1 is negative, 0 is
positive. N bits for representing a number
between 0 and 2N -1.
2) For Decimal:
We get rid of the decimal point and store 2 integers: the exponent and
mantissa (Like scientific notation).
For example, the decimal number 3.14 can be encoded in binary as per the
IEEE 754 standard, resulting in a binary representation like
01000000010010001111010111000011.
3) For Text:
= Sequence of characters or string
Each character is encoded using a single byte using an encoding table.
Example: “Len” = [76, 101, 110] or 3 bytes. Check ASCII table for codes.
For example, the ASCII encoding of the letter 'A' is 65, which in binary is
01000001
4) For Images:
- Matrix of pixels.
- Each pixel represented by 3 numbers between 0 and 255 for red, green and
blue intensity.
- Thus: 4K image = 3840 x 2160 x 3 bytes = 2.4 MB
For example, the RGB encoding of a pixel with red = 255, green = 0, and
blue = 127 would be represented in binary as 11111111 00000000
01111111
2
,What is encoding and decoding? Explain and give an example.
1. Encoding (In-memory to On-file), serialization: Encoding is the process of converting
data from its in-memory representation into a format suitable for storage in files or
other persistent storage.
2. Decoding (On-file to In-memory) deserialization: Decoding is the reverse process of
encoding. It involves reading data from files or other persistent storage and
reconstructing the original in-memory data structures or objects.
It involves parsing or interpreting the stored data, extracting relevant information, and
reconstructing the appropriate data structures or objects.
During decoding, the stored data is read from the file and processed according to the
encoding scheme used.
We saw three different data models for representing data. Name and provide a short
summary of each data model.
The relational model:
- Consists of tables and rows (or tuples /records)
- Each column contains primitive value such as string, integer, float or date
- Two types of tables:
o Entities, i.e. Persons, groups, objects
o Relations between entities: i.e. Part-of, has-a, has-many, linked-to
o Each table can be saved as Comma-Seperated-Values (or CSV) file
Strengths Weaknesses
Structured Static and less flexible schema
Schema checking Joins = necessary evil (they are
complex)
Natural model
Flexible queries
3
, The document-oriented model:
- Consists of keys and documents, that is, each key is associated with one document
- Document is a tree containing:
o Primitive values
o Nested entities
o One-to-many relations
- Each document can be stored (and transferred) in JSON or XML
Strengths Weaknesses
Flexible No static schema checking
Natural model when data is tree- Less flexible queries: Document
structured with few intra structure reflects common
document relations operations
(E.g. text documents (with
chapters, sections paragraphs…))
Performance is good since no
joins
The graph-oriented model: Consists of nodes and edges
- A node is an instance of an entity and has a unique ID
- An edge is a relation between two nodes and has a unique ID
- A node and edge have named properties with a primitive value
Strengths Weaknesses
Flexible: schema easily changed No static schema checking
Natural model: social or Used less in industry (academic
geographic networks model)
Variable number of joins Used in domains where
everything is connected through
everything
4
Voordelen van het kopen van samenvattingen bij Stuvia op een rij:
√ Verzekerd van kwaliteit door reviews
Stuvia-klanten hebben meer dan 700.000 samenvattingen beoordeeld. Zo weet je zeker dat je de beste documenten koopt!
Snel en makkelijk kopen
Je betaalt supersnel en eenmalig met iDeal, Bancontact of creditcard voor de samenvatting. Zonder lidmaatschap.
Focus op de essentie
Samenvattingen worden geschreven voor en door anderen. Daarom zijn de samenvattingen altijd betrouwbaar en actueel. Zo kom je snel tot de kern!
Veelgestelde vragen
Wat krijg ik als ik dit document koop?
Je krijgt een PDF, die direct beschikbaar is na je aankoop. Het gekochte document is altijd, overal en oneindig toegankelijk via je profiel.
Tevredenheidsgarantie: hoe werkt dat?
Onze tevredenheidsgarantie zorgt ervoor dat je altijd een studiedocument vindt dat goed bij je past. Je vult een formulier in en onze klantenservice regelt de rest.
Van wie koop ik deze samenvatting?
Stuvia is een marktplaats, je koop dit document dus niet van ons, maar van verkoper PVE1. Stuvia faciliteert de betaling aan de verkoper.
Zit ik meteen vast aan een abonnement?
Nee, je koopt alleen deze samenvatting voor €7,49. Je zit daarna nergens aan vast.
Is Stuvia te vertrouwen?
4,6 sterren op Google & Trustpilot (+1000 reviews)
Afgelopen 30 dagen zijn er 75282 samenvattingen verkocht
Opgericht in 2010, al 15 jaar dé plek om samenvattingen te kopen