Hadoop and spark - Study guides, Class notes & Summaries

MIS 400 Midterm Exam - Questions and Answers A large storage location that can hold vast quantities of data (mostly unstructured) in its native/raw format for future/potential analytics consumption is referred to as a(n) data lake. data cloud. extended ASP. relational database. How does the use of cloud computing affect the scalability of a data warehouse? Cloud vendors are mostly based overseas where the cost of labor is low. Cloud computing has little effect on a data warehouse's scalability...

Google App Engine - correct answer enables you to build and host applications on the same systems that power Google applications. App Engine offers fast development and deployment; simple administration, with no need to worry about hardware, patches or backups; and effortless scalability. Google BigQuery Service - correct answer is a fully managed data analysis service that enables businesses to analyze Big Data. It features highly scalable data storage that accommodates up to hundr...

GOOGLE CLOUD ARCHITECT NOTES EXAM QUESTIONS AND ANSWERS When to use gsutil, storage service or transfer appliance - Answer-<1TB gsutil, 1-20 TB Transfer service, >20Tb or >1 week Transfer Appliance when to use firestore vs Bigtable ? (size) - Answer-<10TB Firestore, >10TB Bigtable BigTable - Answer-HBASE API compatible how to export data from Bigtable - Answer-Use a Java applications or HBASE commands is Bigtable serverless? - Answer-No Stream processing framewor...

1. Instance templates are used to create a group of identical VMs. The instance templates include: A. Machine type, boot disk image or container image, zone, and labels B. Cloud Storage bucket definitions C. A load balancer description D. App Engine configuration file -ANSWER A. Machine type, boot disk image or container image, zone, and labels are all configuration parameters or attributes of a VM and therefore would be included in an instance group configuration that creates those VMs....

HADOOP 444 bigdata 8 Apache Hive 603 - University of Maryland, Baltimore Draw an architectural diagram of Hive with Hadoop and Spark? Show all components. What is the Hive SerDe interface for IO? What is it used for? Describe its benefits? What is the difference between Hive managed tables and external tables? Give examples? Let's look at the fundamental differences between hive internal and external tables now that we've covered the foundations of Hive tables in Hive Data Models. The DESCRIBE...

Hortonworks - answer-HDP is a powerful platform for managing big data at rest. HDP attributes - answer-open source Central Interoperable ممكن اشغل كذا فيرجن من كذا مكان مع بعض Enterprise-readyفي حد ما مسؤل عنه عشان لو حصل مشاكل هي المسؤله عن تصاليحها Data at rest - answer-Data that is stored physically in any digital form (for example, in databases, data warehouses, spreadsheets, archives, tapes, off-site backup...

AWS DMS - Answer AWS Database Migration Service - helps migrate databases AWS easily and securely Amazon Route 53 - Answer highly available and scalable DNS (Domain Name System) web service Queries for your domain are automatically routed to closest DNS server (around world) you use it register a new domain name in the AWS platform offers health checks to monitor the health and performance of your application as well as your web servers and other resources Amazon VPC - Answer allows you...

What three main types of workload can be found in a typical modern data warehouse? - Streaming Data - Batch Data - Relational Data A ____________________ is a continuous flow of information, where continuous does not necessarily mean regular or constant. data stream __________________________ focuses on moving and transforming data at rest. Batch processing This data is usually well organized and easy to understand. Data stored in relational databases is an example, whe...

Azure Microsoft's cloud computing platform Cloud Computing The delivery of computing services over the Internet using a pay-as-you-go pricing model. Infrastructure as a Service Instead of maintaining CPU's, Memory and Storage in your data center, you rent them for the time that you need them. The cloud provider takes care of maintaining the underlying infrastructure for you. Platform as a Service A complete development and deployment environment in the cloud, with reso...

What are some of the data sources you can use in PBI? Flat files & Folders (csv, text, excel, json, etc). Databases (SQL Access, Oracle, IBM, MySql, etc.). Power Platform (Dataflows, Power BI Datasets, Datavers3, etc). Azure (SQL Db, Blob Storage, Cosmos DB, Data Lake Storage, etc). Online Services (Sharepoint, Github, Dynamics 365, Google Analytics, Salesforce, etc). Others (web feeds, R scripts, Spark, Hadoop, etc.). What let's you shape and transform data? Query editor What is Po...