Download Databricks Data Engineering Associate Exam 2024 and more Exams Nursing in PDF only on Docsity!
Question 1 Which of the following describes a benefit of a data lakehouse that is unavailable in a traditional data warehouse? A. A data lakehouse provides a relational system of data management. B. A data lakehouse captures snapshots of data for version control purposes. C. A data lakehouse couples storage and compute for complete control. D. A data lakehouse utilizes proprietary storage formats for data. E. A data lakehouse enables both batch and streaming analytics. - correct answer ✅E. A data lakehouse enables both batch and streaming analytics. Question 2 Which of the following locations hosts the driver and worker nodes of a Databricks-managed cluster? A. Data plane B. Control plane C. Databricks Filesystem D. JDBC data source E. Databricks web application - correct answer ✅A. Data plane
Question 3 A data architect is designing a data model that works for both video-based machine learning workloads and highly audited batch ETL/ELT workloads. Which of the following describes how using a data lakehouse can help the data architect meet the needs of both workloads? A. A data lakehouse requires very little data modeling. B. A data lakehouse combines compute and storage for simple governance. C. A data lakehouse provides autoscaling for compute clusters. D. A data lakehouse stores unstructured data and is ACID-compliant. E. A data lakehouse fully exists in the cloud. - correct answer ✅D. A data lakehouse stores unstructured data and is ACID-compliant. Question 4 Which of the following describes a scenario in which a data engineer will want to use a Job cluster instead of an all-purpose cluster? A. An ad-hoc analytics report needs to be developed while minimizing compute costs. B. A data team needs to collaborate on the development of a machine learning model. C. An automated workflow needs to be run every 30 minutes.
the same notebook simultaneously. A senior data engineer experienced in Databricks suggests there is a better alternative for this type of collaboration. Which of the following supports the senior data engineer's claim? A. Databricks Notebooks support automatic change-tracking and versioning B. Databricks Notebooks support real-time coauthoring on a single notebook C. Databricks Notebooks support commenting and notification comments D. Databricks Notebooks support the use of multiple languages in the same notebook E. Databricks Notebooks support the creation of interactive data visualizations - correct answer ✅B. Databricks Notebooks support real-time coauthoring on a single notebook Question 7 Which of the following describes how Databricks Repos can help facilitate CI/CD workflows on the Databricks Lakehouse Platform? A. Databricks Repos can facilitate the pull request, review, and approval process before merging branches B. Databricks Repos can merge changes from a secondary Git branch into a main Git branch
C. Databricks Repos can be used to design, develop, and trigger Git automation pipelines D. Databricks Repos can store the single-source-of-truth Git repository E. Databricks Repos can commit or push code changes to trigger a CI/CD process - correct answer ✅E. Databricks Repos can commit or push code changes to trigger a CI/CD process Question 8 Which of the following statements describes Delta Lake? A. Delta Lake is an open source analytics engine used for big data workloads. B. Delta Lake is an open format storage layer that delivers reliability, security, and performance. C. Delta Lake is an open source platform to help manage the complete machine learning lifecycle. D. Delta Lake is an open source data storage format for distributed data. E. Delta Lake is an open format storage layer that processes data. - correct answer ✅B. Delta Lake is an open format storage layer that delivers reliability, security, and performance. Question 9
id STRING, birthDate DATE, avgRating FLOAT ) D. CREATE TABLE table_name AS SELECT id STRING, birthDate DATE, avgRating FLOAT E. CREATE OR REPLACE TABLE table_name WITH COLUMNS ( id STRING, birthDate DATE, avgRating FLOAT ) USING DELTA - correct answer ✅B. CREATE OR REPLACE TABLE table_name ( id STRING, birthDate DATE, avgRating FLOAT )
Question 10 Which of the following SQL keywords can be used to append new rows to an existing Delta table? A. UPDATE B. COPY C. INSERT INTO D. DELETE E. UNION - correct answer ✅C. INSERT INTO Question 11 A data engineering team needs to query a Delta table to extract rows that all meet the same condition. However, the team has noticed that the query is running slowly. The team has already tuned the size of the data files. Upon investigating, the team has concluded that the rows meeting the condition are sparsely located throughout each of the data files. Based on the scenario, which of the following optimization techniques could speed up the query? A. Data skipping B. Z-Ordering C. Bin-packing
A junior data engineer needs to create a Spark SQL table my_table for which Spark manages both the data and the metadata. The metadata and data should also be stored in the Databricks Filesystem (DBFS). Which of the following commands should a senior data engineer share with the junior data engineer to complete this task? A. CREATE TABLE my_table (id STRING, value STRING) USING org.apache.spark.sql.parquet OPTIONS (PATH "storage-path"); B. CREATE MANAGED TABLE my_table (id STRING, value STRING) USING org.apache.spark.sql.parquet OPTIONS (PATH "storage-path"); C. CREATE MANAGED TABLE my_table (id STRING, value STRING); D. CREATE TABLE my_table (id STRING, value STRING) USING DBFS; E. CREATE TABLE my_table (id STRING, value STRING); - correct answer ✅E. CREATE TABLE my_table (id STRING, value STRING); Question 14 A data engineer wants to create a relational object by pulling data from two tables. The relational object must be used by other data engineers in other sessions. In order to save on storage costs, the data engineer wants to avoid copying and storing physical data. Which of the following relational objects should the data engineer create?
A. View B. Temporary view C. Delta Table D. Database E. Spark SQL Table - correct answer ✅A. View Question 15 A data engineering team has created a series of tables using Parquet data stored in an external system. The team is noticing that after appending new rows to the data in the external system, their queries within Databricks are not returning the new rows. They identify the caching of the previous data as the cause of this issue. Which of the following approaches will ensure that the data returned by queries is always up-to-date? A. The tables should be converted to the Delta format B. The tables should be stored in a cloud-based external system C. The tables should be refreshed in the writing cluster before the next query is run D. The tables should be altered to include metadata to not cache
B. CREATE TABLE AS SELECT statements adopt schema details from the source C. CREATE TABLE AS SELECT statements result in tables where schemas are optional. D. CREATE TABLE AS SELECT statements assign all columns the type STRING. E. CREATE TABLE AS SELECT statements result in tables that do not support schemas. - correct answer ✅A. CREATE TABLE AS SELECT statements adopt schema details from the source table and query. Question 17 A data engineer is overwriting data in a table by deleting the table and recreating the table. Another data engineer suggests that this is inefficient and the table should simply be overwritten instead. Which of the following reasons to overwrite the table instead of deleting and recreating the table is incorrect? A. Overwriting a table is efficient because no files need to be deleted. B. Overwriting a table results in a clean table history for logging and audit purposes. C. Overwriting a table maintains the old version of the table for Time Travel.
D. Overwriting a table is an atomic operation and will not leave the table in an unfinished state. E. Overwriting a table allows for concurrent queries to be completed while in progress. - correct answer ✅B. Overwriting a table results in a clean table history for logging and audit purposes. Question 18 Which of the following commands will return records from an existing Delta table my_table where duplicates have been removed? A. DROP DUPLICATES FROM my_table; B. SELECT * FROM my_table WHERE duplicate = False; C. SELECT DISTINCT * FROM my_table; D. MERGE INTO my_table a USING new_records b ON a.id = b.id WHEN NOT MATCHED THEN INSERT *; E. MERGE INTO my_table a USING new_records b; - correct answer ✅C. SELECT DISTINCT * FROM my_table; Question 19
Which of the following commands should the junior data engineer run to complete this task? A. SELECT cart_id, filter(items) AS item_id FROM raw_table; B. SELECT cart_id, flatten(items) AS item_id FROM raw_table; C. SELECT cart_id, reduce(items) AS item_id FROM raw_table; D. SELECT cart_id, explode(items) AS item_id FROM raw_table; E. SELECT cart_id, slice(items) AS item_id FROM raw_table; - correct answer ✅D. SELECT cart_id, explode(items) AS item_id FROM raw_table; Question 21 A data engineer has ingested a JSON file into a table raw_table with the following schema: transaction_id STRING, payload ARRAY<customer_id:STRING, date:TIMESTAMP, store_id:STRING> The data engineer wants to efficiently extract the date of each transaction into a table with the following schema: transaction_id STRING, date TIMESTAMP Which of the following commands should the data engineer run to complete this task? A. SELECT transaction_id, explode(payload) FROM raw_table;
B. SELECT transaction_id, payload.date FROM raw_table; C. SELECT transaction_id, date FROM raw_table; D. SELECT transaction_id, payload[date] FROM raw_table; E. SELECT transaction_id, date from payload FROM raw_table; - correct answer ✅B. SELECT transaction_id, payload.date FROM raw_table; Question 22 A data analyst has provided a data engineering team with the following Spark SQL query: SELECT district, avg(sales) FROM store_sales_20220101 GROUP BY district; The data analyst would like the data engineering team to run this query every day. The date at the end of the table name (20220101) should automatically be replaced with the current date each time the query is run. Which of the following approaches could be used by the data engineering team to efficiently automate this process? A. They could wrap the query using PySpark and use Python's string variable system to automatically update the table name. B. They could manually replace the date within the table name with the current day's date.
Question 24 A data engineer needs to dynamically create a table name string using three Python variables: region, store, and year. An example of a table name is below when region = "nyc", store = "100", and year = "2021": nyc100_sales_ Which of the following commands should the data engineer use to construct the table name in Python? A. "{region}+{store}+sales+{year}" B. f"{region}+{store}+sales+{year}" C. "{region}{store}sales{year}" D. f"{region}{store}sales{year}" E. {region}+{store}+"sales"+{year} - correct answer ✅D. f"{region} {store}sales{year}" Question 25 A data engineer has developed a code block to perform a streaming read on a data source. The code block is below: (spark .read .schema(schema)
.format("cloudFiles") .option("cloudFiles.format", "json") .load(dataSource) ) The code block is returning an error. Which of the following changes should be made to the code block to configure the block to successfully perform a streaming read? A. The .read line should be replaced with .readStream. B. A new .stream line should be added after the .read line. C. The .format("cloudFiles") line should be replaced with .format("stream"). D. A new .stream line should be added after the spark line. E. A new .stream line should be added after the .load(dataSource) line. - correct answer ✅A. The .read line should be replaced with .readStream. Question 26 A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table. The code block used by the data engineer is below: (spark.table("sales")
