An upstream source writes Parquet data as hourly batches to directories named with the current date. A nightly batch job runs the following code to ingest all data from the previous day as indicated by the date variable:

Assume that the fields customer_id and order_id serve as a composite key to uniquely identify each order.
If the upstream system is known to occasionally produce duplicate entries for a single order hours apart, which statement is correct?

• A. Each write to the orders table will run deduplication over the union of new and existing records, ensuring no duplicate records are present.
• B. Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, the operation will tail.
• C. Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, these records will be overwritten.
• D. Each write to the orders table will only contain unique records, and only those records without duplicates in the target table will be written.
• E. Each write to the orders table will only contain unique records, but newly written records may have duplicates already present in the target table.

Explanation: Only visible for PassLeaderVCE members. You can sign-up / login (it's free).

While reviewing a query's execution in the Databricks Query Profiler, a data engineer observes that the Top Operators panel shows a Sort operator with high Time Spent and Memory Peak metrics. The Spark UI also reports frequent data spilling. How should the data engineer address this issue?

• A. Repartition the DataFrame to a single partition before sorting.
• B. Increase the number of shuffle partitions to better distribute data.
• C. Convert the sort operation to a filter operation.
• D. Switch to a broadcast join to reduce memory usage.

Explanation: Only visible for PassLeaderVCE members. You can sign-up / login (it's free).

The data architect has decided that once data has been ingested from external sources into the Databricks Lakehouse, table access controls will be leveraged to manage permissions for all production tables and views.
The following logic was executed to grant privileges for interactive queries on a production database to the core engineering group.
GRANT USAGE ON DATABASE prod TO eng;
GRANT SELECT ON DATABASE prod TO eng;
Assuming these are the only privileges that have been granted to the eng group and that these users are not workspace administrators, which statement describes their privileges?

• A. Group members are able to list all tables in the prod database but are not able to see the results of any queries on those tables.
• B. Group members are able to query and modify all tables and views in the prod database, but cannot create new tables or views.
• C. Group members are able to query all tables and views in the prod database, but cannot create or edit anything in the database.
• D. Group members are able to create, query, and modify all tables and views in the prod database, but cannot define custom functions.
• E. Group members have full permissions on the prod database and can also assign permissions to other users or groups.

Explanation: Only visible for PassLeaderVCE members. You can sign-up / login (it's free).

A data engineer has created a new cluster using shared access mode with default configurations.
The data engineer needs to allow the development team access to view the driver logs if needed.
What are the minimal cluster permissions that allow the development team to accomplish this?

• A. CAN VIEW
• B. CAN MANAGE
• C. CAN RESTART
• D. CAN ATTACH TO

Explanation: Only visible for PassLeaderVCE members. You can sign-up / login (it's free).

The data governance team is reviewing user for deleting records for compliance with GDPR. The following logic has been implemented to propagate deleted requests from the user_lookup table to the user aggregate table.

Assuming that user_id is a unique identifying key and that all users have requested deletion have been removed from the user_lookup table, which statement describes whether successfully executing the above logic guarantees that the records to be deleted from the user_aggregates table are no longer accessible and why?

• A. Yes; Delta Lake ACID guarantees provide assurance that the DELETE command successed fully and permanently purged these records.
• B. No; the change data feed only tracks inserts and updates not deleted records.
• C. No; the Delta Lake DELETE command only provides ACID guarantees when combined with the MERGE INTO command
• D. No; files containing deleted records may still be accessible with time travel until a BACUM command is used to remove invalidated data files.
• E. Yes; the change data feed uses foreign keys to ensure delete consistency throughout the Lakehouse.

Explanation: Only visible for PassLeaderVCE members. You can sign-up / login (it's free).