# ![@easewithdata Avatar](https://lunarcrush.com/gi/w:26/cr:youtube::UCadVGkh-CrparnJIgmv5Iuw.png) @easewithdata Ease With Data

Ease With Data posts on YouTube about what is, databricks, deep, how to the most. They currently have [------] followers and [--] posts still getting attention that total [-----] engagements in the last [--] hours.

### Engagements: [-----] [#](/creator/youtube::UCadVGkh-CrparnJIgmv5Iuw/interactions)
![Engagements Line Chart](https://lunarcrush.com/gi/w:600/cr:youtube::UCadVGkh-CrparnJIgmv5Iuw/c:line/m:interactions.svg)

- [--] Week [------] +40%
- [--] Month [-------] +37%
- [--] Months [-------] +24%
- [--] Year [---------] +171%

### Mentions: [--] [#](/creator/youtube::UCadVGkh-CrparnJIgmv5Iuw/posts_active)
![Mentions Line Chart](https://lunarcrush.com/gi/w:600/cr:youtube::UCadVGkh-CrparnJIgmv5Iuw/c:line/m:posts_active.svg)

- [--] Week [--] +190%
- [--] Month [--] +173%
- [--] Months [--] +61%
- [--] Year [--] +80%

### Followers: [------] [#](/creator/youtube::UCadVGkh-CrparnJIgmv5Iuw/followers)
![Followers Line Chart](https://lunarcrush.com/gi/w:600/cr:youtube::UCadVGkh-CrparnJIgmv5Iuw/c:line/m:followers.svg)

- [--] Week [------] +1.80%
- [--] Month [------] +10%
- [--] Months [------] +73%
- [--] Year [------] +239%

### CreatorRank: [-------] [#](/creator/youtube::UCadVGkh-CrparnJIgmv5Iuw/influencer_rank)
![CreatorRank Line Chart](https://lunarcrush.com/gi/w:600/cr:youtube::UCadVGkh-CrparnJIgmv5Iuw/c:line/m:influencer_rank.svg)

### Social Influence

**Social category influence**
[technology brands](/list/technology-brands)  67.9% [social networks](/list/social-networks)  2.47% [finance](/list/finance)  2.47%

**Social topic influence**
[what is](/topic/what-is) #1848, [databricks](/topic/databricks) #5, [deep](/topic/deep) #2646, [how to](/topic/how-to) 20.99%, [what are](/topic/what-are) #899, [azure](/topic/azure) #233, [level](/topic/level) 11.11%, [science](/topic/science) #4575, [command](/topic/command) #871, [alerts](/topic/alerts) #606

**Top accounts mentioned or mentioned by**
[@easewithdataplaylists](/creator/undefined)
### Top Social Posts
Top posts by engagements in the last [--] hours

"02 How Spark Works - Driver & Executors How Spark divide Job in Stages What is Shuffle in Spark Video explains - How Spark works What are Driver and Executors How Spark divides JOB in Stages and Tasks How Spark Processes data in parallel What are Cores and Tasks What is data Shuffle Chapters 00:00 - Introduction 00:25 - How Spark Works 01:47 - How Spark divide Job in Stages 02:06 - What is Shuffle 03:01 - What is Driver 03:30 - What are Executors 04:02 - Understand complete Workflow The series provides a step-by-step guide to learning PySpark a popular open-source distributed computing"  
[YouTube Link](https://youtube.com/watch?v=nKM4f1olwsI)  2023-03-27T09:14Z 44.9K followers, 119.8K engagements


"Why YouTube NOT Udemy #dataengineering #easewithdata #pyspark #databricks #short #education #pyspark #databricks Checkout all Data Engineering content herem👇🏻 https://www.youtube.com/@easewithdata/playlists Don't forget to like and Subscribe ❤ Follow me on LinkedIn 👇🏻 https://www.linkedin.com/in/subhamkharwal"  
[YouTube Link](https://youtube.com/watch?v=f5K5q4Rpc8I)  2025-11-26T17:29Z 44.9K followers, [----] engagements


"47 AIBI Genie Space in Databricks Use Natural Language to Query data Azure Databricks AIBI Genie Spaces Natural Language to Query data in Databricks Video explains - What is AIBI Genie Spaces in Databricks How to Configure Genie Space in Databrick How to provide Instructions in Genie Spaces How to fix hallucination in Genie Space in Databricks Chapters 00:00 - Introduction 00:18 - What is Genie Spaces in Databricks 01:14 - Enabling Genie Space on AIBI Dashboars 02:04 - How to create Genie Space from Scratch 03:33 - Configuring Instructions and Datasets for Genie Spaces 08:31 - Writing Natural"  
[YouTube Link](https://youtube.com/watch?v=-f2unVTHh2g)  2025-07-29T13:00Z 44.9K followers, [----] engagements


"35 Functions in Unity Catalog using Databricks SQL SCALAR and TABLE User Defined Functions Video explains - How to create Functions in Unity Catalog in Databricks SQL What are SCALAR and TABLE User Defined functions in Databricks What is User Defined Function in Unity Catalog What is User Defined Table Function (UDTF) in Databrick SQL How to write Python function in Databricks SQL How to register a Function in Unity Catalog Chapters 00:00 - Introduction 00:11 - What are Functions in Databricks Unity Catalog 00:21 - Types of User Defined Functions in Unity Catalog 02:30 - Built-in functions in"  
[YouTube Link](https://youtube.com/watch?v=0w0WuTQPesI)  2025-01-24T13:00Z 44.9K followers, [----] engagements


"34 Object Level Security or Permissions in Unity Catalog Manage Object Privileges in Unity Catalog Video explains - How to Secure tables in Unity Catalog What are all different Permissions available in Unity Catalog How to hide tables in Unity Catalog What is MANAGE Permission in Unity Catalog What is Data Access Control in Databricks How to manage privileges on Objects in Unity Catalog Databricks What are different ways to provide privileges in Unity Catalog Databricks How to Secure data in Databricks Chapters 00:00 - Introduction 00:38 - How Permissions work in Unity Catalog 01:03 - Top"  
[YouTube Link](https://youtube.com/watch?v=1zprRpWbZoE)  2025-01-19T15:45Z 44.9K followers, [----] engagements


"28 DLT Append Flow(Union) & Autoloader Pass parameter in DLT pipeline Generate tables dynamically Video explains - How to add Autoloader in DLT pipeline What is the use of Append Flow in DLT pipeline How to Union data in DLT pipeline How to union Streaming tables in DLT pepilines How to pass parameters in DLT pipelines How to generate DLT tables dynamically Chapters 00:00 - Introduction 01:34 - How to use Autoloader in DLT pipelines 05:54 - Use of Append Flow in DLT Pipelines/Union of Streaming tables in DLT using Append Flow 12:27 - How to pass parameters in DLT pipelines 12:37 - Generate"  
[YouTube Link](https://youtube.com/watch?v=23kFaURvknU)  2024-11-28T13:00Z 44.9K followers, 15.9K engagements


"25 Medallion Architecture in Data Lakehouse Use of Bronze Silver & Gold Layers Video explains - What is Medallion Architecture in Databricks What is Lakehouse Medallion Architecture What is the use of Bronze Silver and Gold Layer in Medallion Architecture Chapters 00:00 - Introduction 00:12 - What is Medallion Architecture in Data Lakehouse 00:35 - Bronze Layer in Medallion Architecture 01:11 - Silver Layer in Medallion Architecture 01:26 - Gold Layer in Medallion Architecture Databricks Website: www.databricks.com Medallion Architecture -"  
[YouTube Link](https://youtube.com/watch?v=29FJvrulEAM)  2024-11-16T13:00Z 44.9K followers, 26.4K engagements


"05 ETL vs ELT and Data Loading Strategies Video explains and answers few basic questions - What is the difference between ETL & ETL What is Full Load What is Incremental Load or Delta Loads What is the difference between Full load and Incremental Load It also explains in depth about different loading strategies used in Data Warehousing. Chapters 00:00 - Introduction 00:17 - What is the need of ETL in Data Warehousing 02:00 - What is ETL 03:31 - Major type of Loading Strategies in Data Warehousing 04:07 - What is Full Load or Truncate Load 05:52 - What is Incremental Load or Delta loads 09:00"  
[YouTube Link](https://youtube.com/watch?v=3uuto89FRZU)  2023-01-21T04:50Z 44.9K followers, [----] engagements


"PySpark Full Course Basic to Advanced Optimization with Spark UI PySpark Training Spark Tutorial PySpark Tutorial Apache Spark Full Course Spark Tutorial for beginners PySpark Training Full Course Only training that covers Basic to Advanced Spark with Spark UI and with live examples. Here is what it covers in length in next [--] hrs [--] min: Chapters: 00:00:00 - What we are going to Cover 00:00:25 - Introduction 00:01:10 - What is Spark 00:02:29 - How Spark Works - Driver & Executors 00:06:04 - Spark Transformations & Actions 00:10:31 - Spark DataFrames & Execution Plans 00:13:33 - Understand"  
[YouTube Link](https://youtube.com/watch?v=5RosqOeJrrs)  2024-12-20T14:26Z 44.9K followers, 73K engagements


"02 What is Data Lakehouse & Databricks Data Intelligence Platform Benefits of Databricks Lakehouse Video explains - What is Databricks Data Lakehouse What are the benefits of Databricks Unified solution How Delta Lake empowers Data Lakehouse Why Databricks called Data Intelligence Platform Chapters 00:00 - Introduction 00:33 - Databricks Unified Solution 02:07 - Databricks utilizes Open Source solutions 04:01 - What is Data Lakehouse and Benefits of Data Lakehouse 06:30 - Databricks Lakehouse Platform 08:36 - What is Databricks Data Lakehouse and Data Intelligence platform Databricks Website:"  
[YouTube Link](https://youtube.com/watch?v=5xDP73nX4Mc)  2024-08-04T13:30Z 44.9K followers, 124.6K engagements


"34 Write PySpark Unit Test Cases using PyTest module Setup PyTest with PySpark Unit Test Cases in PySpark using PyTest PySpark Tutorial [----] Spark Training Video explains - How to write Unit Test Cases in PySpark using PyTest Module How to use PyTest Module What are fixtures in PyTest How to integrate PyTest with PySpark How to integrate Unit Test Cases of PySpark using PyTest on CICD Chapters 000:00 - Introduction 00:50 - Setup PyTest Module 02:25 - How to write Unit Tests in PySpark using PyTest 15:19 - Running Test Cases using PyTest - PySpark Playlist -"  
[YouTube Link](https://youtube.com/watch?v=9_D8jTFis6E)  2025-11-29T13:00Z 44.9K followers, [----] engagements


"51 Setup Azure DevOps Pipeline with Databricks Asset Bundles (DABs) Complete CICD Process Azure Databricks Databricks Asset Bundles Setup Azure DevOps Pipeline with DABs Video explains - How to configure Azure DevOps Pipeline with Databricks Asset Bundle What are the steps involved in CICD process Chapters 00:00 - Introduction 00:59 - Permission setup for Service Principal 03:12 - Local Repository Setup for Azure DevOps Pipelines 06:18 - Setup Azure DevOps Pipeline Variables 10:48 - Configure Azure DevOps Pipeline Code in Local 20:00 - Create and Run Azure DevOps Pipeline 25:51 - How whole"  
[YouTube Link](https://youtube.com/watch?v=9_VM3OgEbUo)  2025-08-15T13:00Z 44.9K followers, 10.9K engagements


"13 Managed & External Tables in Unity Catalog vs Legacy Hive Metastore UNDROP Tables in Databricks Video explains - What is difference between Managed Table and External Table in Unity Catalog How is Managed table in Unity Catalog different from Legacy Hive Metastore What is UNDROP in Databricks Chapters 00:00 - Introduction 01:24 - What's new in Databricks Updates and Releases 01:49 - Create External Location in Databricks 03:37 - Managed Tables vs External Tables in Unity Catalog 07:07 - UNDROP in Databricks Databricks Website: www.databricks.com Undrop table:"  
[YouTube Link](https://youtube.com/watch?v=BFwufEvo_aQ)  2024-09-01T12:30Z 44.9K followers, 26.9K engagements


"08 What is Unity Catalog and Databricks Governance What is Metastore Unity Catalog Object Model🔥 Video explains - What is Unity Catalog Introduction to Unity Catalog. What is Metastore How Databricks Governance works What is Catalog in Databricks What is Unity Catalog Data Governance Object Model What is Three Level Namespace in Unity Catalog Chapters 00:00 - Introduction 00:28 - What is Unity Catalog 01:27 - With and Without Unity Catalog 02:06 - Unity Catalog Object Model 02:16 - What is Metastore 03:38 - What is Catalog 05:01 - Three Level Namespace Databricks Website: www.databricks.com"  
[YouTube Link](https://youtube.com/watch?v=EKC7t4USIec)  2024-08-18T11:30Z 44.9K followers, 84.2K engagements


"16 Delta Tables Liquid Clustering and Deletion Vectors Optimize Delta Tables Delta Clustering Video explains - What are Deletion Vectors in Delta Tables What is Liquid Clustering in Delta Table How Liquid Clustering improved performance in Delta Tables How to Optimize a Delta table with High Cardinality Column How to read a file using SQL in Databricks How to enable Liquid Clustering on a Delta Table What is Delta Clustering Chapters 00:00 - Introduction 00:44 - What are Deletion Vector in Delta Tables 01:58 - How Deletion Vector works in Delta Tables 08:13 - What is Liquid Clustering in"  
[YouTube Link](https://youtube.com/watch?v=EveYBUZP__4)  2024-09-27T13:00Z 44.9K followers, 25.3K engagements


"14 Read Parse or Flatten JSON data JSON file with Schema from_json to_json Multiline JSON Video explains - How to read JSON files How to parse JSON data How to flatten JSON data What is explode function What is from_json function What is to_json function How to write complex schema for JSON Chapters 00:00 - Introduction 02:01 - Read Single Line JSON file 03:29 - Read Multiline JSON file 04:42 - Read JSON data in Single column 05:29 - Read JSON file with Schema 07:00 - Write Schema ddl String 09:20 - from_json function 11:00 - to_json function 12:39 - Flatten JSON data Spark JSON Documentation"  
[YouTube Link](https://youtube.com/watch?v=FLrCwoy5Z6c)  2023-10-25T15:00Z 44.9K followers, 23.6K engagements


"45 Metric Views in Databricks Unity Catalog Design Semantic Model Measures and Attributes Databricks Metric Views Semantic Model in Databricks Unity Catalog Metric Views Video explains - What is Metric View in Databricks Unity Catalog How to define measures in Metric Views in Databricks How to use Window function logic Metric Views How to join tables in Metric Views in Databricks Chapters 00:00 - Introduction 00:14 - What is Unity Catalog Metric View in Databricks 00:46 - Benefits of Metric Views 02:15 - How to create Metric Views 04:34 - How to create dimensions Metric Views 07:44 - How to"  
[YouTube Link](https://youtube.com/watch?v=FkVB2delLqE)  2025-06-17T13:00Z 44.9K followers, [----] engagements


"12 Slowly Changing Dimension Type [--] (SCD 2) Video explains - What is Slowly Changing Dimension Type [--] Or What is SCD [--] How to design a SCD [--] in Data Warehousing What is the difference in SCD [--] and SCD [--] What is CDC Chapters: 00:00 - Introduction 00:42 - What is Slowly Changing Dimension Type [--] or SCD [--] 01:07 - How to design SCD [--] 02:02 - Understand SCD [--] with Example #scd2 #scd #dw #datawarehouse #datawarehousing #datamodelling #etl #elt #olap DW Data Warehouse Data Warehousing OLAP Analytics OLTP EDW ETL ELT Fact Dimension Dimensions Slowly Changing Dimensions SCD Conformed Junk Dimension"  
[YouTube Link](https://youtube.com/watch?v=Fx637buOQ7Q)  2023-01-28T06:51Z 44.9K followers, [----] engagements


"41 Data Warehousing using DBSQL SQL Warehouses on Databricks SQL Query Performance Tuning Video explains - How to do Data Warehousing in Databricks What is DBSQL What are SQL Warehouses in Databricks How to tune SQL Queries using Query Profile How to monitor SQL Query Performance What is Serverless SQL Warehouse What are the benefits on Data Warehousing on Databricks Chapters 00:00 - Introduction 01:08 - DBSQL References 01:22 - Types of SQL Warehouses in Databricks 02:31 - Get Started with SQL Warehouse in Databricks 03:04 - SQL Editor in Databricks 03:28 - Create SQL Warehouse in Databricks"  
[YouTube Link](https://youtube.com/watch?v=G_3hoBaUawY)  2025-03-11T13:00Z 44.9K followers, [----] engagements


"04_2 - Setup PySpark in Local Machine with Jupyter Lab PySpark Local Machine Setup Video explains - How to setup PySpark in Local Machine How to setup Spark Cluster in Local Machine How to practise Spark in Local Machine How to setup Spark with Jupyter Lab in Local machine Chapters 00:00 - Introduction 00:39 - Standalone mode setup 09:28 - Cluster mode setup Python Basics - https://www.learnpython.org/ Github URL - https://github.com/subhamkharwal Medium Blog URL - https://subhamkharwal.medium.com/learnbigdata101-spark-series-940160ff4d30 The series provides a step-by-step guide to learning"  
[YouTube Link](https://youtube.com/watch?v=GrvOnYI92Ps)  2025-11-22T13:03Z 44.9K followers, 18.3K engagements


"33 What is Spark Connect Spark Connect vs Spark Session Setup Spark Connect Server with Cluster Video explains - What is Spark Connect How Spark Connect Works What is the difference between Spark Connect and Spark Session How to setup Spark Connect Server with Cluster Chapters 00:00 - Introduction 00:44 - What is Spark Connect 03:00 - Spark Connect Setup with Spark Cluster 09:05 - Spark Connect Client Setup 11:20 - Spark Connect vs Spark Session 21:51 - Spark Connect Medium Blog - PySpark Playlist - https://www.youtube.com/playlistlist=PL2IsFZBGM_IHCl9zhRVC1EXTomkEp_1zm - Databricks Playlist"  
[YouTube Link](https://youtube.com/watch?v=I7F5iAcxPnQ)  2025-11-25T13:00Z 44.9K followers, [----] engagements


"39 Delta Sharing in Databricks Databricks Express Edition Share Data outside your Organization Video explains - What is Delta Sharing in Databricks How to use Delta Sharing to share data outside Organization How to configure Delta Sharing What are Providers and Recipients in Delta Sharing What are the Permission required for Delta Sharing How to Share data across Metastore using Delta Sharing Chapters 00:00 - Introduction 00:25 - Delta Sharing Modes 01:36 - Databricks Express Edition Setup 02:57 - Enable Delta Sharing on Metastore 04:12 - Delta Sharing Permissions 05:14 - Sharing data using"  
[YouTube Link](https://youtube.com/watch?v=IV2f-iGXmOk)  2025-02-25T13:00Z 44.9K followers, 12.3K engagements


"04 Spark DataFrames & Execution Plans Spark Logical and Physical Execution Planning What are DAG Video explains - What are Spark DataFrames What is Logical Planning What is Physical Planning How Spark leverages DAG How Spark Plans Structured API Execution Chapters 00:00 - Introduction 00:10 - What are Spark DataFrames 00:41 - Understand DataFrame Example 01:21 - How Spark DataFrame data partitions are transformed 02:11 - What is Spark Logical Execution Planning 02:49 - What is Spark Physical Execution Planning 03:27 - What is DAG The series provides a step-by-step guide to learning PySpark a"  
[YouTube Link](https://youtube.com/watch?v=I_gum_3bEvY)  2023-03-31T09:28Z 44.9K followers, 68.3K engagements


"37 Column Level Masking in UC Mask Sensitive Column in Unity Catalog table using Column Masking Video explains - How to mask sensitive columns data in tables in Unity Catalog How to apply Column Level Masking in Databricks Unity Catalog How to apply Column Level Security in Databricks Unity Catalog How to mask PII column data in Databricks How to mask PII column data using Unity Catalog in Databricks Chapters 00:00 - Introduction 00:42 - Use cases for Column Level Masking 01:35 - Column Level Masking with Custom Metadata in Databricks 03:36 - Create Masking Function for COlumn Level Masking"  
[YouTube Link](https://youtube.com/watch?v=LCG7LX5nIfg)  2025-02-18T13:00Z 44.9K followers, [----] engagements


"43 Lakehouse Federation or Query Federation in Databricks Query External Database Foreign Catalog Lakehouse Federation in Databricks Query Federation in Databricks Query External Data Source in Databricks Video explains - What is Lakehouse Federation in Databricks What is Query Federation in Databricks How to setup Lakehouse Federation in Databricks How to query external database in Databricks What are external connections in Databricks What are Foreign Catalogs in Databricks How Lakehouse Federation is different than JDBC connections in Databricks Chapters 00:00 - Introduction 00:12 - What"  
[YouTube Link](https://youtube.com/watch?v=LJ8XdJu_zw0)  2025-04-12T05:49Z 44.9K followers, [----] engagements


"42 Streaming Tables and Materialized Views in DBSQL Background Working Schedule data Refresh Streaming Tables in DBSQL Materialized Views in DBSQL Refresh Materialized Views incrementally Azure Databricks tutorials Video explains - What is Streaming Table in Databricks What is Materialized View in Databricks How to create Streaming Table in DBSQL How Streaming tables works in DBSQL How to create Materialized View in DBSQL How to refresh Materialized Views How Materialized View refreshes data Incrementally How Streaming Tables and Materialized Views works in Backend with DLT How to schedule"  
[YouTube Link](https://youtube.com/watch?v=LtRt3T05hRo)  2025-03-26T13:00Z 44.9K followers, [----] engagements


"32 Spark Memory Management Why OOM Errors in Spark Spark Unified Memory Storage/Execution Mem Video explains - How Spark distributes memory What is Spark Memory Management If Spark can Splill data then why OOM Error What is JVM On-Heap and Off-Heap Memory What is the minimum amount of Memory needed for Executors What is Spark Unified Memory What are Storage and Execution Memory What is OOM Error WHat are the reasons for OOM Errors What is Garbage Collection What is Serialization and Deserialization Chapters 00:00 - Introduction 00:39 - Spark Memory Management in Theory 01:39 - JVM On-Heap vs"  
[YouTube Link](https://youtube.com/watch?v=McMQ7yMaL9Q)  2025-01-13T13:00Z 44.9K followers, 19.9K engagements


"10 Enable Unity Catalog and Setup Metastore How to setup Unity Catalog for Databricks Workspace Video explains - How to setup Unity Catalog for Databricks Workspace How create a Metastore in Databricks How to create a Storage account for Metastore How to Assign Metastore to Databricks Workspace How to Enable Unity Catalog for a Databricks Workspace Chapters 00:00 - Introduction 00:11 - Setup Metastore for Databricks 01:43 - Create Azure Storage Account for Metastore 03:59 - Access Connectors for Azure Databricks 05:56 - Setup ADLS path for Metastore 06:47 - Assign Metastore to Databricks"  
[YouTube Link](https://youtube.com/watch?v=NHQcq-ubOig)  2024-08-22T11:30Z 44.9K followers, 53K engagements


"11 Slowly Changing Dimension Type [--] (SCD 1) Video explains - What is Slowly Changing Dimension Type 1or SCD [--] How to design a SCD [--] in Data Warehousing It also explains what are Surrogate Keys and Natural Keys in Data Warehousing and how they are different Chapters: 00:00 - Introduction 00:32 - What are Surrogate Keys in Data Warehousing 01:04 - What is Natural Key 01:22 - Surrogate Key with example 02:21 - What is Slowly Changing Dimension Type [--] or SCD [--] 02:56 - Design SCD [--] with Example #dw #datawarehousing #slowlychangingdimension #type1 #scd1 #dw #datawarehouse #scd DW Data Warehouse"  
[YouTube Link](https://youtube.com/watch?v=OMIAQXk6bhI)  2023-01-27T10:40Z 44.9K followers, [----] engagements


"06 Lambda and Kappa Architectures Data Processing Architectures in Big Data Video covers - What are different type of Big data processing Architectures What is Lambda Architecture What is Kappa Architecture What is the difference between Lambda and Kappa Architectures Chapters: 00:00 - Introduction 00:22 - Lambda Architecture 01:27 - Kappa Architecture URLs: Github Code - https://github.com/subhamkharwal/spark-streaming-with-pyspark/blob/master/01_reading_from_sockets.ipynb Keywords: Apache Spark PySpark Spark Streaming Real-time Data Processing Data Streaming Big Data Analytics PySpark"  
[YouTube Link](https://youtube.com/watch?v=OxskDWkgqTU)  2024-02-12T12:30Z 44.9K followers, 12.1K engagements


"18 Understand DAG Explain Plans & Spark Shuffle with Tasks Skipped Stage Benefit of Shuffle Write Video explains - How to read DAG How to read Explain Plan in Spark How Spark creates Stages and Tasks Chapters 00:00 - Introduction 00:39 - Example Demonstration 08:59 - Understand DAG 10:25 - Understand Explain Plan 12:04 - Skipped Stages 13:26 - Benefits of Shuffle Write Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code - https://github.com/subhamkharwal/pyspark-zero-to-hero/blob/master/14_understand_dag_plan.ipynb"  
[YouTube Link](https://youtube.com/watch?v=RlLWMlDeS04)  2023-11-18T11:30Z 44.9K followers, 23.9K engagements


"20 Databricks Computes - All Purpose & Job Access Modes Cluster Policies Cluster Permissions Video explains - What is Databricks Compute What are different Access Modes available with Databricks Compute How to create a all purpose cluster in Databricks DIfference between all purpose and job compute in Databricks What are different CLuster Permissions in Databricks Compute What are Cluster/Compute Policies in Databricks Chapters 00:00 - Introduction 00:07 - What is Compute in Databricks 01:05 - All Purpose Compute/Cluster 02:51 - Access Mode in Databricks Compute 11:47 - Cluster Permissions"  
[YouTube Link](https://youtube.com/watch?v=TxeDV9v0ukQ)  2024-10-15T13:00Z 44.9K followers, 20.3K engagements


"31 DLT Truncate Load Source Workflow File Arrival Triggers Full Refresh Schedule DLT pipelines Video explains - How to use Trucate Load table as Source in DTL Pipelines What is the use of skipChangeCommits feature How to full refresh a DLT Pipeline How to avoid Streaming Tables from getting full refreshed What are File Arrival Trigger in Databricks Workflows How to use FIle based trigger in Databricks Chapters 00:00 - Introduction 00:47 - Truncate Load table as Source for Streaming Tables skipChangeCommits 03:37 - DLT Pipelines Full Refresh 05:10 - Scheduling DLT pipelines using Workflows"  
[YouTube Link](https://youtube.com/watch?v=UPTBK-YcDbI)  2024-12-23T13:00Z 44.9K followers, [----] engagements


"15 Delta Tables MERGE and UPSERTS SCD1 in Delta Soft Delete with Incremental data using Merge Video explains - How to Merge logic in Delta Tables What are Merge Conditions How to do Upserts in Delta Tables using Merge How to do SCD1 using Merge in Delta Tables How to do soft delete of Incremental data using Merge Statement Chapters 00:00 - Introduction 00:18 - What is Upsert or Merge 04:02 - Merge Data based on Condition in Delta Table 08:57 - Soft deletes using Merge Statements Databricks Website: www.databricks.com Merge Delta Tables:"  
[YouTube Link](https://youtube.com/watch?v=VVSzWm53bes)  2024-09-22T13:15Z 44.9K followers, 22.9K engagements


"01 Databricks Tutorial [----] Databricks for Data Engineering Azure Databricks Training Azure Databricks Databricks Tutorials Databricks Training Databricks End to End playlist This Databricks tutorial playlist covers everything from beginner basics to advanced concepts. Learn Databricks fundamentals features and best practices to enhance your skills and boost productivity. Chapters 00:00 - Introduction 00:10 - Agenda 00:55 - What you gain from this Series 01:09 - Pre-Requisites 01:31 - Resources Databricks Website: www.databricks.com The series provides a step-by-step guide to learning"  
[YouTube Link](https://youtube.com/watch?v=XOSuR8g2SfQ)  2024-08-02T11:30Z 44.9K followers, 263.6K engagements


"36 Row Level Filters in UC Filter Sensitive Data in Unity Catalog table using Row Level Security Video explains - How to filter sensitive data in tables in Unity Catalog How to apply Row Level Filters in Databricks Unity Catalog How to apply Row Level Security in Databricks Unity Catalog What are Dynamic Views What are Dynamic Queries in Databricks Chapters 00:00 - Introduction 01:55 - Use cases for Row Level Filters on Tables 03:18 - Manage Compute or Cluster Permissions 05:43 - Metadata setup 07:38 - Function for Row Level Filter 12:57 - Dynamic Queries and Views in Databricks 16:11 - Apply"  
[YouTube Link](https://youtube.com/watch?v=XToxaq7OE9o)  2025-02-14T13:00Z 44.9K followers, [----] engagements


"11 Catalog External Location & Storage Credentials in Unity Catalog Catalog with External Location Video explains - How to create Catalog using External Location in Databricks How to created Unity Catalog with External Location using SQL in Databricks How to create External Location in Databricks Unity Catalog How to create Storage Credential in Databricks How to connect Databricks to Storage Accounts Chapters 00:00 - Introduction 00:50 - Unity Catalog Managed Table External Locations 03:45 - Create Catalog without External location 07:29 - Create Catalog with SQL 08:09 - Drop Catalog and"  
[YouTube Link](https://youtube.com/watch?v=Ys9obOxJaOM)  2024-08-25T13:30Z 44.9K followers, 46.1K engagements


"19 Orchestrating Notebook Jobs Schedules using Parameters Run Notebook from another Notebook Video explains - How to parameterize Notebooks in Databricks How to run one notebook from another Notebook How to trigger a notebook with different parameters from a notebook How to create Notebook Jobs How to orchestrate notebooks How to Schedule Databricks Notebooks Chapters 00:00 - Introduction 00:24 - Overview 01:01 - How to Parameterize Databricks Notebooks / Child Notebook 08:04 - Orchestrating jobs through notebooks/Running notebooks from Notebooks 12:15 - Scheduling Databricks Notebooks"  
[YouTube Link](https://youtube.com/watch?v=_-cLRVmWxJc)  2024-10-08T12:30Z 44.9K followers, 19.9K engagements


"03 Databricks High Level Architecture Understand Control Plane & Data Plane Roles in Databricks Video explains - What is Control Plane and Data Plane in Databricks What is High Level Architecture of Databricks What are the different roles available in Databricks What is Databricks Workspace What is relation between Databricks Account and Workspace Chapters 00:00 - Introduction 00:27 - Relation between Databricks Account & Workspace 02:12 - What is Databricks Workspace 03:21 - Databricks High Level Architecture 03:31 - What is Control and Data Plane in Databricks 06:28 - Role and"  
[YouTube Link](https://youtube.com/watch?v=_2ZGN_Y6M2c)  2024-08-08T13:15Z 44.9K followers, 88.6K engagements


"48 Databricks GIT Folders Configure GIT repository with Databricks using Azure DevOps Repo Azure Databricks Git Folders Azure DevOps Setup Git Integration Video explains - What are Databricks GIT folders How to configure GIT repo with Databrick How to configure Azure DevOps repo with Databricks How to configure GIT credentials on Databricks How to Push Pull and maintain Version changes on Repo using Databricks How to setup Azure DevOps with Databricks Chapters 00:00 - Introduction 01:01 - Azure DevOps Setup 02:26 - Azure DevOps Repo setup 03:55 - Databrick Git/Repo Folder Setup 07:38 -"  
[YouTube Link](https://youtube.com/watch?v=ahXt3fHCojg)  2025-08-02T13:00Z 44.9K followers, 11.8K engagements


"40 Serverless Compute for Notebooks Jobs DLT ML and Warehouses Architecture of Serverless Video explains - What is Serverless Compute in Databricks What is the Architecture of Serverless Compute What are the benefits of Serverless Compute on Databricks How Serverless is better than Classic Compute in Dtabricks How to Enable Serverless compute in Databricks Chapters 00:00 - Introduction 00:10 - Benefits of Serverless Compute in Databricks 01:22 - Serverless Databricks Architecture 03:29 - Serverless Availability in Regions 04:24 - How to Enable Serverless in Databricks 05:07 - Budget Policies"  
[YouTube Link](https://youtube.com/watch?v=e4GaAj4O1Sk)  2025-03-01T13:00Z 44.9K followers, [----] engagements


"30 DLT Data Quality & Expectations Monitor DLT pipeline using SQL Define DQ rule Observability Video explains - How to use Data Quality in DLT Pipelines How to use Expectations in DLT What are different Actions in Expectations How to monitor a DLT pipeline How to monitor a DLT pipeline using SQL queries How to define data quality rules in DLT pipelines Chapters 00:00 - Introduction 00:18 - What are Expectations in Databricks DLT 01:19 - How to define rules for Expectations in DLT 03:30 - Expectation action - Warning 08:56 - Expectation action - Fail 10:25 - Expectation action - Drop 14:36 -"  
[YouTube Link](https://youtube.com/watch?v=f3HeS2B-qH4)  2024-12-16T13:00Z 44.9K followers, 11.7K engagements


"32 Databricks Secret Management & Secret Scopes Save secrets in Databricks Use of Azure Key Vault Video explains - What is Databricks Secret Management What are Secret Scopes in Databricks How to save and use secrets in Databricks How to create and use Azure Key Vault to save secret in Databricks What is Databricks backed secret scope How to install Databricks CLI How to Authenticate Databricks CLI Chapters 00:00 - Introduction 00:17 - What is a Secret Scope in Databricks 01:02 - Azure Key Vault backed Secret Scope 04:30 - Creating Secret Scope for Azure Key Vault 08:00 - Databricks backed"  
[YouTube Link](https://youtube.com/watch?v=f4SrT3DDdBo)  2024-12-27T13:00Z 44.9K followers, 14K engagements


"24 Auto Loader in Databricks AutoLoader Schema Evolution Modes File Detection Mode in AutoLoader Video explains - How to use AutoLoader in Databricks What are the different file detection modes in Auto Loader What is Schema Evolution in Autoloader What are different Schema Evolution Mode in Auto Loader What is RocksDB What is File Notification mode in Autoloader Chapters 00:00 - Introduction 00:23 - What is Auto Loader in Databricks 04:09 - File Detection Modes in Auto Loader 05:12 - How to use Auto Loader in Databricks 06:30 - What is Schema Location in Auto Loader 07:41 - What is Schema"  
[YouTube Link](https://youtube.com/watch?v=g7d1U2_dWS8)  2024-11-13T15:00Z 44.9K followers, 33.6K engagements


"52 Lakeflow Spark Declarative Pipelines New Pipeline Code Editor AUTO CDC External Target Sinks Lakeflow Spark Declarative Pipelines(SDP) PySpark DLT Databricks Video Covers 👉🏻 How to create Lakeflow Spark Declarative Pipelines (SDP) How to use the new Pipeline Editor in Databricks What happened to DLT DLT vs SDP Chapters 00:00 - Introduction 04:22 - New Lakeflow Pipelines Editor UI 14:09 - Spark Declarative Pipeline Code 15:28 - SDP Streaming Tables 16:50 - SDP Materialized Views 18:14 - SDP SCD2 Table using AUTO CDC (previously apply changes) 22:24 - External Target Sink 24:35 - SDP"  
[YouTube Link](https://youtube.com/watch?v=hAzmPs6NxFs)  2025-12-09T13:01Z 44.9K followers, [----] engagements


"14 Delta Tables Deep & Shallow Clones Temporary & Permanent Views List Catalog Schemas & Tables Video explains - How to clone Delta Tables in Databricks What is Deep Clone of Delta table What is Shallow Clone of Delta Table How is CTAS different that Deep Clone of Delta Table What is the difference between DEEP and SHALLOW clone of Delta Table When to use DEEP and SHALLOW clone of Delta table What are Temporary Views and Permanent Views in Databricks What is the difference between a View and a Table How to list catalogs schemas and tables in Databricks Chapters 00:00 - Introduction 00:25 -"  
[YouTube Link](https://youtube.com/watch?v=iBLK4GJyxqI)  2024-09-06T14:00Z 44.9K followers, 33.1K engagements


"26 DLT aka Delta Live Tables DLT Part [--] Streaming Tables & Materialized Views in DLT pipeline Video explains - What are Delta Live Tables in Databricks What is DLT pipeline What is Streaming Table in DLT Pipeline What is Materialized View in DLT pipeline How to create a DLT pipeline What is LIVE keyword in DLT pipeline Difference between DLT Streaming table and Materialized View Chapters 00:00 - Introduction 00:05 - What is Delta Live Tables(DLT) in Databricks 01:05 - How to create a DLT Pipeline 02:54 - What are Streaming Tables Materialized Views and Views in DLT pipeline 04:29 - How to"  
[YouTube Link](https://youtube.com/watch?v=iqf_QHC7tgQ)  2024-11-19T13:00Z 44.9K followers, 48.2K engagements


"50 Databricks Asset Bundles Configure Production grade DABs CICD using DABs (IAC) Azure Databricks Databricks Asset Bundles Databricks DABs Video explains - How to configure Databricks Asset Bundles How to configure DABs How to deploy jobs using DABs How to deploy DABs from Databricks Workspace UI How to deploy DABs from Databricks CLI Chapters 00:00 - Introduction 02:15 - How to configure Databricks Asset Bundles Project 12:03 - How to Enable DABs deployment from UI 18:02 - Add Jobs & Pipelines to DABs Project 24:31 - What are presets in DABs 29:12 - DABs Deployment using UI 34:24 - How to"  
[YouTube Link](https://youtube.com/watch?v=q2hDLpsJfmE)  2025-08-11T13:01Z 44.9K followers, 18.1K engagements


"27 DLT Internals & Incremental load DLT Part [--] Add or Modify columns Rename table Data Lineage Video explains - How to process Incremental data in DLT pipelines How to rename a table in DLT How to add new columns in DLT tables How to modify an existing column in DLT What is Data Lineage in Unity Catalog Internals of Delta Live Tables Chapters 00:00 - Introduction 00:45 - DLT Pipeline Internals 01:54 - Incremental load using DLT 03:54 - How to add new columns or modify existing columns in Materialized Views in DLT 04:09 - How to use DLT pipeline in debugging mode 07:17 - How to rename DLT"  
[YouTube Link](https://youtube.com/watch?v=q543k7YrMfY)  2024-11-22T13:01Z 44.9K followers, 18.4K engagements


"31 Delta Tables - Deletion Vectors and Liquid Clustering Optimize Delta Tables Delta Clustering Video explains - What are Deletion Vectors in Delta Tables What is Liquid Clustering in Delta Table How Liquid Clustering improved performance in Delta Tables How to Optimize a Delta table with High Cardinality Column How to read a file using SQL in Databricks How to enable Liquid Clustering on a Delta Table What is Delta Clustering This video is also available as a part of playlist : Databricks Zero to Hero (https://www.youtube.com/playlistlist=PL2IsFZBGM_IGiAvVZWAEKX8gg1ItnxEEb) Chapters 00:00 -"  
[YouTube Link](https://youtube.com/watch?v=qovye-vdn8I)  2024-10-02T12:30Z 44.9K followers, 12.1K engagements


"09 Legacy Hive Metastore Catalog in Databricks What are Managed Table and External Table DBFS Video explains - What is Hive Metastore Catalog in Databricks What is Managed Table What is External Table What is difference between Managed and External table What are Views What is the default location for Managed Hive Metastore Table What is DBFS Chapters 00:00 - Introduction 01:45 - What is Managed Table 05:10 - What is External Table 06:48 - Managed Tables vs External Table 08:17 - Data files of External table 08:58 - What are Views Databricks Website: www.databricks.com Unity Catalog"  
[YouTube Link](https://youtube.com/watch?v=rYbk-Y8Mx1g)  2024-08-20T11:30Z 44.9K followers, 52.9K engagements


"33 User Management in Databricks How to add Users Service Principal & Groups in Unity Catalog Video explains - How to add users in Databricks How to create Service Principals in Databricks How to create Service Principal in Azure How to use Service Principal in Databricks How to create and use Groups in Databricks What is SCIM in Databricks How to auto provision users from Microsoft Entra Id in Databricks Chapters 00:00 - Introduction 01:08 - How to add/create new users in Microsoft Entra ID 02:35 - How to add/create new users in Databricks Account console 03:48 - What is SCIM in Databricks"  
[YouTube Link](https://youtube.com/watch?v=rtqvQG7AZFc)  2025-01-07T13:01Z 44.9K followers, 14.8K engagements


"44 Databricks SQL Alerts Configure Alert Schedule and Destinations Databricks SQL Alerts Azure Databricks Alerts Schedule and Destinations for Alerts Video explains - What is Alerts in Databricks How to configure Databricks SQL Alerts How to configure different destinations in Databricks for Alerts What are the different types of Destinations available with Databricks Chapters 00:00 - Introduction 01:19 - Create Query to evaluate condition for Alerts 03:33 - How to create Databricks SQL Alerts 06:55 - How to add Alert schedule and destinations in Databricks 07:48 - What type of Alert"  
[YouTube Link](https://youtube.com/watch?v=sPtlTdA1sPY)  2025-04-25T13:01Z 44.9K followers, [----] engagements


"23 Databricks COPY INTO command COPY INTO Metadata Idempotent Pipeline Exactly Once processing Video explains - How to use COPY INTO command to ingest data in Lakehouse How COPY INTO commands maintain idempotent behaviour How COPY INTO process files exactly once in Databricks How to create placeholder tables in Databricks Chapters 00:00 - Introduction 00:12 - What is COPY INTO command in Databricks and its benefits 01:26 - How to use COPY INTO command in Databricks 03:13 - Placeholder tables or Empty Delta Tables 07:37 - How COPY INTO maintains metadata in Databricks 09:33 - Transform data"  
[YouTube Link](https://youtube.com/watch?v=sjItHOjZsY4)  2024-11-06T13:01Z 44.9K followers, 16.9K engagements


"17 Volumes - Managed & External in Databricks Volumes in Databricks Unity Catalog Files in Volume Video explains - What are Volumes in Databricks How to create a Managed Volume in Databricks How to create an External Volume in Databricks How to store Unstructured data in Databricks How to read files from Databricks Volumes Chapters 00:00 - Introduction 00:05 - What are Volumes in Databricks 00:57 - Types of Volumes in Databricks 01:09 - Create External Location for External Volume 03:17 - Create Managed Volume in Databricks 06:01 - How to define Volume file system paths 08:30 - Create"  
[YouTube Link](https://youtube.com/watch?v=uFoU3H7yURg)  2024-10-01T13:01Z 44.9K followers, 22.1K engagements


"49 Databricks CLI Install and Authenticate Databricks CLI U2M and M2M Authentication Azure Databricks Databricks CLI U2M and M2M Authentication Video explains - How to install Databricks CLI How to Authenticate Databricks CLI How to configure U2M and M2M Authentication in Databricks CLI Chapters 00:00 - Introduction 01:09 - How to install Databricks CLI 03:23 - Databricks U2M Authentication 06:58 - Databricks CLI Help command 09:17 - Databricks M2M Authentication Databricks Website: www.databricks.com Databricks CLI - https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/ Install"  
[YouTube Link](https://youtube.com/watch?v=uOg26utXUYg)  2025-08-06T13:01Z 44.9K followers, [----] engagements


"01 PySpark Tutorial PySpark Training Learn from Basics to Advanced Performance Optimization PySpark Tutorial Apache Spark Tutorials PySpark Training Video explains - What is Spark Why is Spark important How Spark is difference from tradition Hadoop Map Reduce Chapters 00:00 - Introduction 00:10 - Why you should follow this series 01:02 - What is Spark 01:19 - Why Spark is faster than Hadoop 01:34 - Spark Components The series provides a step-by-step guide to learning PySpark a popular open-source distributed computing framework that is used for big data processing. New video in every [--] days ❤"  
[YouTube Link](https://youtube.com/watch?v=wNRjR6Cds5s)  2023-03-25T10:26Z 44.9K followers, 203.3K engagements


"46 AIBI Dashboards & Visualizations Consumer Access in Databricks Forecasting Reports Azure Databricks AIBI Dashboards Consumer Access in Databricks Video explains - What is AIBI Dashboards in Databricks How to use Metric Views in AIBI Dashboards How to use text Prompts in AIBI Dashboards How to setup consumer access in Databricks How to setup Databricks One Consumer Access How to create Visualization in AIBI Dashboards How to create Forecasting reports in AIBI Dashboards How to share AIBI Dashboards in Databricks Chapters 00:00 - Introduction 01:31 - How to create AI/BI Dashboards in"  
[YouTube Link](https://youtube.com/watch?v=xCc1aGrTFmo)  2025-07-26T13:01Z 44.9K followers, [----] engagements


"18 DBUTILS command Databricks Utilities Create Widgets in Databricks Notebooks DBUTILS FS usage Video explains - What is Databricks Utility or dbutils How to use dbutils command in Databricks How to copy files from Local file system to dbfs in Databricks How to use dbutils.fs commands How to create Widgets in Databricks How to pass parameter to a notebook in Databricks How to read values from a widget in Databricks How to use Databricks Secrets Utility How to use Databricks Notebook utility Chapters 00:00 - Introduction 00:06 - What is Databricks Utility or DBUTILS 01:03 - What all Utilities"  
[YouTube Link](https://youtube.com/watch?v=zMUiDYgqlq0)  2024-10-04T12:31Z 44.9K followers, 16.7K engagements


"22 Workflows Jobs & Tasks Pass Values within Tasks If Else Cond For Each Loop & Re-Run Jobs Video explains - How to create Jobs in Databricks Workflows How to pass values from one task to another in Databricks Workflow jobs How to create if else conditional jobs in Databricks How to create For Each Loop in Databricks How to re-run failed Databricks Workflow Jobs How to Override parameters in Databricks Workflow Job runs Chapters 00:00 - Introduction 01:44 - Databricks Jobs UI 05:24 - How to create a Job in Workflow in Databricks 11:49 - How to pass values from one task to another in"  
[YouTube Link](https://youtube.com/watch?v=zQ8YOrD_f8c)  2024-11-01T13:01Z 44.9K followers, 29K engagements


"12 Schemas with External Location in Unity Catalog Managed Table data Location in Unity Catalog Video explains - How to create Schema using External Location in Databricks How Managed table data is stored with External Locations specified at different level in Unity Catalog Object Model How to create Unity Catalog with External Location using SQL in Databricks How to create External Location in Databricks Unity Catalog How to create Storage Credential in Databricks How to connect Databricks to Storage Accounts Chapters 00:00 - Introduction 02:15 - Create Schema in Unity Catalog 03:34 - Create"  
[YouTube Link](https://youtube.com/watch?v=zUxb2sC9Owo)  2024-08-28T13:01Z 44.9K followers, 31.1K engagements


"16 DW Model - Star Schema and Snowflake Schema Video explains - How Surrogate Keys are populated along with the type of Data Warehousing Modelling Schemas - Star and Snowflake Schema. Chapter: 00:00 - Introduction 00:12 - What is Star Schema 00:30 - What is Snowflake Schema 00:48 - How to load Surrogate Keys in Data Warehousing 02:38 - Star Schema Explanation 02:49 - Snowflake Schema Explanation #dw #datawarehousing #datawarehouse #starschema #modelling"  
[YouTube Link](https://youtube.com/watch?v=20WsDwBgo2s)  2023-02-01T10:25Z 30.3K followers, [----] engagements


"14 Transactional Fact Table and Periodic Snapshot Fact Table Video Explains - What is Transactional Fact Table and What is Periodic Snapshot Fact table Understand the basic difference between Transactional and Aggregated Fact Table. Also understand how to use and design different types of Fact Tables Chapters: 00:00 - What is Transactional Fact Table 00:23 - Example for Transactional Fact Table 01:49 - What is Aggregated/Periodic Snapshot Fact Table 02:11 - Example of Aggregated Fact Table 04:10 - Benefit of Aggregated Fact Table with Example 04:35 - Example of Snapshot Fact Table 06:24 -"  
[YouTube Link](https://youtube.com/watch?v=2_i3tdxRKP8)  2023-01-30T11:19Z 15.9K followers, [----] engagements


"20 Data Caching in Spark Cache vs Persist Spark Storage Level with Persist Partial Data Caching Video explains - How Spark works with Cache data What is the difference in Spark Cache vs Persist Understand what is the impact of partial caching. Chapters 00:00 - Introduction 00:29 - Demonstration 03:20 - Spark Cache 09:20 - Spark Storage Level with Persist 12:54 - Cache vs Persist Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code -"  
[YouTube Link](https://youtube.com/watch?v=5peB6KcCsd4)  2023-12-24T12:00Z 23.9K followers, [----] engagements


"27 Read and Write from Azure Cosmos DB using Spark E2E Cosmos DB setup NoSQL vs SQL Databases Video explains - How to read and write data from Azure Cosmos DB What are NO-SQL databases Why is Azure Cosmos DB so important How to create a Azure Cosmos DB Account What are the differences between SQL and NOSQL databases What are different Write strategies in Azure Cosmos DB Why are NO-SQL databases so popular Chapters: 00:00 - Introduction 00:45 - What is NoSQL and SQL Databases and their differences 01:32 - Azure Cosmos DB Basics 04:08 - How to Create Azure Cosmos DB Account in Azure Portal"  
[YouTube Link](https://youtube.com/watch?v=BOfnMXFrNUA)  2024-04-29T11:30Z [----] followers, [----] engagements


"04 Setup Databricks on Azure Create your first Databricks Workspace How to Databricks free trial Video explains - How to set up Databricks How to Setup Databricks with Azure How to setup Databricks free trail How to setup Databricks for Free What are different Platform tiers Databricks offer What are different Databricks Pricing 00:00 - Introduction 00:23 - Setup Databricks with AWS and GCP 01:15 - Setup Databricks with Azure 01:53 - Databricks Tier and Pricing 02:55 - Setup Databricks with Azure Databricks Website: www.databricks.com Other important links: Setup with AWS -"  
[YouTube Link](https://youtube.com/watch?v=MCtsWWTIMB8)  2024-08-10T11:30Z [----] followers, [----] engagements


"01 Data Lakehouse Data Warehousing with PySpark Introduction & Agenda Video explains - Agenda and Problem statement for the series Data Lakehouse Data Warehousing with PySpark. The whole series is designed to help people understand and design Data Warehousing on Data Lake or Data Lakehouse with help of PySpark Delta Lake AWS Docker and more. This is a complete hands-on series with code explanation with implementation. We will also try to apply all best practises as per industry standards. This series requires basic understanding on Python Apache Spark Delta Lake and AWS. If you are new to"  
[YouTube Link](https://youtube.com/watch?v=N2Mzs-nJosQ)  2023-02-06T09:14Z 28.6K followers, 11.4K engagements


"02 Introduction to Data Warehousing Video Explains - What is Data Warehousing And How is it different from Transactional System It also explains What is Business Intelligence Understand the Basics of Data Warehousing to clear any Interview. Chapters: 00:00 - Introduction 00:18 - Agenda of Data Warehouse Series 01:36 - What is Data Warehousing 02:30 - Benefits of Data Warehousing with Example 03:34 - What is Business Intelligence 04:25 - Basics of Data Warehousing 06:00 - Interview Question #dw #datawarehousing #datawarehouse #businessintelligence #bi"  
[YouTube Link](https://youtube.com/watch?v=PA6xXV_C6a0)  2023-01-16T17:27Z 28.6K followers, [----] engagements


"03 Data Lakehouse Data Warehousing with PySpark Setup Docker PySpark Jupyter Lab Environment Video explains - How to setup PySpark on Docker How to set up PySpark with Jupyter Lab on Docker We are going to use AWS Cloud services to design the Data Lakehouse and Processing power of Spark to load & process the data. Github Docker Images - https://github.com/subhamkharwal/docker-images If you are new to Data Warehousing checkout our playlist on YouTube - https://www.youtube.com/watchv=HrFMKGGb1gM&list=PL2IsFZBGM_IE-EvpN9gaZZukj-ysFudag New Video will be uploaded every [--] days. Stay Tuned. Make"  
[YouTube Link](https://youtube.com/watch?v=WhxljT3IfdM)  2023-02-10T05:20Z 28.8K followers, 13.3K engagements


"38 Workspace Catalog Binding in Unity Catalog in Databricks Limit Catalog Access Share Catalog Video explains - How to Limit Catalog access in Unity Catalog in Databricks How to bind catalog to Workspace What is Workspace Catalog binding in Unity Catalog Databricks How to share data across Workspaces in Databricks How to Restrict Catalog to Workspace in Databricks Chapters 00:00 - Introduction 00:42 - Databricks Workspace Setup 02:12 - Workspace Catalog binding in Unity Catalog Databricks 07:27 - How to share catalogs along workspaces 09:23 - Points to note Databricks Website:"  
[YouTube Link](https://youtube.com/watch?v=X-DVzVxGeNM)  2025-02-21T13:00Z 18.7K followers, [----] engagements


"15 PySpark - Zero to Hero How Spark Writes data Video explains - How to Spark writes data under the hood What are the Spark write modes available How to Partition data while writing Chapters 00:00 - Introduction 00:24 - How Spark writes data under the hood 02:14 - Default Parallelism 03:57 - Write data in Spark 07:59 - Write data with Partition 10:49 - Write modes in Spark 12:20 - Bonus Tip Spark Documentation - https://spark.apache.org/docs/latest/sql-data-sources-load-save-functions.html Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics -"  
[YouTube Link](https://youtube.com/watch?v=dn0ijC_SSfo)  2023-10-31T13:36Z [----] followers, [---] engagements


"12 PySpark - Zero to Hero Understand Spark UI Read CSV Files and Read Modes Video explains - How to read CSV Files How Spark works in background while reading files Understand Spark UI. What is InferSchema What are the read modes available in Spark Chapters 00:00 - Introduction 01:29 - How to read CSV file in Spark 02:29 - What is happening in Spark UI 03:15 - Read header from file 04:00 - Spark InferSchema Option 06:02 - Read file with Schema 08:27 - CSV File read options 08:54 - Read Modes 09:25 - Permissive Mode 13:14 - Drop Malformed Mode 14:23 - Fail Fast Mode 15:35 - Use case for Read"  
[YouTube Link](https://youtube.com/watch?v=k2AVOmUS7i0)  2023-10-18T19:19Z [----] followers, [--] engagements


"30 Data Skipping and Z-Ordering in Delta Lake Tables Optimize & Data Compaction Delta Lake Tables Video explains - What is the impact of data skipping on jobs How z-ordering in delta lake works How to optimize delta lake tables Chapters 00:00 - Introduction 00:31 - What is Data Skipping and Z-Ordering in Delta Lake 03:34 - Z-Ordering for more than [--] column/Multidimensional Z-ORDER 04:38 - Delta Lake Table Optimization with Example 11:59 - Multi Column Z-Ordering in Delta Lake Table 14:43 - Impact of Partitioning with Z-Ordering 16:24 - Selective Z-Ordering with Partition filters 17:57 - Auto"  
[YouTube Link](https://youtube.com/watch?v=kUMAmZQIMfA)  2024-07-19T17:01Z [----] followers, [---] engagements


"08 Spark Streaming Checkpoint Directory Contents of Checkpoint Directory Video covers - What are the contents of Checkpoint Directory How checkpoint directory help in resume Streaming applications How Checkpoint directory help in fault tolerance Chapters: 00:00 - Introduction 02:24 - Metadata file in Checkpoint Directory 02:54 - Sources folder in Checkpoint Directory 03:25 - Offset folder in Checkpoint Directory 03:49 - Commits folder in Checkpoint Directory 05:32 - How to handle a fault 06:22 - How to re-run same file URLs: Github Code -"  
[YouTube Link](https://youtube.com/watch?v=knHvAy2h710)  2024-02-20T12:30Z 16.4K followers, [----] engagements


"03 Spark Transformations & Actions Why Spark prefers Lazy Evaluation What are Partitions in Spark Video explains - What are Spark Transformations and Actions What are Narrow and Wide Transformations What is Partition How Spark works on Lazy Evaluation And What is Spark Session Chapters 00:00 - Introduction 00:20 - What is Partition 00:56 - What are Transformations 02:49 - What are Actions 03:15 - Why Spark Prefers Lazy Evaluation 04:49 - What is Spark Session The series provides a step-by-step guide to learning PySpark a popular open-source distributed computing framework that is used for big"  
[YouTube Link](https://youtube.com/watch?v=purrLTWn178)  2023-03-29T11:53Z 30.9K followers, 58.2K engagements


"25 AQE aka Adaptive Query Execution in Spark Coalesce Shuffle Partitions Skew Partitions Fix Video explains - What is Adaptive Query Execution in Spark What is AQE What Optimizations does AQE provides with Spark Chapters 00:00 - Introduction 00:51 - What is AQE and What it Offers 02:13 - Join without AQE 05:16 - Join with AQE 05:23 - AQE Coalesce Post Shuffle Partitions 05:48 - AQE Skew Partitions Optimization 09:14 - AQE SortMerge to BroadCast Join Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code -"  
[YouTube Link](https://youtube.com/watch?v=164OKvwW8T8)  2024-01-06T14:50Z 31K followers, 13.2K engagements


"Get 100% more Interview calls from Naukri Portal Boost your Naukri Profile Optimize Naukri Search Video explains - How to Optimize Naukri Profile to get more calls or opportunities How to boost Naukri Profile What are the relevant changes to get more Interview calls How to hack Naukri Portal to get more calls Naukri Job Search help Chapters 00:00 - Introduction 01:19 - Naukri Profile Changes 02:52 - Changes for Resume 04:32 - Keywords Optimization 05:45 - Serving Notice Period 07:15 - Naukri Activity Tracker Hack 08:15 - Upgrade your Skills Note: I am not looking for any new opportunity this"  
[YouTube Link](https://youtube.com/watch?v=7W1uChmAUOg)  2024-07-05T11:30Z 34.4K followers, 52.1K engagements


"29 DLT SCD2 & SCD1 table Apply Changes CDC Back loading SCD2 table Delete/Truncate SCD table Video explains - How to create SCD2 table in DLT How to create SCD1 table in DLT How to back fill or back load missing data in SCD2 table in DLT How to delete data from SCD tables in DLT How to Truncate SCD tables in DLT What is CDC in DLT How to design CDC tables in DLT Chapters 00:00 - Introduction 02:56 - How to SCD1 or SCD2 tables in DLT Pipelines 03:59 - Slowly Changing Dimension Type [--] table (SCD1) 05:46 - How to delete and truncate data from target table in DLT 07:15 - Slowly Changing Dimension"  
[YouTube Link](https://youtube.com/watch?v=RS4z6cRZn60)  2024-12-06T13:00Z 35.5K followers, 13.3K engagements


"12 Spark Streaming Writing data to Multiple Sinks foreachBatch Writing data to JDBC(Postgres) Video covers - How to write data to multiple sinks in Spark Streaming What is the issue with multiple writeStream command How to use foreachBatch in Spark Streaming How to write data to Postgres/JDBC Chapters: 00:00 - Introduction 00:46 - Issues with Using Multiple WriteStream 01:37 - foreachBatch command 04:03 - Code Implementation 04:51 - Writing data to Multiple Sink using foreachBatch 06:32 - Writing to Parquet 07:06 - Writing to JDBC(Postgres) URLs: Github Code -"  
[YouTube Link](https://youtube.com/watch?v=UtIlm06sbXs)  2024-03-03T13:00Z 42.5K followers, [----] engagements


"Q&A on Data Engineering Interviews and Career - Episode [--] This video tries to explain some of the common questions on Interviews and Careers related to Data Engineering. Chapters: 00:00 - Introduction 00:38 - What is your Experience 01:23 - What you do at Databricks 02:01 - Can someone from Service based Org switch to Product Org 02:38 - How to Prepare for Product based Org 05:19 - How to describe a Project in an Interview 07:22 - Preparing for DE what should be the strategy 09:27 - Is learning Streaming mandatory for DE 10:30 - How much DSA is required for DE interviews 11:41 - Working in"  
[YouTube Link](https://youtube.com/watch?v=U5D-XfPA37A)  2025-11-11T13:00Z 44.9K followers, [----] engagements


"Views on upcoming LLM and GenAI Playlist #llm #shorts #llm #shorts #genai"  
[YouTube Link](https://youtube.com/watch?v=ROeynshHThQ)  2025-07-27T16:54Z 44.9K followers, [----] engagements

Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing