#  @bryancafferky Bryan Cafferky Bryan Cafferky posts on YouTube about databricks, community, watch, how to the most. They currently have [------] followers and [---] posts still getting attention that total [---] engagements in the last [--] hours. ### Engagements: [---] [#](/creator/youtube::UCEdMzQ0m9WcZQepgizrHpMw/interactions)  - [--] Week [---] +188% - [--] Month [-----] -32% - [--] Months [------] -38% - [--] Year [-------] -15% ### Mentions: [--] [#](/creator/youtube::UCEdMzQ0m9WcZQepgizrHpMw/posts_active)  - [--] Week [--] +250% - [--] Month [--] +80% - [--] Months [--] -5.30% - [--] Year [--] +22% ### Followers: [------] [#](/creator/youtube::UCEdMzQ0m9WcZQepgizrHpMw/followers)  - [--] Week [------] no change - [--] Month [------] +0.41% - [--] Months [------] +3% - [--] Year [------] +8.70% ### CreatorRank: undefined [#](/creator/youtube::UCEdMzQ0m9WcZQepgizrHpMw/influencer_rank)  ### Social Influence **Social category influence** [technology brands](/list/technology-brands) [social networks](/list/social-networks) [stocks](/list/stocks) [finance](/list/finance) [fashion brands](/list/fashion-brands) **Social topic influence** [databricks](/topic/databricks) #61, [community](/topic/community), [watch](/topic/watch), [how to](/topic/how-to), [apache](/topic/apache), [azure](/topic/azure), [python](/topic/python), [delta](/topic/delta), [youtube](/topic/youtube), [step](/topic/step) **Top accounts mentioned or mentioned by** [@bryancafferkyplaylists](/creator/undefined) **Top assets mentioned** [Microsoft Corp. (MSFT)](/topic/microsoft) ### Top Social Posts Top posts by engagements in the last [--] hours "Master Databricks and Apache Spark Step by Step: Lesson [--] - Introduction In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Slides and Other Content when Applicable available at: https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Databricks Spark data science machine learning Python SQL" [YouTube Link](https://youtube.com/watch?v=YvTzvZh3yTE) 2021-11-15T19:45Z 48.7K followers, 161.5K engagements "Intro to Python Dask: Easy Big Data Analytics with Pandas In this video you will learn how to use Dask a Python module that enables pandas code to run in parallel on your local machine or scaled out to multiple machines. No dataframe or numpy size limits and super-fast execution. Just pip install and go It's that easy Does it really work Find out Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook with Code at: https://github.com/bcafferky/shared/blob/master/Dask/DaskIntro.zip See my Master Databricks and" [YouTube Link](https://youtube.com/watch?v=jstCmSD_LAs) 2022-01-04T14:40Z 48.7K followers, 17.8K engagements "Master Databricks and Apache Spark Step by Step: Using Scala Dataframes & Datasets In this video you learn how to use Scala Spark dataframes and datasets and how to get the most out of them. It's all demonstration and the link to the code is below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Code Available at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_39_Scala_EDA.zip For training on how to create the tables see: https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s" [YouTube Link](https://youtube.com/watch?v=3HooMbk7SF8) 2023-02-07T15:14Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Series Overview This video introduces a training series on Databricks and Apache Spark in parallel. You'll learn both platforms in-depth while we create an analytics solution. Databricks runs on top of Spark and this series will take you from Padawan to Jedi Knight. Edited video on 2022-10-16 to improve sound and reduce length. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Content available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Follow me on Twitter" [YouTube Link](https://youtube.com/watch?v=ChISx0-cMpU) 2022-10-17T00:57Z 48.7K followers, 91K engagements "Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Architecture A popular interview question and a critical topic for all Databricks and Spark developers how do you tune and optimize Spark queries This video provides a conceptual understanding of where things can go wrong as a starting point to understanding performance tuning and optimization. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/DatabricksPerfTuning/lesson01_DatabricksPerfTuningIntro.pdf" [YouTube Link](https://youtube.com/watch?v=KG2RzvtJ-eg) 2024-03-18T15:34Z 48.7K followers, [----] engagements "Master Databricks 2nd Ed: Lesson [--] - Use Databricks for Free In this video you will learn how to get the Databricks service for free so you can learn at your leisure. What's the catch What are the limitations How do I sign up All this is explained in the video. Get Databricks for Free here https://www.databricks.com/learn/free-edition Databricks Free Edition Limitations https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-edition-limitations Get Free Databricks Training https://docs.databricks.com/aws/en/getting-started/free-training" [YouTube Link](https://youtube.com/watch?v=M9Q_oqqTzMY) 2026-01-28T13:36Z 48.7K followers, [---] engagements "Don't Use Apache Airflow Apache Airflow is touted as the answer to all your data movement and transformation problems but is it In this video I explain what Airflow is why it is not the answer for most data movement and transformation needs and provide some better options. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflow/AirFlow_DoNotUse.pdf Follow me on Twitter @BryanCafferky Follow Me on LinkedIn https://www.linkedin.com/in/bryancafferky/" [YouTube Link](https://youtube.com/watch?v=YQ056EKzCyw) 2022-01-18T14:52Z 48.7K followers, 121.7K engagements "Apache Airflow Architecture [---] Apache Airflow is a popular open-source Linux and Python based workflow engine. Before you jump in and start using it there are some things you need to know. In this video I explain the Airflow architecture: the good the bad and the ugly so you can decide where and when to use it. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflowArch/AirFlow_Architecture.pdf Video: Don't Use Apache Airflow https://youtu.be/YQ056EKzCyw Follow me on Twitter" [YouTube Link](https://youtube.com/watch?v=lVS6lz5wuH4) 2022-09-06T20:03Z 48.7K followers, 21.2K engagements "Should You Use Databricks Delta Live Tables Delta Live Tables (DLT) is Databricks new declarative framework to build reliable maintainable and testable data processing pipelines. It is a big deal and loaded with functionality. If you are overwhelmed developing and maintaining Databricks ETL pipelines you need to consider Delta Live Tables. In this short video I discuss critical things to consider to determine if DLT is right for your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides:" [YouTube Link](https://youtube.com/watch?v=pASZmKNiDDI) 2023-09-06T13:05Z 48.7K followers, 10.4K engagements "Master Using SQL with Python: Lesson [--] - Using Enterprise Databases with ODBC In this third part of the series you learn how to query production scale database systems like SQL Server Oracle PostgreSQL and MySQL using pyodbc and Pandas. This takes a bit more work than the prior methods but gives the most power and flexibility. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook and Data https://github.com/bcafferky/shared/blob/master/PythonSQL/PythonSQLLesson3.zip python data analysis anlaytics sql T-SQL" [YouTube Link](https://youtube.com/watch?v=rTCWORnIqBI) 2019-07-19T16:32Z 48.7K followers, 15.5K engagements "Master Databricks 2nd Ed: Lesson [--] - Introduction This is a 2nd edition with updated content of my popular YouTube series Master Databricks & Apache Spark. In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. I'll also talk about many of the services Databricks offers and what they do. You will learn how Spark is bare bones whereas Databricks is a full data and AI development platform. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon" [YouTube Link](https://youtube.com/watch?v=-_aIROeFr_8) 2025-03-10T18:29Z 48.7K followers, [----] engagements "Azure Databricks with R: Deep Dive Azure Databricks is Microsoft first class Big Data Machine Learning cloud serviced based on Spark. In this video we'll explain how to use the R programming language with Databricks. Bring your popcorn. Slide and code at: https://github.com/bcafferky/shared" [YouTube Link](https://youtube.com/watch?v=-vekHiJdQ1Y) 2023-10-23T19:49Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Saving Query Results to Tables on Spark In this video you learn how to query Spark tables with SQL and how to save the results permanently to tables which is a great way to build a platform of data for future analysis and ML pipelines. This video demonstrates using open-source Apache Spark via Zeppelin Notebook. Get Master Azure Databricks Step by Step at" [YouTube Link](https://youtube.com/watch?v=0z5JBrbjTTg) 2023-10-24T20:59Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Creating the SQL Tables on Databricks In this video you will learn about the project use case its data and how to create and load the Spark SQL tables you'll need from the CSV files provided. This video lays the foundations for the ones that follow so make sure you watch it and create your own database. Note: Video was re-edited to improve sound and uploaded again. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at:" [YouTube Link](https://youtube.com/watch?v=1BNO8Syj8UY) 2022-10-24T12:51Z 48.7K followers, 15.2K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Intro to the New pandas UDFs Spark [---] launched a new way to code traditional Python User Defined Functions (UDF) and added a new pandas UDF API that leverages Apache Arrow to get highly performant execution. This video explains the important concepts you need to understand to use this powerful new feature. Slides at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_26_PySpark_Intor_new_pandas_udfs.zip Blog on using SQL Aggregate functions from PySpark" [YouTube Link](https://youtube.com/watch?v=1BVTuMIGl-k) 2023-10-23T18:54Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Window Functions In this video you learn how to use Spark Structured Query Language (SQL) window functions. Spark SQL is the most performant way to do data engineering on Databricks and window functions expand SQL functionality to include things like cumulative totals ranking values and including aggregations alongside detail rows. They can save you a lot of work. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get my book Master Azure Databricks Step by Step at" [YouTube Link](https://youtube.com/watch?v=3rD77orSxKI) 2023-10-24T20:59Z 34K followers, [----] engagements "Introduction to Scaling Analytics Using DuckDB with Python DuckDB is a free open-source fast and performant singe machine OLAP analytical database that supports the full SQL language. It's Python API is extensive can work with data that does NOT fit into memory and is many times faster than pandas. I predict DuckDB will dominate the landscape soon It is a Game-Changer Supporting Links Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Slides:" [YouTube Link](https://youtube.com/watch?v=6zzsVbpdwQA) 2024-07-30T14:30Z 48.7K followers, 10.5K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Features Trends and Direction his video helps you understand what the myriad of Apache Spark services are and why are they needed. The goal is to demystify Spark so you are less overwhelmed. Don't Panic It actually makes sense. Support me on Patreon: https://www.patreon.com/join/clouddatatrek Slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_40_SparkServicesAndConcepts.zip Data Lakehouse Series https://www.youtube.com/playlistlist=PL7_h0bRfL52pOai_ih3HSu2WCgPXmNHzH Hive Metastore" [YouTube Link](https://youtube.com/watch?v=9YJby_COOdc) 2024-11-08T13:19Z 48.7K followers, [----] engagements "Why Databricks Delta Live Tables Delta Live Tables are a new and exciting way to develop ETL pipelines but what are they and do you need them Why was this technology created This video answers these questions and more Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DLT_Intro.zip See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp databricks dlt delta live tables Apache Spark databricks dlt delta live tables" [YouTube Link](https://youtube.com/watch?v=BpIc-St0EFY) 2023-05-08T11:35Z 48.7K followers, 22.2K engagements "Scale Up Your Databricks Coding with Databricks AI Assistant Databricks AI Assistant is a new intelligent helper in performing coding tasks. It's "Wicked Smart". Think ChatGPT for Databricks. This video will demonstrate how to enable and use the Assistant review its pros and cons and advise you on things to consider when implementing the Assistant in your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Databricks Notebook in dbc format):" [YouTube Link](https://youtube.com/watch?v=FoxYdvD-Nok) 2023-08-24T12:08Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Coding pandas UDFs PySpark pandas user defined functions are custom code you can run in parallel over the cluster nodes getting top performance. Spark [---] launched a new way to code traditional Python User Defined Functions (UDF) (introduced in video 26). This video teaches you how to code the new PySpark pandas user defined functions. Slides at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_27_PySpark_pandas_df_udf.zip Intro to PySpark User Defined Functions Video" [YouTube Link](https://youtube.com/watch?v=H00Y9JTcFio) 2023-10-24T20:59Z 34K followers, [----] engagements "Understanding Delta Lake - The Heart of the Data Lakehouse Data Lakehouse is taking the world by storm as the new data warehouse platform In this video I demonstrate how Delta Lake provides the core functionality of the Data Lakehouse and demystify this powerful technology. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s See my" [YouTube Link](https://youtube.com/watch?v=JX9oyM1q26U) 2023-02-13T17:28Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Spark SQL DDL on Spark In this video you will learn how to use Spark SQL Data Definition Language (DDL) on open-source Apache Spark with Zeppelin Notebook. DDL statements create and maintain database objects. This video explains the differences between using Databricks and Apache Spark for SQL DDL. Example Notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_08_AW_SQL_DDL_on_Spark.zip You need to unzip the file and import the notebook into Zeppelin - explained in the video" [YouTube Link](https://youtube.com/watch?v=JeSw11pCJxo) 2021-03-01T15:59Z 43K followers, 13.1K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Saving Query Results to Tables In this video you learn how to query Spark tables with SQL and how to save the results permanently to tables which is a great way to build a platform of data for future analysis and ML pipelines. Get Master Azure Databricks Step by Step at https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_1crid=3U9U5QGUAZISS&dchild=1&keywords=master+azure+databricks+step+by+step&qid=1616409819&sprefix=master+azure+%2Caps%2C150&sr=8-1 Example Notebook for lesson [--] and [--] at:" [YouTube Link](https://youtube.com/watch?v=L9mfr9tf2UQ) 2021-03-22T10:53Z 43K followers, 11.6K engagements "Master Databricks & Apache Spark Step by Step: Lesson [--] - Using The Data Science Process In this video you will learn about the data science process. This series of steps takes you from project inception to completion. You'll need this to do your own projects and we'll be following this structure for the rest of this series. Master Azure Databricks Step By Step https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_3dchild=1&keywords=master+azure+databricks&qid=1611758195&sr=8-3 Video Slides https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark" [YouTube Link](https://youtube.com/watch?v=Ov25ojlqEkg) 2021-02-08T18:20Z 43K followers, 23.7K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Create a Databricks Workspace The Databricks workspace is the cloud based environment in which you use Databricks and includes the user interface integrated storage security settings job scheduling and most importantly Databricks notebooks. In this video you will learn how to create a Databricks workspace. Slides available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Video on Getting Databricks Free Community Edition https://www.youtube.com/watchv=lcI1W2_KUPo&t=236s Azure Portal" [YouTube Link](https://youtube.com/watch?v=QefelWdD_OA) 2021-01-18T14:32Z 46.5K followers, 69.4K engagements "How to Create Databricks Workflows (new features explained) Data Pipeline orchestration is a challenge to effective data engineering yet there is no perfect solution that can meet all needs. However if you are using Databricks then the Workflows service is an excellent answer to this problem. In this video I'll explain what workflows are when and how to use them and discuss powerful new features added to this service See my YouTube video content guide: https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/ Support Me on Patreon Community and Watch this Video without Ads" [YouTube Link](https://youtube.com/watch?v=TAg2u5jKvrk) 2023-10-01T13:29Z 48.7K followers, 25.8K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Using PySpark Dataframe Methods In this video you learn how to use PySpark dataframes methods on Databricks to perform data analysis and engineering at scale. This is the core of using Python on Spark and you need to learn the power but also the nuances involved. Video demo notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_23_AW_PySpark_Dataframe_Methods_2.zip Apache Spark Zeppelin Notebook link will be posted later. For information on how to upload files to Databricks see:" [YouTube Link](https://youtube.com/watch?v=TVuv07-T8XA) 2023-10-23T18:54Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Spark SQL Data Definition Language. In this video you will learn how to use Using Spark SQL Data Definition Language which works the same on Databricks and Spark. DDL statements create and maintain database objects but since Spark is not a database you need to know the differences. Spark SQL is the backbone of data engineering on Spark. Example Notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_07_AW_SQL_DDL.zip You need to unzip the file and import the notebook into Databricks" [YouTube Link](https://youtube.com/watch?v=Vflq-YArP3A) 2023-10-24T20:59Z 34K followers, 13.2K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Functions In this video you learn how to use Spark Structured Query Language (SQL) scalar and aggregate functions. Spark SQL is the most performant way to do data engineering on Databricks and Spark and you want to leverage SQL functions as much as possible versus writing custom code. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get my boo Master Azure Databricks Step by Step at" [YouTube Link](https://youtube.com/watch?v=W0T96I8dUaM) 2023-10-24T20:59Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark Introduction In this video we introduce PySpark and explain important concepts you need to understand to be productive with Python on Spark. Specific questions include Can Python do everything Does it perform well Why you need to know PySpark and more. Link to slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_20_PySpark_Intro.zip Deep Dive Apache Spark Interview with Dan Zafar from Databricks https://www.youtube.com/watchv=zlZ5oWAC2D8&list=PL7_h0bRfL52qJnJrpZc1wJaqrE8yDQmOY PySpark" [YouTube Link](https://youtube.com/watch?v=XDJA0MtgmAQ) 2023-10-24T20:59Z 34K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Goodbye Koalas: Hello Pandas on Spark In this video you will learn how to use the NEW PySpark pandas API a Python module that enables Python pandas code to run in parallel on Spark clusters with almost no code changes. This replaces the Koalas library as of Spark [---] and Databricks Runtime [----]. Code and Data link below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Notebook and Data" [YouTube Link](https://youtube.com/watch?v=YDUd0D0JyBM) 2022-01-11T15:38Z 43K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Using Scala What is the Scala programming language and do you need to use it on Databricks and Apache Spark Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky LinkedIn: https://www.linkedin.com/in/bryancafferky/ - mention my channel Video on Enabling Apache Arrow with R: https://www.youtube.com/watchv=m4dGkj5laXo&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp&index=36&t=3s Slides" [YouTube Link](https://youtube.com/watch?v=ZMZlvU7Q_bE) 2022-05-27T12:59Z 43K followers, [----] engagements "Understanding Delta File Logs Part [--] - Demonstrating Transactions Data Lakehouse is the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 2nd video in the series explores the delta log files and delta lake parquet files using Python code to demonstrate how the logs to work and how they from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at:" [YouTube Link](https://youtube.com/watch?v=ZSTJLfZy_Hs) 2023-03-20T13:11Z 48.7K followers, [----] engagements "Data Architecture vs. Data Engineering Deep Dive Are you an aspiring Data Architect Join me as I explain what Data Architecture is and what Data Engineering is with in-depth explanations and examples. I draw on decades of experience as a Data Engineer and Data Architect to give you time tested advice and best practices. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataArchitecture/DataArchVsDataEng/DataArchitectureVsDataEngSlides.pdf data architecture data engineering data architecture data engineering" [YouTube Link](https://youtube.com/watch?v=cI2dYnM5Kzo) 2024-02-22T16:24Z 48.7K followers, [----] engagements "Core Databricks: Understand the Hive Metastore A core part of the Databricks ecosystem is the Hive Metastore which enables Spark SQL. But how does Hive work and how do you use it How does Hive relate to the new Unity Catalog Join me as I answer these questions and more. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides data and code (Databricks Notebook in dbc format): https://github.com/bcafferky/shared/blob/master/DatabricksHive/DatabrickHive.zip" [YouTube Link](https://youtube.com/watch?v=cw54hfU2Ce0) 2023-08-16T12:11Z 48.7K followers, 26.2K engagements "Azure Databricks: A Brief Introduction A short introduction to the Amazing Azure Databricks recently made generally available. Databricks is a Big Data service based on Apache Spark and supports Python R and SQL as well as many machine learning frameworks. This is a friendly introduction to this exciting technology. Learn about it now" [YouTube Link](https://youtube.com/watch?v=cxyUy1bZ9mk) 2018-03-26T20:10Z 42.9K followers, 118.4K engagements "PowerShell Development: Querying SQL Server A quick code walk through of a custom function that executes queries against a SQL Server database. Includes coverage of key concepts. Code available at: https://github.com/bcafferky/shared/tree/master/PowerShellSQL" [YouTube Link](https://youtube.com/watch?v=dJkuAMx1Zh8) 2019-07-09T16:02Z 47.6K followers, 12.4K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark Using RDDs In this video we use PySpark to analyze data with Resilient Distributed Datasets (RDD). RDDs are the foundation of Spark. You learn what RDDs are what Lazy Evaluation is and why it matters and how to use Transformations and Actions. Everything is demonstrated using a Databricks notebook. Video slides and code at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_21_Using_PySpark_RDDs.zip Apache Spark Transformations Docs" [YouTube Link](https://youtube.com/watch?v=hHIXtyW5DXo) 2021-06-22T14:04Z 47.1K followers, 12.6K engagements "Quick Review of the Best App Dev Tools & Services Whether you want to showcase your data analytics skills or just create a cool app you'll need an app development tool. There's a lot of tools out there to build and deploy web and mobile apps but which are the best i.e. easiest to use maintain and deploy With a focus on data centric apps I'll review my favorites and discuss the pros and cons of the runner ups. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/AppDevTools/AppDevToolsOverview.pdf My Playlist About Streamlit" [YouTube Link](https://youtube.com/watch?v=hP6rVCo0-QQ) 2024-06-17T12:06Z 48.7K followers, [---] engagements "Master Databricks 2nd Ed: Lesson [--] - Understanding Clusters In this video you will learn about Databricks clusters including what they are why they are important how to create one configuration options and a review of how to answer common interview questions about them. Cluster Configuration Options & Best Practices https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices Enable Unity Catalog https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started Request an Increase in Your Compute Quota" [YouTube Link](https://youtube.com/watch?v=i2Y6911kP50) 2025-09-30T18:46Z 48.7K followers, [----] engagements "Master Databricks 2nd Ed: Lesson [--] - Create the Workspace To use Databricks you need a workspace. In this video I explain what a Databricks workspace is and how to create one. I also tell you how you can use Databricks for free. Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDatabricks_2nd/Lesson_02_2ndEdition_CreateDatabricksWorkspace.pdf Databricks Apache Spark Databricks Apache Spark" [YouTube Link](https://youtube.com/watch?v=kJO91zROMvg) 2025-03-18T15:50Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Parallel Database Queries This video shows you how to read data from a SQL Database from Databricks/Spark using Python using parallel reads so you get back partitioned data. SQL databases are the most popular platform for storing data so you are going to need this in your toolbelt. This video picks up where Lesson [--] left off and provides better performance. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook with Code at:" [YouTube Link](https://youtube.com/watch?v=kh_EWw7eKsA) 2023-10-20T18:01Z 34K followers, [----] engagements "How to Create a GUI in Python using Tkinter In this video you will learn how to create a Graphical User Interface (GUI) in Python using the Tkinter built-in library. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Code: https://github.com/bcafferky/shared/blob/master/PythonGUI/PythonTkinter/PythonGUITkinter1.zip" [YouTube Link](https://youtube.com/watch?v=kvd6GQZASno) 2022-07-11T14:58Z 45.9K followers, 20.5K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Joins In this video you learn how to query perform joins using Spark Structured Query Language (SQL). Spark SQL is the most performant way to do data engineering on Databrick and Spark. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get Master Azure Databricks Step by Step at https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_1crid=3U9U5QGUAZISS&dchild=1&keywords=master+azure+databricks+step+by+step&qid=1616409819&sprefix=master+azure+%2Caps%2C150&sr=8-1" [YouTube Link](https://youtube.com/watch?v=lIKTutg5rAs) 2023-10-24T20:59Z 34K followers, [----] engagements "Dimensional Modeling A tutorial on the concepts and practice of Dimensional Modeling the Kimball Method" [YouTube Link](https://youtube.com/watch?v=lWPiSZf7-uQ) 2017-08-22T20:17Z 47.3K followers, 188.6K engagements "Understanding Delta File Logs - The Heart of the Delta Lake Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This video explains how Delta tables use delta logs to make the magic happen. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video" [YouTube Link](https://youtube.com/watch?v=pCH_qNqnms0) 2023-02-24T13:02Z 48.7K followers, 12.4K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Using SQL Aggregate Functions In this video you learn how to use the built-in Spark SQL aggregate functions from Python. This gives you the benefit of good performance and functionality offered by any SQL function all within Python code. Scalar functions can also be used from Python. Video demo notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_25_PySpark_SQL_Agg_Functions.zip For information on how to upload files to Databricks and create tables see:" [YouTube Link](https://youtube.com/watch?v=s3tVpVZ7768) 2021-08-25T15:33Z 43K followers, [----] engagements "Estimating Azure Costs with the Azure Pricing Calculator Everyone asks me how do I estimates my Azure costs and avoid getting hit with unexpected charges Use the tool Microsoft sales people use The Azure Pricing Calculator. I'll show you how. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp finances costs expenses Azure Cloud finances costs expenses Azure Cloud" [YouTube Link](https://youtube.com/watch?v=vPLoYHRmQiU) 2023-01-19T15:36Z 48.7K followers, 15.7K engagements "Use Enterprise Relational Databases with R and ODBC To do data analytics R developers often need to get data from their organization's enterprise databases. In this video I'll show you how to use the RODBC package to easily query and even save data back to these databases using SQL Server as an example. If you use R you need to watch this video. Code for this video is available at: https://github.com/bcafferky/shared/tree/master/RSQLODBC" [YouTube Link](https://youtube.com/watch?v=wgmUyE4oZS0) 2020-12-06T21:24Z 45.5K followers, [----] engagements "PowerShell Module 1: An Introduction to the CLI and ISE A brief introduction to Windows PowerShell the Command Line Interpreter (CLI) and the Integrated Script Editor ISE). Slides available at https://github.com/bcafferky/shared/tree/master/IntroToPowerShell" [YouTube Link](https://youtube.com/watch?v=wrSlfAfZ49E) 2017-06-07T18:33Z 46K followers, 17.1K engagements "About My Channel In the digital age people are confused by the myriad of complex technologies. My channel is all about taking complex things breaking them down and making them simple to understand. Once you have that the rest is easy. Let me tell you about what my channel is about and why you should subscribe. My Playlists https://www.youtube.com/@BryanCafferky/playlists Master Databricks & Apache Spark https://www.youtube.com/watchv=ChISx0-cMpU&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Master Python & SQL https://www.youtube.com/watchv=xY54Emo8rQM&list=PL7_h0bRfL52oWNfE0GhwbnNjeJSmf8Q35" [YouTube Link](https://youtube.com/watch?v=rT4fUHchz5I) 2024-06-25T17:44Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Databricks Demo In this video I take you on a tour of the Databricks Workspace showing you each tool explaining its purpose and demonstrating how to use it. Since the Databricks interactive development environment (IDE) is their proprietary notebook I focus a bit more there. This video provides the foundation for later lessons in the series. The data files for this video are available here: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_03.zip Join my Patreon Community and Watch this Video without Ads" [YouTube Link](https://youtube.com/watch?v=xkD1l9_nj5w) 2021-01-20T13:57Z 48K followers, 64.6K engagements "Master Databricks 2nd Ed: Lesson [--] - Use Databricks for Free In this video you will learn how to get the Databricks service for free so you can learn at your leisure. What's the catch What are the limitations How do I sign up All this is explained in the video. Get Databricks for Free here https://www.databricks.com/learn/free-edition Databricks Free Edition Limitations https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-edition-limitations Get Free Databricks Training https://docs.databricks.com/aws/en/getting-started/free-training" [YouTube Link](https://youtube.com/watch?v=M9Q_oqqTzMY) 2026-01-28T13:36Z 48.7K followers, [---] engagements "Master Databricks 2nd Ed: Lesson [--] - Understanding Clusters In this video you will learn about Databricks clusters including what they are why they are important how to create one configuration options and a review of how to answer common interview questions about them. Cluster Configuration Options & Best Practices https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices Enable Unity Catalog https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started Request an Increase in Your Compute Quota" [YouTube Link](https://youtube.com/watch?v=i2Y6911kP50) 2025-09-30T18:46Z 48.7K followers, [----] engagements "Master Databricks 2nd Ed: Lesson [--] - Create the Workspace To use Databricks you need a workspace. In this video I explain what a Databricks workspace is and how to create one. I also tell you how you can use Databricks for free. Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDatabricks_2nd/Lesson_02_2ndEdition_CreateDatabricksWorkspace.pdf Databricks Apache Spark Databricks Apache Spark" [YouTube Link](https://youtube.com/watch?v=kJO91zROMvg) 2025-03-18T15:50Z 48.7K followers, [----] engagements "Master Databricks 2nd Ed: Lesson [--] - Introduction This is a 2nd edition with updated content of my popular YouTube series Master Databricks & Apache Spark. In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. I'll also talk about many of the services Databricks offers and what they do. You will learn how Spark is bare bones whereas Databricks is a full data and AI development platform. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon" [YouTube Link](https://youtube.com/watch?v=-_aIROeFr_8) 2025-03-10T18:29Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Features Trends and Direction his video helps you understand what the myriad of Apache Spark services are and why are they needed. The goal is to demystify Spark so you are less overwhelmed. Don't Panic It actually makes sense. Support me on Patreon: https://www.patreon.com/join/clouddatatrek Slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_40_SparkServicesAndConcepts.zip Data Lakehouse Series https://www.youtube.com/playlistlist=PL7_h0bRfL52pOai_ih3HSu2WCgPXmNHzH Hive Metastore" [YouTube Link](https://youtube.com/watch?v=9YJby_COOdc) 2024-11-08T13:19Z 48.7K followers, [----] engagements "Understanding Microsoft Fabric - Video [--] Fabric is Microsoft's new self service data analytics and AI platform. To be proficient in Fabric you need to understand it's architecture services key concepts and terminology. In this my first video in this series I walk through the Fabric User Interface. In this video I go deeper to give you the foundation you need. Support Me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/Fabric/Fabric2/UnderstandingFabric.pdf Using the Fabric User Interface https://youtu.be/NiexQXuZbos Playlist on Delta" [YouTube Link](https://youtube.com/watch?v=eKoxMitRZJc) 2024-10-02T12:28Z 48.7K followers, [----] engagements "Microsoft Fabric: Tour of the User Interface Fabric is Microsoft's new Self Service Data and AI platform. Learn how to navigate the Microsoft Fabric user interface and key concepts. Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Code and Data https://github.com/bcafferky/shared/blob/master/Fabric/FabricUIIntro/FabricIntro.zip" [YouTube Link](https://youtube.com/watch?v=NiexQXuZbos) 2024-09-01T14:15Z 48.7K followers, [----] engagements "Introduction to Scaling Analytics Using DuckDB with Python DuckDB is a free open-source fast and performant singe machine OLAP analytical database that supports the full SQL language. It's Python API is extensive can work with data that does NOT fit into memory and is many times faster than pandas. I predict DuckDB will dominate the landscape soon It is a Game-Changer Supporting Links Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Slides:" [YouTube Link](https://youtube.com/watch?v=6zzsVbpdwQA) 2024-07-30T14:30Z 48.7K followers, 10.5K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Understanding Spark SQL (fixed sound) In this video you will learn about Spark SQL the data engineering powerhouse inside Apache Spark. Spark SQL not only supports a rich implementation of Structured Query Language but provides query optimizations that make it the most performant way to write applications. Python R and Scala rely on this to perform well in parallel. Support me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists https://www.youtube.com/@BryanCafferky/playlists Slides Available at" [YouTube Link](https://youtube.com/watch?v=ZzS6fzUUia4) 2024-07-10T19:29Z 48.7K followers, [----] engagements "What to Learn for Your Career Path The most common question I get asked is "What do I need to learn" related to a given career path like Data Engineer Data Scientist Data Analyst or other role. The answer is simpler than you may think. Join me as I resolve this question and put you on the right path. Support me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists https://www.youtube.com/@BryanCafferky/playlists Slides from this Video https://github.com/bcafferky/shared/blob/master/WhatToLearn/WhatToLearn.pdf" [YouTube Link](https://youtube.com/watch?v=bTQten5T53g) 2024-07-02T14:55Z 48.7K followers, [----] engagements "About My Channel In the digital age people are confused by the myriad of complex technologies. My channel is all about taking complex things breaking them down and making them simple to understand. Once you have that the rest is easy. Let me tell you about what my channel is about and why you should subscribe. My Playlists https://www.youtube.com/@BryanCafferky/playlists Master Databricks & Apache Spark https://www.youtube.com/watchv=ChISx0-cMpU&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Master Python & SQL https://www.youtube.com/watchv=xY54Emo8rQM&list=PL7_h0bRfL52oWNfE0GhwbnNjeJSmf8Q35" [YouTube Link](https://youtube.com/watch?v=rT4fUHchz5I) 2024-06-25T17:44Z 48.7K followers, [----] engagements "Quick Review of the Best App Dev Tools & Services Whether you want to showcase your data analytics skills or just create a cool app you'll need an app development tool. There's a lot of tools out there to build and deploy web and mobile apps but which are the best i.e. easiest to use maintain and deploy With a focus on data centric apps I'll review my favorites and discuss the pros and cons of the runner ups. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/AppDevTools/AppDevToolsOverview.pdf My Playlist About Streamlit" [YouTube Link](https://youtube.com/watch?v=hP6rVCo0-QQ) 2024-06-17T12:06Z 48.7K followers, [---] engagements "Master Databricks and Apache Spark Step by Step: Series Update - What's Changed Since this series was uploaded Databricks has added a lot of powerful new services and enhanced existing services. In this video I will give a summary of what has changed since I uploaded the series. Spoiler Alert The series is still valid and an ideal jump start on Databricks and Apache Spark. Watch the video to understand why. Databricks Apache Spark Databricks Apache Spark" [YouTube Link](https://youtube.com/watch?v=tvee297UT1E) 2024-05-29T15:17Z 48.7K followers, [----] engagements "Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Hardware Following up on Databricks Performance Tuning with the best place to start: allocating Spark clusters. If you don't allocate sufficient resources nothing else will fix the problem. How many nodes How large should the driver and workers be Do you need GPUs or CPUs Should you use Photon These and many more questions will be covered in detail. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides" [YouTube Link](https://youtube.com/watch?v=hLOpfxpgc70) 2024-05-09T16:39Z 48.7K followers, [----] engagements "Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Architecture A popular interview question and a critical topic for all Databricks and Spark developers how do you tune and optimize Spark queries This video provides a conceptual understanding of where things can go wrong as a starting point to understanding performance tuning and optimization. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/DatabricksPerfTuning/lesson01_DatabricksPerfTuningIntro.pdf" [YouTube Link](https://youtube.com/watch?v=KG2RzvtJ-eg) 2024-03-18T15:34Z 48.7K followers, [----] engagements "Master Dimensional Modeling Lesson [--] - The [--] Step Process Dimensional Modeling is the process of developing The Star Schema a popular and effective way to organize your data to maximize business value. In this video you will learn about the [--] steps in the Dimensional Modeling process. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDimensionalModeling/lesson_02/lesson02_DimModelingSteps01.pdf Understanding Dimensional Modeling https://www.youtube.com/watchv=lWPiSZf7-uQ&t=1476s Databricks Blog: Dimensional Modeling" [YouTube Link](https://youtube.com/watch?v=ccA6r4_DF3o) 2024-03-08T13:21Z 48.7K followers, 11.5K engagements "Master Dimensional Modeling Lesson [--] - Why Use a Dimensional Model Dimensional Modeling is a popular and effective way to organize your data to maximize business value. In this video you will learn what a Dimensional Model aka a Star Schema is and why you should use them to organize your data warehouse. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDimensionalModeling/lesson_01/DimModelingWhy_lesson01.pdf Understanding Dimensional Modeling https://www.youtube.com/watchv=lWPiSZf7-uQ&t=1476s Should You Use a Data" [YouTube Link](https://youtube.com/watch?v=CZM__QtHCB0) 2024-03-01T15:22Z 48.7K followers, 34.3K engagements "Data Architecture vs. Data Engineering Deep Dive Are you an aspiring Data Architect Join me as I explain what Data Architecture is and what Data Engineering is with in-depth explanations and examples. I draw on decades of experience as a Data Engineer and Data Architect to give you time tested advice and best practices. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataArchitecture/DataArchVsDataEng/DataArchitectureVsDataEngSlides.pdf data architecture data engineering data architecture data engineering" [YouTube Link](https://youtube.com/watch?v=cI2dYnM5Kzo) 2024-02-22T16:24Z 48.7K followers, [----] engagements "Master Data Workload Automation: Introduction Automating your data workloads is essential in today's mission critical data driven businesses but what is the best way to do it There are two basic choices: job schedulers and data orchestrators. I'll explain what they are review some examples and explain when to use each. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataLoadAutomation/lesson01/SchedulersVsOrch.pdf Video about Airflow https://www.youtube.com/watchv=lVS6lz5wuH4&t=1s Playlist on Azure" [YouTube Link](https://youtube.com/watch?v=pR3TPlmpf_A) 2024-01-25T12:08Z 48.7K followers, [----] engagements "Streamlit for Dummies: Lesson [--] - Using Advanced Features This video builds on lesson [--] by using Streamlit's advanced features like state management layout control animations and more. Using these features is crucial to building professional apps. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Code: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson03/lesson03.zip My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA My Streamlit Introduction: Lesson [--] https://youtu.be/__fwMqh-2WA Streamlit docs: https://streamlit.io/" [YouTube Link](https://youtube.com/watch?v=NXXOtUqOAHo) 2024-01-15T14:03Z 48.7K followers, [----] engagements "Streamlit for Dummies: Lesson [--] - Writing Your First App Streamlit is a fun and easy way to create interactive web apps in Python. In this video I show you how to code a simple Streamlit app i.e. a game. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Code: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson02/lesson02_basic.py My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA My Streamlit Introduction: Lesson [--] https://youtu.be/__fwMqh-2WA Streamlit docs: https://streamlit.io/" [YouTube Link](https://youtube.com/watch?v=k6Neh9MSDFU) 2023-12-22T12:47Z 48.7K followers, [----] engagements "Python Streamlit for Dummies Streamlit is a fun and easy way to create interactive web apps in Python. Join me as I explain how you can get started using this powerful framework to have fun build a data analytics online work portfolio and add a valuable skill to your resume. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson01/StreamlitForDummies.pdf Streamlit docs: https://streamlit.io/ My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA Deploying a Streamlit App to" [YouTube Link](https://youtube.com/watch?v=__fwMqh-2WA) 2023-11-25T14:59Z 48.7K followers, 14.9K engagements "Python Virtual Environments & The Facts of Life If you develop Python programs you need to use Virtual Environments In this video I'll explain what they are how to use virtual them and The Facts of Life. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Video Slides https://github.com/bcafferky/shared/blob/master/PythonVirtualEnvironments/PythonVirtualEnvs.zip" [YouTube Link](https://youtube.com/watch?v=bjUjNSotYgA) 2023-10-30T18:05Z 48.7K followers, [----] engagements "How and When to Use Databricks Identity Column Databricks added support for Identity Columns similar to the same feature found in relational databases. How do you use it Should you use it How does it differ from Identity columns on relational databases Before you use the Identity Column feature you need to watch this video. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Video Slides https://github.com/bcafferky/shared/blob/master/DatabricksIdentityColumn/DatabricksIdentityColumn.pdf Delta Logs Video [--] https://youtu.be/pCH_qNqnms0 Delta Logs Video 2" [YouTube Link](https://youtube.com/watch?v=8npFjnHecpI) 2023-10-13T14:39Z 48.7K followers, [----] engagements "How to Create Databricks Workflows (new features explained) Data Pipeline orchestration is a challenge to effective data engineering yet there is no perfect solution that can meet all needs. However if you are using Databricks then the Workflows service is an excellent answer to this problem. In this video I'll explain what workflows are when and how to use them and discuss powerful new features added to this service See my YouTube video content guide: https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/ Support Me on Patreon Community and Watch this Video without Ads" [YouTube Link](https://youtube.com/watch?v=TAg2u5jKvrk) 2023-10-01T13:29Z 48.7K followers, 25.8K engagements "Introduction to my Online Guide to my YouTube Videos To help my viewers find my content I created an online guide which makes it a snap to find the playlists and videos you need. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Online Guide Link https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/" [YouTube Link](https://youtube.com/watch?v=McEI67S7p-M) 2023-09-11T13:50Z 48.7K followers, [---] engagements "Should You Use Databricks Delta Live Tables Delta Live Tables (DLT) is Databricks new declarative framework to build reliable maintainable and testable data processing pipelines. It is a big deal and loaded with functionality. If you are overwhelmed developing and maintaining Databricks ETL pipelines you need to consider Delta Live Tables. In this short video I discuss critical things to consider to determine if DLT is right for your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides:" [YouTube Link](https://youtube.com/watch?v=pASZmKNiDDI) 2023-09-06T13:05Z 48.7K followers, 10.4K engagements "Scale Up Your Databricks Coding with Databricks AI Assistant Databricks AI Assistant is a new intelligent helper in performing coding tasks. It's "Wicked Smart". Think ChatGPT for Databricks. This video will demonstrate how to enable and use the Assistant review its pros and cons and advise you on things to consider when implementing the Assistant in your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Databricks Notebook in dbc format):" [YouTube Link](https://youtube.com/watch?v=FoxYdvD-Nok) 2023-08-24T12:08Z 48.7K followers, [----] engagements "Core Databricks: Understand the Hive Metastore A core part of the Databricks ecosystem is the Hive Metastore which enables Spark SQL. But how does Hive work and how do you use it How does Hive relate to the new Unity Catalog Join me as I answer these questions and more. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides data and code (Databricks Notebook in dbc format): https://github.com/bcafferky/shared/blob/master/DatabricksHive/DatabrickHive.zip" [YouTube Link](https://youtube.com/watch?v=cw54hfU2Ce0) 2023-08-16T12:11Z 48.7K followers, 26.2K engagements "Python Pro Understand Variable Scopes To become a professional Python programmer you need to understand the underlying architecture and how it works to run your code. Central to this is how Python defines object namespaces and scopes that it uses to create and locate object references in other words your variables functions and classes. Know this and you will be a better developer and ahead of the rest of the crowd Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Jupyter Notebook):" [YouTube Link](https://youtube.com/watch?v=VV8j7ItoirQ) 2023-08-07T13:14Z 48.7K followers, [----] engagements "Creating Decorators on Steroids: Adding Custom Parameters Function decorators are a flexible way to add behavior to existing functions without changing them. In this video I'll show you how to make your decorators much more powerful by adding your own custom parameters. In may last video I explain how to create and use function decorators. See it at https://youtu.be/yiKk8hm7d2c Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Demo Jupyter Notebook available at:" [YouTube Link](https://youtube.com/watch?v=wC-ywIPewtM) 2023-07-26T12:07Z 48.7K followers, [---] engagements "Python for Data Engineers: Using Function Decorators Function decorators are like inheritance for Python functions. They let you easily add functionality to existing functions without changing the decorated function. And they are used in many popular Python frameworks including Django Flask and even Databricks. Learn what decorators are how to use them and how to write your own Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Demo Jupyter Notebook available at:" [YouTube Link](https://youtube.com/watch?v=yiKk8hm7d2c) 2023-06-15T13:33Z 48.7K followers, [----] engagements "Advanced Python Programming: Using Functions as First Class Objects Learn how to leverage Python functions as objects enabling you to do more with less code and write more scalable and extensible applications. This is the basic of Python decorators used in many popular Python frameworks including Airflow and Django. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Jupyter Notebook Used in the Video: https://github.com/bcafferky/shared/blob/master/PythonAdvanced/FunctionsAsObjects.zip" [YouTube Link](https://youtube.com/watch?v=WIx0rjuAUOs) 2023-06-01T13:43Z 48.7K followers, [----] engagements "How to Build a Delta Live Table Pipeline in Python Delta Live Tables are a new and exciting way to develop ETL pipelines. In this video I'll show you how to build a Delta Live Table Pipeline and explain the gotchas you need to know about. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Useful Links: What is Delta Live Tables https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/ Tutorial on Developing a DLT Pipeline with Python https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/tutorial-python Python DLT Notebook" [YouTube Link](https://youtube.com/watch?v=VgDiP7tYxBY) 2023-05-17T11:52Z 48.7K followers, 21.6K engagements "Why Databricks Delta Live Tables Delta Live Tables are a new and exciting way to develop ETL pipelines but what are they and do you need them Why was this technology created This video answers these questions and more Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DLT_Intro.zip See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp databricks dlt delta live tables Apache Spark databricks dlt delta live tables" [YouTube Link](https://youtube.com/watch?v=BpIc-St0EFY) 2023-05-08T11:35Z 48.7K followers, 22.2K engagements "Understanding Delta File Logs Part [--] - The Deep Dive Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 3rd video in the series completes the explanation of how Delta logs work and how they differ from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs3.zip Uploading Files to" [YouTube Link](https://youtube.com/watch?v=al_E0QFpNlw) 2023-04-16T20:22Z 48.7K followers, [----] engagements "Understanding Delta File Logs Part [--] - Demonstrating Transactions Data Lakehouse is the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 2nd video in the series explores the delta log files and delta lake parquet files using Python code to demonstrate how the logs to work and how they from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at:" [YouTube Link](https://youtube.com/watch?v=ZSTJLfZy_Hs) 2023-03-20T13:11Z 48.7K followers, [----] engagements "Understanding Delta File Logs - The Heart of the Delta Lake Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This video explains how Delta tables use delta logs to make the magic happen. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video" [YouTube Link](https://youtube.com/watch?v=pCH_qNqnms0) 2023-02-24T13:02Z 48.7K followers, 12.4K engagements "Understanding Delta Lake - The Heart of the Data Lakehouse Data Lakehouse is taking the world by storm as the new data warehouse platform In this video I demonstrate how Delta Lake provides the core functionality of the Data Lakehouse and demystify this powerful technology. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s See my" [YouTube Link](https://youtube.com/watch?v=JX9oyM1q26U) 2023-02-13T17:28Z 48.7K followers, [----] engagements "Master Databricks and Apache Spark Step by Step: Using Scala Dataframes & Datasets In this video you learn how to use Scala Spark dataframes and datasets and how to get the most out of them. It's all demonstration and the link to the code is below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Code Available at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_39_Scala_EDA.zip For training on how to create the tables see: https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s" [YouTube Link](https://youtube.com/watch?v=3HooMbk7SF8) 2023-02-07T15:14Z 48.7K followers, [----] engagements "Understanding Data Lakehouse To use a Data Lakehouse you need to understand what it is and the core concepts or you will only be fumbling your way through. This video is the most important in the Data Lakehouse series because it lays the foundation for the others. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDataLakehouse.pdf See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp" [YouTube Link](https://youtube.com/watch?v=o355DPyN348) 2023-01-23T20:46Z 48.7K followers, 10.3K engagements "Estimating Azure Costs with the Azure Pricing Calculator Everyone asks me how do I estimates my Azure costs and avoid getting hit with unexpected charges Use the tool Microsoft sales people use The Azure Pricing Calculator. I'll show you how. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp finances costs expenses Azure Cloud finances costs expenses Azure Cloud" [YouTube Link](https://youtube.com/watch?v=vPLoYHRmQiU) 2023-01-19T15:36Z 48.7K followers, 15.7K engagements "How to Cheaply Use Azure: Saving Money Learn how to save money on Azure and minimize your costs. I will share my tips I learned from my work at Microsoft and from my experience using Azure to test code for my videos and books. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Slides Available at: https://github.com/bcafferky/shared/tree/master/CheapAzure" [YouTube Link](https://youtube.com/watch?v=NhqLicMOS5s) 2023-01-09T15:07Z 48.7K followers, [----] engagements "Data Lakehouse: An Introduction What is the Data Lakehouse and why is it so important In this first video of a series we look at how the Data Lakehouse compares to the traditional SQL data warehouse where is meets or exceeds that functionality and where it is still lacking. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DataLakehouse.zip You need to unzip the file and import the notebook into Databricks to run the code. See my complete Databricks" [YouTube Link](https://youtube.com/watch?v=Muyq3qtHzzo) 2022-11-30T20:24Z 48.7K followers, 30.5K engagements "Master Databricks and Apache Spark Step by Step: Lesson [--] - Creating the SQL Tables on Databricks In this video you will learn about the project use case its data and how to create and load the Spark SQL tables you'll need from the CSV files provided. This video lays the foundations for the ones that follow so make sure you watch it and create your own database. Note: Video was re-edited to improve sound and uploaded again. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at:" [YouTube Link](https://youtube.com/watch?v=1BNO8Syj8UY) 2022-10-24T12:51Z 48.7K followers, 15.2K engagements "Master Databricks and Apache Spark Step by Step: Series Overview This video introduces a training series on Databricks and Apache Spark in parallel. You'll learn both platforms in-depth while we create an analytics solution. Databricks runs on top of Spark and this series will take you from Padawan to Jedi Knight. Edited video on 2022-10-16 to improve sound and reduce length. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Content available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Follow me on Twitter" [YouTube Link](https://youtube.com/watch?v=ChISx0-cMpU) 2022-10-17T00:57Z 48.7K followers, 91K engagements "Succeeding in Technical Sales: The Most Important Secret Technical sales is a hot and lucrative career but you need to know how to succeed In this video I'll share the most important secret to success. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/TechnicalSales/TechSales1.zip Follow me on Twitter @BryanCafferky" [YouTube Link](https://youtube.com/watch?v=r1YBcpdjuSo) 2022-10-12T11:51Z 48.7K followers, [---] engagements "The Hot Technology You Need to Learn Find out what hot new technologies you need to learn in Data Analytics Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/TheTechYouNeedToKnow/TheTechYouNeedToKnow.zip Don't Use Apache Airflow Video https://www.youtube.com/watchv=YQ056EKzCyw&t=858s data analytics technology programming data engineering data analytics technology programming data engineering" [YouTube Link](https://youtube.com/watch?v=aU02yB1ZVJs) 2022-09-16T17:44Z 48.7K followers, [----] engagements "Apache Airflow Architecture [---] Apache Airflow is a popular open-source Linux and Python based workflow engine. Before you jump in and start using it there are some things you need to know. In this video I explain the Airflow architecture: the good the bad and the ugly so you can decide where and when to use it. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflowArch/AirFlow_Architecture.pdf Video: Don't Use Apache Airflow https://youtu.be/YQ056EKzCyw Follow me on Twitter" [YouTube Link](https://youtube.com/watch?v=lVS6lz5wuH4) 2022-09-06T20:03Z 48.7K followers, 21.2K engagements "Master Using SQL with Python: Lesson [--] - Using SQLite Studio SQLite is a robust and lightweight database management system built into Python. SQLite Studio is a visual interface into SQLite databases and lets you query and modify database objects. I'll show you how to install and use SQLite Studio and explain how it can work with Python to provide a complete data analysis platform Newly edited to improve audio and shorten the the run time. Python SQL SQLite SQLite Studio Python SQL SQLite SQLite Studio" [YouTube Link](https://youtube.com/watch?v=e2B_dOA3rEI) 2022-08-08T14:08Z 48.7K followers, [----] engagements Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing
@bryancafferky Bryan CafferkyBryan Cafferky posts on YouTube about databricks, community, watch, how to the most. They currently have [------] followers and [---] posts still getting attention that total [---] engagements in the last [--] hours.
Social category influence technology brands social networks stocks finance fashion brands
Social topic influence databricks #61, community, watch, how to, apache, azure, python, delta, youtube, step
Top accounts mentioned or mentioned by @bryancafferkyplaylists
Top assets mentioned Microsoft Corp. (MSFT)
Top posts by engagements in the last [--] hours
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Introduction In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Slides and Other Content when Applicable available at: https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Databricks Spark data science machine learning Python SQL"
YouTube Link 2021-11-15T19:45Z 48.7K followers, 161.5K engagements
"Intro to Python Dask: Easy Big Data Analytics with Pandas In this video you will learn how to use Dask a Python module that enables pandas code to run in parallel on your local machine or scaled out to multiple machines. No dataframe or numpy size limits and super-fast execution. Just pip install and go It's that easy Does it really work Find out Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook with Code at: https://github.com/bcafferky/shared/blob/master/Dask/DaskIntro.zip See my Master Databricks and"
YouTube Link 2022-01-04T14:40Z 48.7K followers, 17.8K engagements
"Master Databricks and Apache Spark Step by Step: Using Scala Dataframes & Datasets In this video you learn how to use Scala Spark dataframes and datasets and how to get the most out of them. It's all demonstration and the link to the code is below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Code Available at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_39_Scala_EDA.zip For training on how to create the tables see: https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s"
YouTube Link 2023-02-07T15:14Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Series Overview This video introduces a training series on Databricks and Apache Spark in parallel. You'll learn both platforms in-depth while we create an analytics solution. Databricks runs on top of Spark and this series will take you from Padawan to Jedi Knight. Edited video on 2022-10-16 to improve sound and reduce length. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Content available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Follow me on Twitter"
YouTube Link 2022-10-17T00:57Z 48.7K followers, 91K engagements
"Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Architecture A popular interview question and a critical topic for all Databricks and Spark developers how do you tune and optimize Spark queries This video provides a conceptual understanding of where things can go wrong as a starting point to understanding performance tuning and optimization. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/DatabricksPerfTuning/lesson01_DatabricksPerfTuningIntro.pdf"
YouTube Link 2024-03-18T15:34Z 48.7K followers, [----] engagements
"Master Databricks 2nd Ed: Lesson [--] - Use Databricks for Free In this video you will learn how to get the Databricks service for free so you can learn at your leisure. What's the catch What are the limitations How do I sign up All this is explained in the video. Get Databricks for Free here https://www.databricks.com/learn/free-edition Databricks Free Edition Limitations https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-edition-limitations Get Free Databricks Training https://docs.databricks.com/aws/en/getting-started/free-training"
YouTube Link 2026-01-28T13:36Z 48.7K followers, [---] engagements
"Don't Use Apache Airflow Apache Airflow is touted as the answer to all your data movement and transformation problems but is it In this video I explain what Airflow is why it is not the answer for most data movement and transformation needs and provide some better options. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflow/AirFlow_DoNotUse.pdf Follow me on Twitter @BryanCafferky Follow Me on LinkedIn https://www.linkedin.com/in/bryancafferky/"
YouTube Link 2022-01-18T14:52Z 48.7K followers, 121.7K engagements
"Apache Airflow Architecture [---] Apache Airflow is a popular open-source Linux and Python based workflow engine. Before you jump in and start using it there are some things you need to know. In this video I explain the Airflow architecture: the good the bad and the ugly so you can decide where and when to use it. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflowArch/AirFlow_Architecture.pdf Video: Don't Use Apache Airflow https://youtu.be/YQ056EKzCyw Follow me on Twitter"
YouTube Link 2022-09-06T20:03Z 48.7K followers, 21.2K engagements
"Should You Use Databricks Delta Live Tables Delta Live Tables (DLT) is Databricks new declarative framework to build reliable maintainable and testable data processing pipelines. It is a big deal and loaded with functionality. If you are overwhelmed developing and maintaining Databricks ETL pipelines you need to consider Delta Live Tables. In this short video I discuss critical things to consider to determine if DLT is right for your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides:"
YouTube Link 2023-09-06T13:05Z 48.7K followers, 10.4K engagements
"Master Using SQL with Python: Lesson [--] - Using Enterprise Databases with ODBC In this third part of the series you learn how to query production scale database systems like SQL Server Oracle PostgreSQL and MySQL using pyodbc and Pandas. This takes a bit more work than the prior methods but gives the most power and flexibility. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook and Data https://github.com/bcafferky/shared/blob/master/PythonSQL/PythonSQLLesson3.zip python data analysis anlaytics sql T-SQL"
YouTube Link 2019-07-19T16:32Z 48.7K followers, 15.5K engagements
"Master Databricks 2nd Ed: Lesson [--] - Introduction This is a 2nd edition with updated content of my popular YouTube series Master Databricks & Apache Spark. In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. I'll also talk about many of the services Databricks offers and what they do. You will learn how Spark is bare bones whereas Databricks is a full data and AI development platform. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon"
YouTube Link 2025-03-10T18:29Z 48.7K followers, [----] engagements
"Azure Databricks with R: Deep Dive Azure Databricks is Microsoft first class Big Data Machine Learning cloud serviced based on Spark. In this video we'll explain how to use the R programming language with Databricks. Bring your popcorn. Slide and code at: https://github.com/bcafferky/shared"
YouTube Link 2023-10-23T19:49Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Saving Query Results to Tables on Spark In this video you learn how to query Spark tables with SQL and how to save the results permanently to tables which is a great way to build a platform of data for future analysis and ML pipelines. This video demonstrates using open-source Apache Spark via Zeppelin Notebook. Get Master Azure Databricks Step by Step at"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Creating the SQL Tables on Databricks In this video you will learn about the project use case its data and how to create and load the Spark SQL tables you'll need from the CSV files provided. This video lays the foundations for the ones that follow so make sure you watch it and create your own database. Note: Video was re-edited to improve sound and uploaded again. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at:"
YouTube Link 2022-10-24T12:51Z 48.7K followers, 15.2K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Intro to the New pandas UDFs Spark [---] launched a new way to code traditional Python User Defined Functions (UDF) and added a new pandas UDF API that leverages Apache Arrow to get highly performant execution. This video explains the important concepts you need to understand to use this powerful new feature. Slides at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_26_PySpark_Intor_new_pandas_udfs.zip Blog on using SQL Aggregate functions from PySpark"
YouTube Link 2023-10-23T18:54Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Window Functions In this video you learn how to use Spark Structured Query Language (SQL) window functions. Spark SQL is the most performant way to do data engineering on Databricks and window functions expand SQL functionality to include things like cumulative totals ranking values and including aggregations alongside detail rows. They can save you a lot of work. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get my book Master Azure Databricks Step by Step at"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Introduction to Scaling Analytics Using DuckDB with Python DuckDB is a free open-source fast and performant singe machine OLAP analytical database that supports the full SQL language. It's Python API is extensive can work with data that does NOT fit into memory and is many times faster than pandas. I predict DuckDB will dominate the landscape soon It is a Game-Changer Supporting Links Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Slides:"
YouTube Link 2024-07-30T14:30Z 48.7K followers, 10.5K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Features Trends and Direction his video helps you understand what the myriad of Apache Spark services are and why are they needed. The goal is to demystify Spark so you are less overwhelmed. Don't Panic It actually makes sense. Support me on Patreon: https://www.patreon.com/join/clouddatatrek Slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_40_SparkServicesAndConcepts.zip Data Lakehouse Series https://www.youtube.com/playlistlist=PL7_h0bRfL52pOai_ih3HSu2WCgPXmNHzH Hive Metastore"
YouTube Link 2024-11-08T13:19Z 48.7K followers, [----] engagements
"Why Databricks Delta Live Tables Delta Live Tables are a new and exciting way to develop ETL pipelines but what are they and do you need them Why was this technology created This video answers these questions and more Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DLT_Intro.zip See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp databricks dlt delta live tables Apache Spark databricks dlt delta live tables"
YouTube Link 2023-05-08T11:35Z 48.7K followers, 22.2K engagements
"Scale Up Your Databricks Coding with Databricks AI Assistant Databricks AI Assistant is a new intelligent helper in performing coding tasks. It's "Wicked Smart". Think ChatGPT for Databricks. This video will demonstrate how to enable and use the Assistant review its pros and cons and advise you on things to consider when implementing the Assistant in your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Databricks Notebook in dbc format):"
YouTube Link 2023-08-24T12:08Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Coding pandas UDFs PySpark pandas user defined functions are custom code you can run in parallel over the cluster nodes getting top performance. Spark [---] launched a new way to code traditional Python User Defined Functions (UDF) (introduced in video 26). This video teaches you how to code the new PySpark pandas user defined functions. Slides at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_27_PySpark_pandas_df_udf.zip Intro to PySpark User Defined Functions Video"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Understanding Delta Lake - The Heart of the Data Lakehouse Data Lakehouse is taking the world by storm as the new data warehouse platform In this video I demonstrate how Delta Lake provides the core functionality of the Data Lakehouse and demystify this powerful technology. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s See my"
YouTube Link 2023-02-13T17:28Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Spark SQL DDL on Spark In this video you will learn how to use Spark SQL Data Definition Language (DDL) on open-source Apache Spark with Zeppelin Notebook. DDL statements create and maintain database objects. This video explains the differences between using Databricks and Apache Spark for SQL DDL. Example Notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_08_AW_SQL_DDL_on_Spark.zip You need to unzip the file and import the notebook into Zeppelin - explained in the video"
YouTube Link 2021-03-01T15:59Z 43K followers, 13.1K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Saving Query Results to Tables In this video you learn how to query Spark tables with SQL and how to save the results permanently to tables which is a great way to build a platform of data for future analysis and ML pipelines. Get Master Azure Databricks Step by Step at https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_1crid=3U9U5QGUAZISS&dchild=1&keywords=master+azure+databricks+step+by+step&qid=1616409819&sprefix=master+azure+%2Caps%2C150&sr=8-1 Example Notebook for lesson [--] and [--] at:"
YouTube Link 2021-03-22T10:53Z 43K followers, 11.6K engagements
"Master Databricks & Apache Spark Step by Step: Lesson [--] - Using The Data Science Process In this video you will learn about the data science process. This series of steps takes you from project inception to completion. You'll need this to do your own projects and we'll be following this structure for the rest of this series. Master Azure Databricks Step By Step https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_3dchild=1&keywords=master+azure+databricks&qid=1611758195&sr=8-3 Video Slides https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark"
YouTube Link 2021-02-08T18:20Z 43K followers, 23.7K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Create a Databricks Workspace The Databricks workspace is the cloud based environment in which you use Databricks and includes the user interface integrated storage security settings job scheduling and most importantly Databricks notebooks. In this video you will learn how to create a Databricks workspace. Slides available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Video on Getting Databricks Free Community Edition https://www.youtube.com/watchv=lcI1W2_KUPo&t=236s Azure Portal"
YouTube Link 2021-01-18T14:32Z 46.5K followers, 69.4K engagements
"How to Create Databricks Workflows (new features explained) Data Pipeline orchestration is a challenge to effective data engineering yet there is no perfect solution that can meet all needs. However if you are using Databricks then the Workflows service is an excellent answer to this problem. In this video I'll explain what workflows are when and how to use them and discuss powerful new features added to this service See my YouTube video content guide: https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/ Support Me on Patreon Community and Watch this Video without Ads"
YouTube Link 2023-10-01T13:29Z 48.7K followers, 25.8K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Using PySpark Dataframe Methods In this video you learn how to use PySpark dataframes methods on Databricks to perform data analysis and engineering at scale. This is the core of using Python on Spark and you need to learn the power but also the nuances involved. Video demo notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_23_AW_PySpark_Dataframe_Methods_2.zip Apache Spark Zeppelin Notebook link will be posted later. For information on how to upload files to Databricks see:"
YouTube Link 2023-10-23T18:54Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Spark SQL Data Definition Language. In this video you will learn how to use Using Spark SQL Data Definition Language which works the same on Databricks and Spark. DDL statements create and maintain database objects but since Spark is not a database you need to know the differences. Spark SQL is the backbone of data engineering on Spark. Example Notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_07_AW_SQL_DDL.zip You need to unzip the file and import the notebook into Databricks"
YouTube Link 2023-10-24T20:59Z 34K followers, 13.2K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Functions In this video you learn how to use Spark Structured Query Language (SQL) scalar and aggregate functions. Spark SQL is the most performant way to do data engineering on Databricks and Spark and you want to leverage SQL functions as much as possible versus writing custom code. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get my boo Master Azure Databricks Step by Step at"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark Introduction In this video we introduce PySpark and explain important concepts you need to understand to be productive with Python on Spark. Specific questions include Can Python do everything Does it perform well Why you need to know PySpark and more. Link to slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_20_PySpark_Intro.zip Deep Dive Apache Spark Interview with Dan Zafar from Databricks https://www.youtube.com/watchv=zlZ5oWAC2D8&list=PL7_h0bRfL52qJnJrpZc1wJaqrE8yDQmOY PySpark"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Goodbye Koalas: Hello Pandas on Spark In this video you will learn how to use the NEW PySpark pandas API a Python module that enables Python pandas code to run in parallel on Spark clusters with almost no code changes. This replaces the Koalas library as of Spark [---] and Databricks Runtime [----]. Code and Data link below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Notebook and Data"
YouTube Link 2022-01-11T15:38Z 43K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Using Scala What is the Scala programming language and do you need to use it on Databricks and Apache Spark Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky LinkedIn: https://www.linkedin.com/in/bryancafferky/ - mention my channel Video on Enabling Apache Arrow with R: https://www.youtube.com/watchv=m4dGkj5laXo&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp&index=36&t=3s Slides"
YouTube Link 2022-05-27T12:59Z 43K followers, [----] engagements
"Understanding Delta File Logs Part [--] - Demonstrating Transactions Data Lakehouse is the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 2nd video in the series explores the delta log files and delta lake parquet files using Python code to demonstrate how the logs to work and how they from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at:"
YouTube Link 2023-03-20T13:11Z 48.7K followers, [----] engagements
"Data Architecture vs. Data Engineering Deep Dive Are you an aspiring Data Architect Join me as I explain what Data Architecture is and what Data Engineering is with in-depth explanations and examples. I draw on decades of experience as a Data Engineer and Data Architect to give you time tested advice and best practices. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataArchitecture/DataArchVsDataEng/DataArchitectureVsDataEngSlides.pdf data architecture data engineering data architecture data engineering"
YouTube Link 2024-02-22T16:24Z 48.7K followers, [----] engagements
"Core Databricks: Understand the Hive Metastore A core part of the Databricks ecosystem is the Hive Metastore which enables Spark SQL. But how does Hive work and how do you use it How does Hive relate to the new Unity Catalog Join me as I answer these questions and more. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides data and code (Databricks Notebook in dbc format): https://github.com/bcafferky/shared/blob/master/DatabricksHive/DatabrickHive.zip"
YouTube Link 2023-08-16T12:11Z 48.7K followers, 26.2K engagements
"Azure Databricks: A Brief Introduction A short introduction to the Amazing Azure Databricks recently made generally available. Databricks is a Big Data service based on Apache Spark and supports Python R and SQL as well as many machine learning frameworks. This is a friendly introduction to this exciting technology. Learn about it now"
YouTube Link 2018-03-26T20:10Z 42.9K followers, 118.4K engagements
"PowerShell Development: Querying SQL Server A quick code walk through of a custom function that executes queries against a SQL Server database. Includes coverage of key concepts. Code available at: https://github.com/bcafferky/shared/tree/master/PowerShellSQL"
YouTube Link 2019-07-09T16:02Z 47.6K followers, 12.4K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark Using RDDs In this video we use PySpark to analyze data with Resilient Distributed Datasets (RDD). RDDs are the foundation of Spark. You learn what RDDs are what Lazy Evaluation is and why it matters and how to use Transformations and Actions. Everything is demonstrated using a Databricks notebook. Video slides and code at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_21_Using_PySpark_RDDs.zip Apache Spark Transformations Docs"
YouTube Link 2021-06-22T14:04Z 47.1K followers, 12.6K engagements
"Quick Review of the Best App Dev Tools & Services Whether you want to showcase your data analytics skills or just create a cool app you'll need an app development tool. There's a lot of tools out there to build and deploy web and mobile apps but which are the best i.e. easiest to use maintain and deploy With a focus on data centric apps I'll review my favorites and discuss the pros and cons of the runner ups. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/AppDevTools/AppDevToolsOverview.pdf My Playlist About Streamlit"
YouTube Link 2024-06-17T12:06Z 48.7K followers, [---] engagements
"Master Databricks 2nd Ed: Lesson [--] - Understanding Clusters In this video you will learn about Databricks clusters including what they are why they are important how to create one configuration options and a review of how to answer common interview questions about them. Cluster Configuration Options & Best Practices https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices Enable Unity Catalog https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started Request an Increase in Your Compute Quota"
YouTube Link 2025-09-30T18:46Z 48.7K followers, [----] engagements
"Master Databricks 2nd Ed: Lesson [--] - Create the Workspace To use Databricks you need a workspace. In this video I explain what a Databricks workspace is and how to create one. I also tell you how you can use Databricks for free. Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDatabricks_2nd/Lesson_02_2ndEdition_CreateDatabricksWorkspace.pdf Databricks Apache Spark Databricks Apache Spark"
YouTube Link 2025-03-18T15:50Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Parallel Database Queries This video shows you how to read data from a SQL Database from Databricks/Spark using Python using parallel reads so you get back partitioned data. SQL databases are the most popular platform for storing data so you are going to need this in your toolbelt. This video picks up where Lesson [--] left off and provides better performance. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Notebook with Code at:"
YouTube Link 2023-10-20T18:01Z 34K followers, [----] engagements
"How to Create a GUI in Python using Tkinter In this video you will learn how to create a Graphical User Interface (GUI) in Python using the Tkinter built-in library. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Twitter: @BryanCafferky Code: https://github.com/bcafferky/shared/blob/master/PythonGUI/PythonTkinter/PythonGUITkinter1.zip"
YouTube Link 2022-07-11T14:58Z 45.9K followers, 20.5K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Using SQL Joins In this video you learn how to query perform joins using Spark Structured Query Language (SQL). Spark SQL is the most performant way to do data engineering on Databrick and Spark. I'll explain the concepts and demonstrate them with code in a Databricks notebook. Get Master Azure Databricks Step by Step at https://www.amazon.com/Master-Azure-Databricks-Step-ebook/dp/B08JFWCNDF/ref=sr_1_1crid=3U9U5QGUAZISS&dchild=1&keywords=master+azure+databricks+step+by+step&qid=1616409819&sprefix=master+azure+%2Caps%2C150&sr=8-1"
YouTube Link 2023-10-24T20:59Z 34K followers, [----] engagements
"Dimensional Modeling A tutorial on the concepts and practice of Dimensional Modeling the Kimball Method"
YouTube Link 2017-08-22T20:17Z 47.3K followers, 188.6K engagements
"Understanding Delta File Logs - The Heart of the Delta Lake Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This video explains how Delta tables use delta logs to make the magic happen. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video"
YouTube Link 2023-02-24T13:02Z 48.7K followers, 12.4K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - PySpark: Using SQL Aggregate Functions In this video you learn how to use the built-in Spark SQL aggregate functions from Python. This gives you the benefit of good performance and functionality offered by any SQL function all within Python code. Scalar functions can also be used from Python. Video demo notebook at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_25_PySpark_SQL_Agg_Functions.zip For information on how to upload files to Databricks and create tables see:"
YouTube Link 2021-08-25T15:33Z 43K followers, [----] engagements
"Estimating Azure Costs with the Azure Pricing Calculator Everyone asks me how do I estimates my Azure costs and avoid getting hit with unexpected charges Use the tool Microsoft sales people use The Azure Pricing Calculator. I'll show you how. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp finances costs expenses Azure Cloud finances costs expenses Azure Cloud"
YouTube Link 2023-01-19T15:36Z 48.7K followers, 15.7K engagements
"Use Enterprise Relational Databases with R and ODBC To do data analytics R developers often need to get data from their organization's enterprise databases. In this video I'll show you how to use the RODBC package to easily query and even save data back to these databases using SQL Server as an example. If you use R you need to watch this video. Code for this video is available at: https://github.com/bcafferky/shared/tree/master/RSQLODBC"
YouTube Link 2020-12-06T21:24Z 45.5K followers, [----] engagements
"PowerShell Module 1: An Introduction to the CLI and ISE A brief introduction to Windows PowerShell the Command Line Interpreter (CLI) and the Integrated Script Editor ISE). Slides available at https://github.com/bcafferky/shared/tree/master/IntroToPowerShell"
YouTube Link 2017-06-07T18:33Z 46K followers, 17.1K engagements
"About My Channel In the digital age people are confused by the myriad of complex technologies. My channel is all about taking complex things breaking them down and making them simple to understand. Once you have that the rest is easy. Let me tell you about what my channel is about and why you should subscribe. My Playlists https://www.youtube.com/@BryanCafferky/playlists Master Databricks & Apache Spark https://www.youtube.com/watchv=ChISx0-cMpU&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Master Python & SQL https://www.youtube.com/watchv=xY54Emo8rQM&list=PL7_h0bRfL52oWNfE0GhwbnNjeJSmf8Q35"
YouTube Link 2024-06-25T17:44Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Databricks Demo In this video I take you on a tour of the Databricks Workspace showing you each tool explaining its purpose and demonstrating how to use it. Since the Databricks interactive development environment (IDE) is their proprietary notebook I focus a bit more there. This video provides the foundation for later lessons in the series. The data files for this video are available here: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_03.zip Join my Patreon Community and Watch this Video without Ads"
YouTube Link 2021-01-20T13:57Z 48K followers, 64.6K engagements
"Master Databricks 2nd Ed: Lesson [--] - Use Databricks for Free In this video you will learn how to get the Databricks service for free so you can learn at your leisure. What's the catch What are the limitations How do I sign up All this is explained in the video. Get Databricks for Free here https://www.databricks.com/learn/free-edition Databricks Free Edition Limitations https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-edition-limitations Get Free Databricks Training https://docs.databricks.com/aws/en/getting-started/free-training"
YouTube Link 2026-01-28T13:36Z 48.7K followers, [---] engagements
"Master Databricks 2nd Ed: Lesson [--] - Understanding Clusters In this video you will learn about Databricks clusters including what they are why they are important how to create one configuration options and a review of how to answer common interview questions about them. Cluster Configuration Options & Best Practices https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices Enable Unity Catalog https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started Request an Increase in Your Compute Quota"
YouTube Link 2025-09-30T18:46Z 48.7K followers, [----] engagements
"Master Databricks 2nd Ed: Lesson [--] - Create the Workspace To use Databricks you need a workspace. In this video I explain what a Databricks workspace is and how to create one. I also tell you how you can use Databricks for free. Join my Patreon Community https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDatabricks_2nd/Lesson_02_2ndEdition_CreateDatabricksWorkspace.pdf Databricks Apache Spark Databricks Apache Spark"
YouTube Link 2025-03-18T15:50Z 48.7K followers, [----] engagements
"Master Databricks 2nd Ed: Lesson [--] - Introduction This is a 2nd edition with updated content of my popular YouTube series Master Databricks & Apache Spark. In this first lesson you learn about scale-up vs. scale-out Databricks and Apache Spark. I'll also talk about many of the services Databricks offers and what they do. You will learn how Spark is bare bones whereas Databricks is a full data and AI development platform. This video lays the foundation of the series by explaining what Apache Spark and Databricks are. The series will take you from Padawan to Jedi Knight Join me Join my Patreon"
YouTube Link 2025-03-10T18:29Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Features Trends and Direction his video helps you understand what the myriad of Apache Spark services are and why are they needed. The goal is to demystify Spark so you are less overwhelmed. Don't Panic It actually makes sense. Support me on Patreon: https://www.patreon.com/join/clouddatatrek Slides: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_40_SparkServicesAndConcepts.zip Data Lakehouse Series https://www.youtube.com/playlistlist=PL7_h0bRfL52pOai_ih3HSu2WCgPXmNHzH Hive Metastore"
YouTube Link 2024-11-08T13:19Z 48.7K followers, [----] engagements
"Understanding Microsoft Fabric - Video [--] Fabric is Microsoft's new self service data analytics and AI platform. To be proficient in Fabric you need to understand it's architecture services key concepts and terminology. In this my first video in this series I walk through the Fabric User Interface. In this video I go deeper to give you the foundation you need. Support Me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/Fabric/Fabric2/UnderstandingFabric.pdf Using the Fabric User Interface https://youtu.be/NiexQXuZbos Playlist on Delta"
YouTube Link 2024-10-02T12:28Z 48.7K followers, [----] engagements
"Microsoft Fabric: Tour of the User Interface Fabric is Microsoft's new Self Service Data and AI platform. Learn how to navigate the Microsoft Fabric user interface and key concepts. Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Code and Data https://github.com/bcafferky/shared/blob/master/Fabric/FabricUIIntro/FabricIntro.zip"
YouTube Link 2024-09-01T14:15Z 48.7K followers, [----] engagements
"Introduction to Scaling Analytics Using DuckDB with Python DuckDB is a free open-source fast and performant singe machine OLAP analytical database that supports the full SQL language. It's Python API is extensive can work with data that does NOT fit into memory and is many times faster than pandas. I predict DuckDB will dominate the landscape soon It is a Game-Changer Supporting Links Support Me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists: https://www.youtube.com/@BryanCafferky/playlists Slides:"
YouTube Link 2024-07-30T14:30Z 48.7K followers, 10.5K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Understanding Spark SQL (fixed sound) In this video you will learn about Spark SQL the data engineering powerhouse inside Apache Spark. Spark SQL not only supports a rich implementation of Structured Query Language but provides query optimizations that make it the most performant way to write applications. Python R and Scala rely on this to perform well in parallel. Support me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists https://www.youtube.com/@BryanCafferky/playlists Slides Available at"
YouTube Link 2024-07-10T19:29Z 48.7K followers, [----] engagements
"What to Learn for Your Career Path The most common question I get asked is "What do I need to learn" related to a given career path like Data Engineer Data Scientist Data Analyst or other role. The answer is simpler than you may think. Join me as I resolve this question and put you on the right path. Support me on Patreon https://www.patreon.com/bePatronu=63260756 My Playlists https://www.youtube.com/@BryanCafferky/playlists Slides from this Video https://github.com/bcafferky/shared/blob/master/WhatToLearn/WhatToLearn.pdf"
YouTube Link 2024-07-02T14:55Z 48.7K followers, [----] engagements
"About My Channel In the digital age people are confused by the myriad of complex technologies. My channel is all about taking complex things breaking them down and making them simple to understand. Once you have that the rest is easy. Let me tell you about what my channel is about and why you should subscribe. My Playlists https://www.youtube.com/@BryanCafferky/playlists Master Databricks & Apache Spark https://www.youtube.com/watchv=ChISx0-cMpU&list=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Master Python & SQL https://www.youtube.com/watchv=xY54Emo8rQM&list=PL7_h0bRfL52oWNfE0GhwbnNjeJSmf8Q35"
YouTube Link 2024-06-25T17:44Z 48.7K followers, [----] engagements
"Quick Review of the Best App Dev Tools & Services Whether you want to showcase your data analytics skills or just create a cool app you'll need an app development tool. There's a lot of tools out there to build and deploy web and mobile apps but which are the best i.e. easiest to use maintain and deploy With a focus on data centric apps I'll review my favorites and discuss the pros and cons of the runner ups. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/AppDevTools/AppDevToolsOverview.pdf My Playlist About Streamlit"
YouTube Link 2024-06-17T12:06Z 48.7K followers, [---] engagements
"Master Databricks and Apache Spark Step by Step: Series Update - What's Changed Since this series was uploaded Databricks has added a lot of powerful new services and enhanced existing services. In this video I will give a summary of what has changed since I uploaded the series. Spoiler Alert The series is still valid and an ideal jump start on Databricks and Apache Spark. Watch the video to understand why. Databricks Apache Spark Databricks Apache Spark"
YouTube Link 2024-05-29T15:17Z 48.7K followers, [----] engagements
"Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Hardware Following up on Databricks Performance Tuning with the best place to start: allocating Spark clusters. If you don't allocate sufficient resources nothing else will fix the problem. How many nodes How large should the driver and workers be Do you need GPUs or CPUs Should you use Photon These and many more questions will be covered in detail. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides"
YouTube Link 2024-05-09T16:39Z 48.7K followers, [----] engagements
"Understanding Databricks & Apache Spark Performance Tuning: Lesson [--] - Spark Architecture A popular interview question and a critical topic for all Databricks and Spark developers how do you tune and optimize Spark queries This video provides a conceptual understanding of where things can go wrong as a starting point to understanding performance tuning and optimization. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/DatabricksPerfTuning/lesson01_DatabricksPerfTuningIntro.pdf"
YouTube Link 2024-03-18T15:34Z 48.7K followers, [----] engagements
"Master Dimensional Modeling Lesson [--] - The [--] Step Process Dimensional Modeling is the process of developing The Star Schema a popular and effective way to organize your data to maximize business value. In this video you will learn about the [--] steps in the Dimensional Modeling process. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDimensionalModeling/lesson_02/lesson02_DimModelingSteps01.pdf Understanding Dimensional Modeling https://www.youtube.com/watchv=lWPiSZf7-uQ&t=1476s Databricks Blog: Dimensional Modeling"
YouTube Link 2024-03-08T13:21Z 48.7K followers, 11.5K engagements
"Master Dimensional Modeling Lesson [--] - Why Use a Dimensional Model Dimensional Modeling is a popular and effective way to organize your data to maximize business value. In this video you will learn what a Dimensional Model aka a Star Schema is and why you should use them to organize your data warehouse. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/MasterDimensionalModeling/lesson_01/DimModelingWhy_lesson01.pdf Understanding Dimensional Modeling https://www.youtube.com/watchv=lWPiSZf7-uQ&t=1476s Should You Use a Data"
YouTube Link 2024-03-01T15:22Z 48.7K followers, 34.3K engagements
"Data Architecture vs. Data Engineering Deep Dive Are you an aspiring Data Architect Join me as I explain what Data Architecture is and what Data Engineering is with in-depth explanations and examples. I draw on decades of experience as a Data Engineer and Data Architect to give you time tested advice and best practices. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataArchitecture/DataArchVsDataEng/DataArchitectureVsDataEngSlides.pdf data architecture data engineering data architecture data engineering"
YouTube Link 2024-02-22T16:24Z 48.7K followers, [----] engagements
"Master Data Workload Automation: Introduction Automating your data workloads is essential in today's mission critical data driven businesses but what is the best way to do it There are two basic choices: job schedulers and data orchestrators. I'll explain what they are review some examples and explain when to use each. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides available here: https://github.com/bcafferky/shared/blob/master/DataLoadAutomation/lesson01/SchedulersVsOrch.pdf Video about Airflow https://www.youtube.com/watchv=lVS6lz5wuH4&t=1s Playlist on Azure"
YouTube Link 2024-01-25T12:08Z 48.7K followers, [----] engagements
"Streamlit for Dummies: Lesson [--] - Using Advanced Features This video builds on lesson [--] by using Streamlit's advanced features like state management layout control animations and more. Using these features is crucial to building professional apps. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Code: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson03/lesson03.zip My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA My Streamlit Introduction: Lesson [--] https://youtu.be/__fwMqh-2WA Streamlit docs: https://streamlit.io/"
YouTube Link 2024-01-15T14:03Z 48.7K followers, [----] engagements
"Streamlit for Dummies: Lesson [--] - Writing Your First App Streamlit is a fun and easy way to create interactive web apps in Python. In this video I show you how to code a simple Streamlit app i.e. a game. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Code: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson02/lesson02_basic.py My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA My Streamlit Introduction: Lesson [--] https://youtu.be/__fwMqh-2WA Streamlit docs: https://streamlit.io/"
YouTube Link 2023-12-22T12:47Z 48.7K followers, [----] engagements
"Python Streamlit for Dummies Streamlit is a fun and easy way to create interactive web apps in Python. Join me as I explain how you can get started using this powerful framework to have fun build a data analytics online work portfolio and add a valuable skill to your resume. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Slides: https://github.com/bcafferky/shared/blob/master/Streamlit/lesson01/StreamlitForDummies.pdf Streamlit docs: https://streamlit.io/ My Video on Using Python Virtual Environments: https://www.youtube.com/watchv=bjUjNSotYgA Deploying a Streamlit App to"
YouTube Link 2023-11-25T14:59Z 48.7K followers, 14.9K engagements
"Python Virtual Environments & The Facts of Life If you develop Python programs you need to use Virtual Environments In this video I'll explain what they are how to use virtual them and The Facts of Life. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Video Slides https://github.com/bcafferky/shared/blob/master/PythonVirtualEnvironments/PythonVirtualEnvs.zip"
YouTube Link 2023-10-30T18:05Z 48.7K followers, [----] engagements
"How and When to Use Databricks Identity Column Databricks added support for Identity Columns similar to the same feature found in relational databases. How do you use it Should you use it How does it differ from Identity columns on relational databases Before you use the Identity Column feature you need to watch this video. Support me on Patreon https://www.patreon.com/bePatronu=63260756 Video Slides https://github.com/bcafferky/shared/blob/master/DatabricksIdentityColumn/DatabricksIdentityColumn.pdf Delta Logs Video [--] https://youtu.be/pCH_qNqnms0 Delta Logs Video 2"
YouTube Link 2023-10-13T14:39Z 48.7K followers, [----] engagements
"How to Create Databricks Workflows (new features explained) Data Pipeline orchestration is a challenge to effective data engineering yet there is no perfect solution that can meet all needs. However if you are using Databricks then the Workflows service is an excellent answer to this problem. In this video I'll explain what workflows are when and how to use them and discuss powerful new features added to this service See my YouTube video content guide: https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/ Support Me on Patreon Community and Watch this Video without Ads"
YouTube Link 2023-10-01T13:29Z 48.7K followers, 25.8K engagements
"Introduction to my Online Guide to my YouTube Videos To help my viewers find my content I created an online guide which makes it a snap to find the playlists and videos you need. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Online Guide Link https://bpc-global-solutions-llc.gitbook.io/bryan-cafferkys-training-content/"
YouTube Link 2023-09-11T13:50Z 48.7K followers, [---] engagements
"Should You Use Databricks Delta Live Tables Delta Live Tables (DLT) is Databricks new declarative framework to build reliable maintainable and testable data processing pipelines. It is a big deal and loaded with functionality. If you are overwhelmed developing and maintaining Databricks ETL pipelines you need to consider Delta Live Tables. In this short video I discuss critical things to consider to determine if DLT is right for your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides:"
YouTube Link 2023-09-06T13:05Z 48.7K followers, 10.4K engagements
"Scale Up Your Databricks Coding with Databricks AI Assistant Databricks AI Assistant is a new intelligent helper in performing coding tasks. It's "Wicked Smart". Think ChatGPT for Databricks. This video will demonstrate how to enable and use the Assistant review its pros and cons and advise you on things to consider when implementing the Assistant in your organization. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Databricks Notebook in dbc format):"
YouTube Link 2023-08-24T12:08Z 48.7K followers, [----] engagements
"Core Databricks: Understand the Hive Metastore A core part of the Databricks ecosystem is the Hive Metastore which enables Spark SQL. But how does Hive work and how do you use it How does Hive relate to the new Unity Catalog Join me as I answer these questions and more. Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides data and code (Databricks Notebook in dbc format): https://github.com/bcafferky/shared/blob/master/DatabricksHive/DatabrickHive.zip"
YouTube Link 2023-08-16T12:11Z 48.7K followers, 26.2K engagements
"Python Pro Understand Variable Scopes To become a professional Python programmer you need to understand the underlying architecture and how it works to run your code. Central to this is how Python defines object namespaces and scopes that it uses to create and locate object references in other words your variables functions and classes. Know this and you will be a better developer and ahead of the rest of the crowd Support Me on Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Link to slides and code (Jupyter Notebook):"
YouTube Link 2023-08-07T13:14Z 48.7K followers, [----] engagements
"Creating Decorators on Steroids: Adding Custom Parameters Function decorators are a flexible way to add behavior to existing functions without changing them. In this video I'll show you how to make your decorators much more powerful by adding your own custom parameters. In may last video I explain how to create and use function decorators. See it at https://youtu.be/yiKk8hm7d2c Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Demo Jupyter Notebook available at:"
YouTube Link 2023-07-26T12:07Z 48.7K followers, [---] engagements
"Python for Data Engineers: Using Function Decorators Function decorators are like inheritance for Python functions. They let you easily add functionality to existing functions without changing the decorated function. And they are used in many popular Python frameworks including Django Flask and even Databricks. Learn what decorators are how to use them and how to write your own Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Demo Jupyter Notebook available at:"
YouTube Link 2023-06-15T13:33Z 48.7K followers, [----] engagements
"Advanced Python Programming: Using Functions as First Class Objects Learn how to leverage Python functions as objects enabling you to do more with less code and write more scalable and extensible applications. This is the basic of Python decorators used in many popular Python frameworks including Airflow and Django. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Jupyter Notebook Used in the Video: https://github.com/bcafferky/shared/blob/master/PythonAdvanced/FunctionsAsObjects.zip"
YouTube Link 2023-06-01T13:43Z 48.7K followers, [----] engagements
"How to Build a Delta Live Table Pipeline in Python Delta Live Tables are a new and exciting way to develop ETL pipelines. In this video I'll show you how to build a Delta Live Table Pipeline and explain the gotchas you need to know about. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Useful Links: What is Delta Live Tables https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/ Tutorial on Developing a DLT Pipeline with Python https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/tutorial-python Python DLT Notebook"
YouTube Link 2023-05-17T11:52Z 48.7K followers, 21.6K engagements
"Why Databricks Delta Live Tables Delta Live Tables are a new and exciting way to develop ETL pipelines but what are they and do you need them Why was this technology created This video answers these questions and more Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DLT_Intro.zip See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp databricks dlt delta live tables Apache Spark databricks dlt delta live tables"
YouTube Link 2023-05-08T11:35Z 48.7K followers, 22.2K engagements
"Understanding Delta File Logs Part [--] - The Deep Dive Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 3rd video in the series completes the explanation of how Delta logs work and how they differ from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs3.zip Uploading Files to"
YouTube Link 2023-04-16T20:22Z 48.7K followers, [----] engagements
"Understanding Delta File Logs Part [--] - Demonstrating Transactions Data Lakehouse is the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This 2nd video in the series explores the delta log files and delta lake parquet files using Python code to demonstrate how the logs to work and how they from relational database logs. Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at:"
YouTube Link 2023-03-20T13:11Z 48.7K followers, [----] engagements
"Understanding Delta File Logs - The Heart of the Delta Lake Data Lakehouse is taking the world by storm as the new data warehouse platform Delta Lake is the heart of Data Lakehouse and the Delta Logs are the heart of Delta Lake. This video explains how Delta tables use delta logs to make the magic happen. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video"
YouTube Link 2023-02-24T13:02Z 48.7K followers, 12.4K engagements
"Understanding Delta Lake - The Heart of the Data Lakehouse Data Lakehouse is taking the world by storm as the new data warehouse platform In this video I demonstrate how Delta Lake provides the core functionality of the Data Lakehouse and demystify this powerful technology. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Databricks Notebook and Data Files at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDeltaLogs.zip Uploading Files to Databricks Video https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s See my"
YouTube Link 2023-02-13T17:28Z 48.7K followers, [----] engagements
"Master Databricks and Apache Spark Step by Step: Using Scala Dataframes & Datasets In this video you learn how to use Scala Spark dataframes and datasets and how to get the most out of them. It's all demonstration and the link to the code is below. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Code Available at: https://github.com/bcafferky/shared/blob/master/MasterDatabricksAndSpark/Lesson_39_Scala_EDA.zip For training on how to create the tables see: https://www.youtube.com/watchv=wqCCWAa6mFA&t=751s"
YouTube Link 2023-02-07T15:14Z 48.7K followers, [----] engagements
"Understanding Data Lakehouse To use a Data Lakehouse you need to understand what it is and the core concepts or you will only be fumbling your way through. This video is the most important in the Data Lakehouse series because it lays the foundation for the others. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/UnderstandingDataLakehouse.pdf See my Pre Data Lakehouse training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp"
YouTube Link 2023-01-23T20:46Z 48.7K followers, 10.3K engagements
"Estimating Azure Costs with the Azure Pricing Calculator Everyone asks me how do I estimates my Azure costs and avoid getting hit with unexpected charges Use the tool Microsoft sales people use The Azure Pricing Calculator. I'll show you how. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp finances costs expenses Azure Cloud finances costs expenses Azure Cloud"
YouTube Link 2023-01-19T15:36Z 48.7K followers, 15.7K engagements
"How to Cheaply Use Azure: Saving Money Learn how to save money on Azure and minimize your costs. I will share my tips I learned from my work at Microsoft and from my experience using Azure to test code for my videos and books. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 See my complete Databricks training series at: https://www.youtube.com/playlistlist=PL7_h0bRfL52qWoCcS18nXcT1s-5rSa1yp Slides Available at: https://github.com/bcafferky/shared/tree/master/CheapAzure"
YouTube Link 2023-01-09T15:07Z 48.7K followers, [----] engagements
"Data Lakehouse: An Introduction What is the Data Lakehouse and why is it so important In this first video of a series we look at how the Data Lakehouse compares to the traditional SQL data warehouse where is meets or exceeds that functionality and where it is still lacking. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at: https://github.com/bcafferky/shared/blob/master/DataLakehouse/DataLakehouse.zip You need to unzip the file and import the notebook into Databricks to run the code. See my complete Databricks"
YouTube Link 2022-11-30T20:24Z 48.7K followers, 30.5K engagements
"Master Databricks and Apache Spark Step by Step: Lesson [--] - Creating the SQL Tables on Databricks In this video you will learn about the project use case its data and how to create and load the Spark SQL tables you'll need from the CSV files provided. This video lays the foundations for the ones that follow so make sure you watch it and create your own database. Note: Video was re-edited to improve sound and uploaded again. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Example Slides & Notebook at:"
YouTube Link 2022-10-24T12:51Z 48.7K followers, 15.2K engagements
"Master Databricks and Apache Spark Step by Step: Series Overview This video introduces a training series on Databricks and Apache Spark in parallel. You'll learn both platforms in-depth while we create an analytics solution. Databricks runs on top of Spark and this series will take you from Padawan to Jedi Knight. Edited video on 2022-10-16 to improve sound and reduce length. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Content available at https://github.com/bcafferky/shared/tree/master/MasterDatabricksAndSpark Follow me on Twitter"
YouTube Link 2022-10-17T00:57Z 48.7K followers, 91K engagements
"Succeeding in Technical Sales: The Most Important Secret Technical sales is a hot and lucrative career but you need to know how to succeed In this video I'll share the most important secret to success. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/TechnicalSales/TechSales1.zip Follow me on Twitter @BryanCafferky"
YouTube Link 2022-10-12T11:51Z 48.7K followers, [---] engagements
"The Hot Technology You Need to Learn Find out what hot new technologies you need to learn in Data Analytics Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/TheTechYouNeedToKnow/TheTechYouNeedToKnow.zip Don't Use Apache Airflow Video https://www.youtube.com/watchv=YQ056EKzCyw&t=858s data analytics technology programming data engineering data analytics technology programming data engineering"
YouTube Link 2022-09-16T17:44Z 48.7K followers, [----] engagements
"Apache Airflow Architecture [---] Apache Airflow is a popular open-source Linux and Python based workflow engine. Before you jump in and start using it there are some things you need to know. In this video I explain the Airflow architecture: the good the bad and the ugly so you can decide where and when to use it. Join my Patreon Community and Watch this Video without Ads https://www.patreon.com/bePatronu=63260756 Slides https://github.com/bcafferky/shared/blob/master/ApacheAirflowArch/AirFlow_Architecture.pdf Video: Don't Use Apache Airflow https://youtu.be/YQ056EKzCyw Follow me on Twitter"
YouTube Link 2022-09-06T20:03Z 48.7K followers, 21.2K engagements
"Master Using SQL with Python: Lesson [--] - Using SQLite Studio SQLite is a robust and lightweight database management system built into Python. SQLite Studio is a visual interface into SQLite databases and lets you query and modify database objects. I'll show you how to install and use SQLite Studio and explain how it can work with Python to provide a complete data analysis platform Newly edited to improve audio and shorten the the run time. Python SQL SQLite SQLite Studio Python SQL SQLite SQLite Studio"
YouTube Link 2022-08-08T14:08Z 48.7K followers, [----] engagements
Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing
/creator/youtube::bryancafferky