Invidious
Mr. K Talks Tech
Subscribe | 32K
 RSS

Hello Everyone,

Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"

I will be creating playlist which covers the below topics (with DEMO)

1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,

1. Data Engineer
2. Data Analyst and
3. Data Scientist

Can't wait to help people with my videos. Stay tuned!

For contact:

Email: mrktalkstech@gmail.com

View channel on YouTube
Switch Invidious Instance
Videos
Shorts
Playlists
Posts

Mr. K Talks Tech

The Most Realistic Way to Prepare for a Data Engineer Interview!

1 week ago | [YT] | 3

View 0 replies

Mr. K Talks Tech

What is your preferred tool for ETL right now?

1 week ago | [YT] | 4

View 2 replies

Mr. K Talks Tech

7๏ธโƒฃ 0๏ธโƒฃ ๐†๐š๐ฆ๐ž-๐‚๐ก๐š๐ง๐ ๐ข๐ง๐  ๐„๐“๐‹ ๐“๐จ๐จ๐ฅ๐ฌ ๐„๐ฏ๐ž๐ซ๐ฒ ๐ƒ๐š๐ญ๐š ๐„๐ง๐ ๐ข๐ง๐ž๐ž๐ซ ๐’๐ก๐จ๐ฎ๐ฅ๐ ๐Š๐ง๐จ๐ฐ ๐€๐›๐จ๐ฎ๐ญ!

ETL (Extract, Transform, Load) is a vital part of data engineering. Whether you're building a modern data pipeline or optimizing your data workflows, having the right tools in your arsenal is crucial.

I've compiled a comprehensive list of 70 must-know ETL toolsโ€”covering everything from legacy giants to cutting-edge open-source solutions. This document is designed to help data engineers of all levels explore the best tools for their needs.

๐Ÿ” ๐–๐ก๐š๐ญ ๐ฒ๐จ๐ฎโ€™๐ฅ๐ฅ ๐Ÿ๐ข๐ง๐:
โœ… Tools tailored for big data processing
โœ… Cloud-native ETL platforms
โœ… Open-source solutions for cost-effective pipelines
โœ… Specialized tools for niche use cases

Whether youโ€™re a beginner looking to get started or a seasoned expert staying ahead of the curve, this list has something for everyone.

Drop a ๐Ÿ‘, share and comment below if you found it useful. You can view the full PDF from the link below,

www.linkedin.com/feed/update/urn:li:activity:72782โ€ฆ

#DataEngineering #ETLTools #Azure #AWS #GCP #ETL

8 months ago (edited) | [YT] | 18

View 5 replies

Mr. K Talks Tech

Dear Data Engineers ๐Ÿ”ฅ

Ready for a PySpark transformation challenge?

๐ˆ๐ง๐Ÿ๐จ:

You have a DataFrame containing a list of transactions for each user. Your task is to calculate the total amount spent by each user.

๐‚๐ซ๐ž๐š๐ญ๐ž ๐’๐š๐ฆ๐ฉ๐ฅ๐ž ๐ƒ๐š๐ญ๐š๐Ÿ๐ซ๐š๐ฆ๐ž (Input Data):

๐˜ฅ๐˜ข๐˜ต๐˜ข = [
(1, [{"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 45}, {"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 60}]),
(2, [{"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 30}, {"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 20}]),
(3, [{"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 120}, {"๐˜ข๐˜ฎ๐˜ฐ๐˜ถ๐˜ฏ๐˜ต": 80}])
]
๐˜ฅ๐˜ง = ๐˜ด๐˜ฑ๐˜ข๐˜ณ๐˜ฌ.๐˜ค๐˜ณ๐˜ฆ๐˜ข๐˜ต๐˜ฆ๐˜‹๐˜ข๐˜ต๐˜ข๐˜๐˜ณ๐˜ข๐˜ฎ๐˜ฆ(๐˜ฅ๐˜ข๐˜ต๐˜ข, ["๐˜ถ๐˜ด๐˜ฆ๐˜ณ_๐˜ช๐˜ฅ", "๐˜ต๐˜ณ๐˜ข๐˜ฏ๐˜ด๐˜ข๐˜ค๐˜ต๐˜ช๐˜ฐ๐˜ฏ๐˜ด"])

๐๐ฒ๐’๐ฉ๐š๐ซ๐ค ๐“๐ซ๐š๐ง๐ฌ๐Ÿ๐จ๐ซ๐ฆ๐š๐ญ๐ข๐จ๐ง ๐‚๐จ๐๐ž? (Expected Data)

Let me know the answer in the comments section ๐Ÿ˜€


#pyspark #dataengineering

11 months ago | [YT] | 22

View 7 replies

Mr. K Talks Tech

๐ŸŽ‰ 20,000 ๐’๐ฎ๐›๐ฌ๐œ๐ซ๐ข๐›๐ž๐ซ๐ฌ! ๐“๐ก๐š๐ง๐ค ๐˜๐จ๐ฎ! ๐ŸŽ‰

I'm so excited to share that our YouTube channel has hit 20,000 subscribers! Thank you all for your amazing support. ๐Ÿ™Œ This milestone wouldnโ€™t have been possible without each and every one of you. Your support, feedback, and enthusiasm for Data Engineering inspire me every day.

If you're interested in more Data Engineering content, consider subscribing :)

Letโ€™s keep learning and growing together!

#DataEngineering #ThankYou

1 year ago | [YT] | 38

View 10 replies

Mr. K Talks Tech

What is Apache Spark? Step by Step Guide for Beginners - Explained under 15 Minutes

Video Link: https://youtu.be/jDkLiqlyQaY

Watch it and let me know you feedback in the comments section :)

1 year ago (edited) | [YT] | 10

View 0 replies

Mr. K Talks Tech

Have you guys watched the latest video yet? Don't miss it to get a complete end-to-end understanding of how to resolve merge conflicts effectively.

Video link: https://youtu.be/fM2hwK48arw

What topic should I cover next? Please leave a comment below :)

#DataEngineering #Git #MergeConflicts #VersionControl

1 year ago (edited) | [YT] | 10

View 6 replies

Mr. K Talks Tech

Have you guys watched the latest video yet? Don't miss it to get a complete end-to-end understanding of how a real-time Data Engineering project is created from scratch.

Video link: https://youtu.be/JRi1JNOt5wo

#DataEngineering #Azure #AWS #GCP #DataEngineeringProject

1 year ago | [YT] | 24

View 11 replies