Knowledge Amplifier

23rd Jan, 2026 -- Saraswathi Puja & Netaji Subhas Chandra Bose's birthday celebration in our society ❣️

https://youtu.be/jmsGOPtZdj4?si=tWroU...

#saraswatipuja #netaji #india

#saraswatipuja #india #netaji #subhaschandra

2 days ago (edited) | [YT] | 6

Knowledge Amplifier

Celebrated Ganpati Bappa's birthday on 22nd January, 2026 at Siddhivinayak Temple, Kolkata 🌸✨
youtube.com/shorts/wY1NghfUYR...

#ganpatibappa #sidhhivinayak

3 days ago | [YT] | 7

Knowledge Amplifier

How Vector Math Powers Modern AI : medium.com/@satadru1998/how-vector-math-powers-mod…

#generativeai #dataengineering #medium #llm #vectorembedding

1 week ago | [YT] | 6

Knowledge Amplifier

It's 2️⃣0️⃣2️⃣6️⃣, Wish all of u a very Happy New Year!

Started New Year with a nice Theme Cafe, recommended in case u are near Dumdum, Kolkata!


#kolkata #india #cafe #funwithourfam

3 weeks ago | [YT] | 2

Knowledge Amplifier

There is no rocket-science behind tool selection!
medium.com/@satadru1998/there-is-no-rocket-science…

#llm #generativeai #dataengineering #aiagent

4 weeks ago | [YT] | 7

Knowledge Amplifier

Learn MCP with in-depth intuition: medium.com/@satadru1998/intuition-of-model-context…


#generativeai #mcp #langchain #genai #protocol

1 month ago | [YT] | 3

Knowledge Amplifier

Went to trekking for mental health, came back knowing physical health comes first 😕🥺

#trek #pune #india

3 months ago | [YT] | 2

Knowledge Amplifier

Did you know? Before Raigad was chosen, 𝐂𝐡𝐡𝐚𝐭𝐫𝐚𝐩𝐚𝐭𝐢 𝐒𝐡𝐢𝐯𝐚𝐣𝐢 𝐌𝐚𝐡𝐚𝐫𝐚𝐣 had considered another fort as the capital of his kingdom. Can you guess which one? 🤔

It's 𝐒𝐮𝐝𝐡𝐚𝐠𝐚𝐝, which means "the sweet fort".

This fort, surrounded by lush greenery and cascading waterfalls, offers the perfect monsoon escape.
Here is a video that captures moments from my recent trek to this hill fort:


#sahyadri #trekking #maharashtra #india #chhatrapatishivajimaharaj

4 months ago | [YT] | 3

Knowledge Amplifier

You run an Athena query on S3 data and it returns zero rows, even though the output files are present. What can be the possible issue?

4 months ago | [YT] | 2

Knowledge Amplifier

𝑩𝒖𝒊𝒍𝒅 𝒂 𝑩𝒖𝒍𝒍𝒆𝒕𝒑𝒓𝒐𝒐𝒇 𝑫𝒂𝒕𝒂 𝑷𝒊𝒑𝒆𝒍𝒊𝒏𝒆..

Want robust datasets? The secret isn't just good code - it's adding data flow controls. Just like assertions in unit tests validate code, strong pipeline controls validate your data before, during, and after ETL.

𝐓𝐡𝐞 𝐀𝐖𝐀𝐏 𝐏𝐚𝐭𝐭𝐞𝐫𝐧
Audit-Write-Audit-Publish (AWAP) is my go-to ETL pattern when reliability matters. By introducing two audit steps - one before extraction, one before loading - you catch issues early and often.

🔍 𝐀𝐮𝐝𝐢𝐭 𝐁𝐞𝐟𝐨𝐫𝐞 𝐄𝐱𝐭𝐫𝐚𝐜𝐭
Start by analyzing your data source for quick, impactful checks. Validate file formats, table sizes, or schemas before transformations even begin. For a simple CSV table (say, columns a, b, and c), a fast audit can confirm all columns are present and correctly formatted - without wasting time on full scans.

🛡️ 𝐀𝐮𝐝𝐢𝐭 𝐁𝐞𝐟𝐨𝐫𝐞 𝐋𝐨𝐚𝐝
Once transformed, validate your data again. Treat it like running unit tests on real datasets. Ensure that critical values (like those columns you just transformed) never violate business rules, such as unexpected NULLs or invalid data types.

Every audit tightens your pipeline's defenses, saves debugging time, and boosts trust in your data product.

Curious how to implement unit tests for your data pipeline?

Explore Pydeequ - an incredibly useful module for running data unit-tests at scale and ensuring your datasets are trustworthy--
https://youtu.be/699jUhUE9hY?si=b4DCs...

#aws #dataengineering #cloudcomputing #datapipeline

4 months ago | [YT] | 7