Introducing my new series: “𝐋 𝐟𝐨𝐫 𝐋𝐋𝐌”(Episode - 1):
𝑳𝒂𝒓𝒈𝒆 𝑳𝒂𝒏𝒈𝒖𝒂𝒈𝒆 𝑴𝒐𝒅𝒆𝒍
AI systems trained on massive amounts of text (books, articles, websites, conversations). LLMs are powerful pattern recognizers that feel intelligent because of scale.
Example : ChatGPT, Claude, and more......................................................................
But, How exactly are these modern LLMs trained?
1️⃣ 𝐏𝐫𝐞𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠: Model learns language patterns and knowledge from massive text datasets.
2️⃣ 𝐈𝐧𝐬𝐭𝐫𝐮𝐜𝐭𝐢𝐨𝐧 𝐅𝐢𝐧𝐞-𝐓𝐮𝐧𝐢𝐧𝐠 (𝐒𝐅𝐓): Humans teach the model to follow instructions with curated examples.
3️⃣ 𝐏𝐫𝐞𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐂𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧: Multiple model outputs are ranked to capture what humans actually prefer.
4️⃣ 𝐑𝐞𝐰𝐚𝐫𝐝 𝐌𝐨𝐝𝐞𝐥 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠: A model is trained to score outputs based on human preferences.
5️⃣ 𝐑𝐞𝐢𝐧𝐟𝐨𝐫𝐜𝐞𝐦𝐞𝐧𝐭 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠 (𝐑𝐋𝐇𝐅/𝐃𝐏𝐎): The model is fine-tuned to maximize helpful, safe, and aligned.
Tada! ChatGPT is ready to be shipped! 🚀
As usual i have some handcrafted visualizations to make it easy for digestion. Go check out now----->
Data Science with Keerthi (தமிழில்)
Introducing my new series: “𝐋 𝐟𝐨𝐫 𝐋𝐋𝐌”(Episode - 1):
𝑳𝒂𝒓𝒈𝒆 𝑳𝒂𝒏𝒈𝒖𝒂𝒈𝒆 𝑴𝒐𝒅𝒆𝒍
AI systems trained on massive amounts of text (books, articles, websites, conversations). LLMs are powerful pattern recognizers that feel intelligent because of scale.
Example : ChatGPT, Claude, and more......................................................................
But, How exactly are these modern LLMs trained?
1️⃣ 𝐏𝐫𝐞𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠: Model learns language patterns and knowledge from massive text datasets.
2️⃣ 𝐈𝐧𝐬𝐭𝐫𝐮𝐜𝐭𝐢𝐨𝐧 𝐅𝐢𝐧𝐞-𝐓𝐮𝐧𝐢𝐧𝐠 (𝐒𝐅𝐓): Humans teach the model to follow instructions with curated examples.
3️⃣ 𝐏𝐫𝐞𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐂𝐨𝐥𝐥𝐞𝐜𝐭𝐢𝐨𝐧: Multiple model outputs are ranked to capture what humans actually prefer.
4️⃣ 𝐑𝐞𝐰𝐚𝐫𝐝 𝐌𝐨𝐝𝐞𝐥 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠: A model is trained to score outputs based on human preferences.
5️⃣ 𝐑𝐞𝐢𝐧𝐟𝐨𝐫𝐜𝐞𝐦𝐞𝐧𝐭 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠 (𝐑𝐋𝐇𝐅/𝐃𝐏𝐎): The model is fine-tuned to maximize helpful, safe, and aligned.
Tada! ChatGPT is ready to be shipped! 🚀
As usual i have some handcrafted visualizations to make it easy for digestion. Go check out now----->
#AI #ArtificialIntelligence #MachineLearning #DeepLearning #LLM #ChatGPT #ClaudeAI #NaturalLanguageProcessing #NLP #AIResearch #TechInnovation #GenerativeAI #AIExplained #DataScience hashtag#AICommunity #RLHF #RLAIF #LLMTraining
2 weeks ago | [YT] | 12