Amit Ganesh

Ruokai Yin, our summer intern from Yale to Microsoft Azure, worked with Xuan Zuo, @Sattwik Deb Mishra, Hokchhay T. and Preyas Shah and me. We published a paper based on his project: https://lnkd.in/eHuG3BSt Summary of paper: Finding optimal sharding is hard especially for large LLMs. A large number of devices have to be divided into TP, PP, EP dimensions. For TP, we have to decide the tensor dimension e.g. head, hidden size to shard for every op. Additionally, TP can be one-dimensional/two-dimensional etc. This makes for a large sharding space that is hard to cover exhaustively. SoTA methods use heuristics to select sharding e.g. GSPMD, Sequence Parallelism, Helix etc. There are significant time gaps, months or years, between the discovery of each of these methods. We want to fast-forward the process of discovery by 1) using a formal representation of the sharding space, and, 2) using reinforcement learning to search the sharding space.    This paper demonstrates that our method is 3.5x better than random search, and on par with hand-tuned heuristics when looking only at 1D sharding and without allowing sequence parallelism. We aim to extend the work to multi-dimensional sharding as well as sequence parallelism. Beyond that, we wish to combine the problem of sharding with fusion, tiling and collectives as well.

58

What happens when kids use AI not just to learn… but to create? In the latest episode of Beyond the Tech, I sat down with Rima Karmakar—a passionate educator from India who is blending robotics, IoT, and Generative AI to reimagine how children learn. She told me something that really stuck: “With GenAI tools, my students realized they could build their own games from scratch. Suddenly they weren’t just learners—they were creators. The joy on their faces when they said, ‘This is my product,’ was unforgettable.” From tic-tac-toe reimagined with AI prompts to teaching kids the future skill of prompt engineering, Rima shows how AI can build confidence, curiosity, and creativity in the classroom. But we didn’t stop there. We talked about: 🔹 How teachers can use AI for lesson planning & assessments 🔹 Why empathy must remain “beyond the tech” This isn’t just about EdTech trends—it’s about shaping the next generation of innovators. #AIinEducation #GenerativeAI #ArtificialIntelligence #EdTech #BeyondTheTech #NedaMariaKaizumi #RimaKarmakar #Podcast #AI #AITrends #AIInnovation #EducationTechnology #ResponsibleAI #AI4Good #EdTechInnovation #FutureOfLearning #AIInClassroom #AIandRobotics #IoT #DigitalLearning #GlobalEducation #AIforTeachers #PromptEngineering #AI4Education #TechForGood #EdTechPodcast #EducationalAI #LearningWithAI #NextGenLearning #AIforKids #AIinSchools #TeachingWithAI #RoboticsEducation #AIandSociety #AItools #AIworkflow #EducationInnovation #AIethics #AIbias #AIprivacy #MultilingualAI #DigitalTransformation #FutureEducation #AIPodcast #AIcommunity #AIleaders #AIapplications #Education4Future #AIimpact #AItrends2025 #TechPodcast 🎧 Catch the full conversation here: https://lnkd.in/daJVNsVW

22

6 Comments

“Human Edge in the AI Age” by Nitin Seth is a great read providing comprehensive strategies for humans to thrive and succeed in the AI World. Incedo Inc.

37

Less than a week to go🔥 After the incredible response to our MCP, Agentic AI, and Vibe Coding sessions, Arvind Narayanamurthy and I are kicking off a brand-new workshop series on one of the most requested and practical topics- Retrieval-Augmented Generation (RAG). The first installment of this series is specifically designed for beginner to intermediate learners, offering a comprehensive introduction to the fundamental concepts of RAG. 🔍 Whether you're building production-grade AI apps or just starting to explore how LLMs can go beyond their training data - RAG is a must-have skill. This isn’t your usual high-level webinar. We’ll take you through real implementation, live guidance, and building from scratch You’ll: ✅ Learn how RAG improves LLM performance with fresh, contextual data ✅ Understand vector DBs, indexing, and retrieval techniques ✅ Get Hands-on: Build and deploy a working RAG pipeline using LangChain + Pinecone ✅ See no-code and low-code demos for faster experimentation ✅ Explore real-world use cases and performance tips 📅 Reserve your seat, roll up your sleeves, and let's get building. 👉 https://lnkd.in/gS_B7_7d

144

13 Comments

New blog on Distributed Inference Serving for Large Language Models (LLMs); exploring how large models are hosted and scaled efficiently across multiple GPUs and machines. If you’ve ever wondered how LLMs are actually hosted across distributed systems, this explains the architecture and process in depth. Link to blog: https://lnkd.in/gfkNZHEu

24

1 Comment

"For these models to reach their peak value, you need to train them not just on publicly available data, but make privately owned data available for those models as well," - Ellison https://lnkd.in/gM6FskzJ

4

2026 marks the shift from AI experimentation to real-world deployment—where agentic AI solutions tackle complex business problems autonomously with a focus on vertical solutions. AWS's Rishi Bhaskar shares insights with Nextgov on this transformation, emphasizing that success starts with a data-first approach to modernize legacy systems and deliver measurable outcomes. Get the details:

12

With the continued evolution of LLMs and AI apps, some people may find it overwhelming to pick the one(s) relevant to their specific use cases. I have consolidated some of the popular ones with a brief description and their application areas for quick reference (and launch directly from the web page below). They are also categorized into separate lists based on use cases e.g., Text generation & summarization, Image generation, Code, Audio, Video, etc. Hope this would be useful.   Feel free to check it out and put in comments below for any latest ones that may be missing on the list. Will update later this week. #GenAI #AI #ML #LLM #AgenticAI #Cloud https://lnkd.in/gQhcu8Ud

22

Grateful for the opportunity to speak at GAI World on a panel moderated by the incredible Luda Kopeikina and alongside two inspiring leaders, Sharna Sattiraju and Neha Shah. Each of us shared how our companies are leveraging AI in unique ways to drive innovation and impact. I had the opportunity to speak about how we at SimpliSafe are applying AI to enhance safety and security in people’s everyday lives. As our moderator Luda Kopeikina so powerfully said: “AI success requires more than algorithms. It’s about building robust systems, yes—but equally about building trust, governance, and culture. The winning formula is: focus on high impact cases, start small, show value, empower champions, create excitement and scale responsibly. Technology may be moving fast, but people, education, and trust remain the real accelerators.” I couldn’t agree more. Responsible, human-centered approaches are what will ensure AI drives positive impact in our communities. Grateful for the chance to share ideas, learn from such thoughtful women leaders, and highlight the meaningful role AI can play in building a safer future. #AI #WomenInAI #Leadership #Innovation #GAIWorld

132

1 Comment