Apurv Garg

What if your queries required access to multiple sub-related data from different documents, for an LLM to parse and make sense of before returning a coherent and accurate output? We often ask complicated questions, right? 🔹Well to solve this problem, these researchers released Multi-Head RAG (MRAG) which leverages activations of Transformer’s multi-head attention layer, instead of the decoder layer, as keys for fetching multi-aspect documents. They are taking advantage of the fact that multi-head attention can learn to capture different data aspects. 🔹The interesting part is that MRAG is both cost-effective and energy-efficient. In other words, it does not require additional LLM queries, multiple model instances, increased storage, or multiple inference passes over the embedding model. 🔹Moreover, MRAG can be seamlessly integrated with existing RAG frameworks and benchmarking tools like RAGAS as well as different classes of data stores. 🔹The researchers provide a comprehensive evaluation methodology, including specific metrics, synthetic datasets, and real world use cases to demonstrate MRAG’s effectiveness. 🔸Do check it out! #genai #technology #artificialintelligence Click #linkedangle and follow for more content Set the 🔔 notification on my page, don’t miss a post!

181

10 Comments

Worthy Read: Fooled by Stickiness by Charlie Taylor Many investors and product managers can be misled into making poor decisions by looking at data on the daily active users/monthly active users (DAU/MAU) ratio. In this detailed post, Charlie Taylor explains why aggregated DAU/MAU ratios are a bad way of measuring user behavior and product performance—and takes you step by step through arriving at a better alternative. Check it out here: https://buff.ly/2xMfgaB ❓ How do you currently measure product stickiness, and what strategies do you use to ensure your DAU/MAU metrics accurately reflect genuine user engagement and value? #prodmgmt #ux #engineering

22

2 Comments

HSR Founders Club is doing an AI for GTM Fireside this Friday. Where? Most probably HSR :) If you're in a 5km radius and looking to do something before you step out, drop by. Look forward to meeting Rapti Gupta Piyush Agarwal and Akshay Hangloo. #GTM #AI

28

Excited and looking forward to discussing the evolving challenges of raising capital for early-stage startups at SAASCON24. Join me as I dive into the current trends, what founders need to know, and how we can navigate this more challenging environment. #SAASCON24 #StartupFunding #EarlyStageStartups #SaaS #Entrepreneurship

73

1 Comment

60,000 calls a day, all handled by AI! India based #Meesho , valued at 4.9 Biillion, with 160M customers; “We get a ton of customer support calls,” said Sanjeev Barnwal. Their AI #voicebot design had to overcome low-end phones and tons of background noise, and multi-language issues. https://lnkd.in/gkUs6Pw2

1

It took us < 30 mins to integrate Llama3 to our health AI stack. It takes our customers < 3 mins. Within a week Llama3 went live with all the 101 GenAI healthtech customers. We’ve curated and integrated 15+ models over last 7+ months to enhance healthcare workflows. Don’t spend weeks or months integrating with just one model; instead have a “team of models” power your “network of copilots”. Great post by Prashanth Aditya Susarla about how to build a high performance AI product with team of LLMs.

16

If you doubted the rise of India as a powerhouse, Pine Labs, a significant fintech player, is now relocating its headquarters from Singapore to India following approval from a Singapore court. This strategic shift mirrors other successful Indian startups like PhonePe, Razorpay, and Groww, embracing the trend of ‘reverse flipping’. The move signifies growing confidence in the Indian market and its potential. Key factors enabling this move include: - Favorable economic policies - Growing domestic market - Increasing investor confidence - Greater certainty of an exit at a higher valuation - Ease of accessing capital - Regulatory changes - Maturing capital markets - Cost-effective listing process All great signs for India! #India #Fintech #PineLabs #Startups #BusinessGrowth

91

2 Comments

🚀 Be Agentic, Do Agentic! 🚀 Why make AI complicated? 🤔 Let’s simplify the process and get your POC up and running in just 2-5 days! That’s the power of SimplAI. 💡 AI doesn’t have to be difficult—it’s time to be the change with Agentic solutions that are fast, secure, and scalable. 🔐✨ Let’s build the future, one Agentic step at a time. 🌐 #AI #POC #SimplAI #Agentic #Innovation #TechLeadership #FutureOfAI SimplAI

37

2 Comments

Like to order deliveries from the comfort of your own home? Zepto's recent $665 million funding will now allow the company to set up even more store across India to serve you better. Read all about it only in my new article at Entrepreneur India. . . . Follow and connect for more industry news and updates . . . #News #Update #Zepto #Funding #Investment #EntrepreneurIndia #AdityaPranMahanta https://lnkd.in/gYvATrUE

1

What I find interesting is: when growth starts to slow down and we hit diminishing returns, the next question is always, “So, now what?” Do we go after a new audience (which, if the market’s small, could mean building something new), or do we squeeze more out of the one we’ve got? Then when evaluating such trade-off, we would naturally just go back to calculate ROI to make a call (wearing my data science hat). Yet, when I look at the products people go crazy for, it’s not always just about the numbers. There’s something bigger at play, like the mission or vision that keeps things moving in the long way. Figuring out when to stick to the mission or compromise for ROI is always a fascinating thinking process :)

3

India is not just catching up in the AI race; we're innovating and leading in ways that are uniquely ours. The Economic Times recently highlighted how our approach to Generative AI goes beyond just Large Language Models (LLMs), addressing the specific challenges and opportunities within our diverse market. Rahul Agarwalla, Managing Partner at SenseAI Ventures, shared his invaluable insights into this AI revolution. His leadership and vision are truly driving innovation in the field, and it's an honour to be part of this journey with him. For anyone interested in the developments in AI and how India is making its mark on the global stage, this is a must-read.

46

3 Comments

OpenAI shared their views on Stages of #AI Interestingly, there isn't any mention of #AGI in these levels. Currently as per the table shared, I would say the world is still at Level 1 and 2 with few firms moving towards Level 3. I have been saying that every business would need an AI persona that stands for who they are and impersonates them and interestingly the level 5 in the table is Organization AI i.e. AI that can do the work of an Organization and this only possible when you have a overarching digital persona governing multiple smaller agents. Coincidentally I have heard about #OAGI in an interesting podcast by Robb W. and Josh Tyson (credits - Invisible Machines podcast by UX Magazine), highly recommend checking it out. I would say the underlying need is keeping your stakeholders (customers, employees, investors etc ) engaged. Engagement is the bloodline of any business and the best part is that the means are evolving. Do share your views in the comments below and follow me (Vellanki Sriharsha) for insights.

5

The hype has shifted from LLMs to Agents. The first ideas emerged right after the recent "AI-resurrection" (read: ChatGPT release 2 years back) and now it has become a buzzword on all levels. Don't get me wrong, I am an "Agent-optimist". Both consumers and businesses want to move on from "request-based assistance" ("summarize me this article") to autonomous minions helping us with everyday tasks without explicit orders given. We have already seen these attempts of introducing Agents to our email services and allowing them to take over the computer control. The explosive burst of such tools will happen in 2025, though – just scan the billboards of AI conferences' participants and ask your favorite LLM to extract the most commonly used term. What is less obvious is that Agents will eventually follow the LLM's path – huge models are great for consumers and everyday support. Still, enterprise businesses require distilled dedicated fine-tuned versions tailored to specific tasks. Think of Agents as not of a single almighty deity but more like a team of skilled professionals working on assigned projects (and later starting their own ones). Each of these "distilled Agents" will have their core competency, communicate with each other, and enrich the world picture for the whole group. The skills will not be fully isolated, though each has an area of strength. In the same way as it is now a reality in effective software development teams: an engineer or PM can draw a mock-up and it is warmly welcomed, then the final prototype work is better left to the designer. There are opportunities and challenges. Companies (or single project owners) will be able to "hire" a specific Agent from the marketplace to "join the existing A-Team". The biggest technical riddle is about having an efficient and universal protocol for Agents of various origins to effectively communicate with each other. And not drink too much coffee in the kitchen between tasks. #ai #ml #future #futureofai #aiagents

8

4 Comments

Hiring full-time NLP engineer for fast-growing and funded generative AI startup! At Arrowhead, we’re becoming the AI partner for enterprises’ customer support and sales teams. We are working with enterprises globally and are targeting close to $1 mn in ARR by end of the year. We’re building proprietary in-house models that will create 100x value compared to what we can do today. At Arrowhead, you’ll experience a culture where:  🚀 You will have ownership and empowerment to take decisions, even as an intern 🚀 You will see what you’re building directly in the hands of users, and be able to iterate on a weekly basis based on user feedback 🚀 You will be challenged and pushed to do some of the best work you’ve ever done! If you are interested, please fill out the google form in the comments below 👇 #hiring #NLP #startuphiring

139

11 Comments

10 TRILLION $ QUESTION: How much of a leap forward will ChatGPT5 be? If it’s only 20% or 30% or even anything less then 100% better, it will indicate that these models are topping out and we are shifting into a deployment phase with roughly the existing capabilities. This has massive implications for the foundational model builders and infra providers, as we are reaching diminishing marginal returns from new foundational models. The investment cycle in new models will slow down dramatically and it will be a race to the bottom on token prices. Most of the value will accrue to the application layer. We are still in the early days of deploying this technology and haven’t yet found the new ai first applications that create $100b+ companies, but we likely will soon. Maybe even $1tn or even $10tn. If we find out ChatGPT5 is just incremental, most of the energy and capital will likely shift toward building the application layer racing to win this prize. If ChatGPT5 is >100%, or even 10x better than 4, it will be clear that larger models are not facing diminishing marginal returns and all bets are off and any and every investment dollar will scramble in to larger and larger models. This will include the hyperscalers, financial institutions and likely even most state actors. We will reorganize society around building orders of magnitude larger models, requiring rethinking energy policy, capital, geopolitics, data, rare earth supply chains, advanced chip manufacturing etc etc etc. Waiting for OpenAI to reveal ChatGPT5’s leap is the only thing that matters in the world right now. Get out your 🍿 Which one are you betting on?

6

5 Comments

CLSA published a detailed research report on India quick commerce. Recommended reading. Who will be the first to create a $50-100Bn company in India internet? #Zepto #Zomato #IndiaInternet

18

Entrepreneurship Teaches Resilience and Problem-Solving I’ll never forget the days, my early days at Intelliplanner that took me deep into India’s heartlands, where the real grit of the country thrives. One moment, I’d be presenting to skeptical mine managers, convincing them of a GPS-enabled logistics solution; the next, I’d be hopping onto a dusty jeep to see operations firsthand. And nights? They were for coding, often by dim lights, surrounded by nothing but quiet fields and the occasional chai stop. These weren’t just workdays—they were life lessons. Resilience, adaptability, and ingenuity.

49

4 Comments

Harshita and I spoke with Pranay to discuss our approach towards Entrepreneurship and some other interesting aspects. Do watch the full episode. Link in the first comment. Matrix Partners India, GreyLabs AI #startups #business #entrepreneurship

50

3 Comments