Alexander Ratner

AI memory is fundamental for conversational AI and AI agents. It is critical for building personalized experiences and improving reasoning. Check out Letta’s course to understand how to use AI memory to enhance the customization and quality of your AI app.

15

Ilya Sutskever confirmed at NeurIPS '24 pre-training scaling law will not be the same. Internet data, the AI fossil fuel, is running out. It is not the end of the AI hype, the rapid rise of foundational AI has outpaced our ability to fully grasp their long-term societal impact. AI agents and applications are poised to transform every facet of our lives, and we will see it happening in coming few years. There will still be improvements in model architecture, and synthetic data creation, so models will improve, just not at the lightning speed they did till now. Looking forward, the single most important milestone in AI is creating systems capable of advancing themselves—AI researchers that can innovate and improve foundational models autonomously. We need to assess how far are we from this stage.

9

One new interesting application of LLMs: CAIS has released a forecasting bot that provides probability estimates for any question you ask. For example, to the question "Will GPT5 be released before 2025?", it answers that it's 70% likely. The bot works by searching for relevant information online, feeding it to GPT-4o, asking a few guiding questions, and then requesting a probability estimate. What's impressive is that this bot outperforms experienced human forecasters, even though GPT-4o wasn't specifically trained for this task. This kind of application shows that AI could be of great help in improving decision-making in the future. Link to the blog post: https://lnkd.in/gjP7JQgz Link the bot if you want to try it yourself: https://forecast.safe.ai/

11

Today, I found a fascinating way to think about “Tokens” in LLMs. It came from a conversation between Jensen Huang and Patrick Collison at a recent Stripe event. When asked about the future of compute capacity in five years, Jensen smartly dodged that question a bit, but then gave an excellent explanation and analogy about why tokens are the new forces that will power the next decades of humanity. He explained that we're now producing something unprecedented (and at scale): floating point numbers that possess “value”, which we now call tokens. These tokens are valuable because they encapsulate “intelligence”. People are now taking these tokens and transforming them into English, French, images, videos, chemicals, proteins, robotic movements, etc. And many are working hard to expand the range of concepts and ideas we can create with these tokens. He then goes on to made a compelling comparison between tokens and electricity. In the past industrial revolution, we successfully found a way to convert “atoms” into “electrons” (by boiling water to power electricity turbines). And now, we've discovered a way to convert "electrons" into "tokens" (by using energy to power data centers that train and run LLMs). When electricity was first introduced, few people understood its value. Today, paying for kilowatts is routine. The same will happen with tokens. Right now, only early adopters and builders are paying tokens. Soon, everyone will be paying for tokens on a daily basis to supercharge productivity and power new products and services. Many new industries will be born from and built on top of tokens. When I first heard about this way of thinking, I got goosebumps. Perhaps it’s because Jensen has a good storytelling skill that helps him sell what he builds, but I have to admit this way of thinking gave me a brief surge of pride. I'm proud of humanity's collective effort and creativity, which have taken us from living under rocks to building machines that can "think." That's nothing short but a miracle.

18

5 Comments

During yesterday's LibreQoS APNIC webinar, I posed the question: won't more bandwidth solve these problems? As Herbert Wolverson said, yes, more bandwidth is good, but, still these problems remain if queueing is done incorrectly. Here's my take on why bandwidth alone is not as good as bandwidth + good queueing policies: Generally it was believed that 'data is important, so don't throw it away; hang on to it and send it later'. In practice, this has proven to be suboptimal as two issues may emerge: 1) latency increases for some flows due to heavy demand from other flows using the same bottleneck link, 2) even a single flow can have excessive latency due to aspects of typical TCP behavior (referred to bufferbloat) when the buffers grew large enough that the data being buffered was retransmitted anyway. It turns out that not all data is equally important. Active Queue Management is the art of deciding priorities, both in deciding what data to throw away, but also in allowing some later arriving data to be transmitted ahead of data in another connection that arrived before it. These problems have been studied, and good solutions have been found by using certain queueing policies in routers and switches, referred to as “fq_codel’ and “cake”. These track the different flows not by classifying the data, but by watching the behavior. Flows that send relatively little data (DNS lookups), or at a measured pace (video chat) have priority over flows that send a lot of data as quickly as possible (App and System updates, Video and ISO downloads).

10

5 Comments

Humans have historically found the secret to some natural phenomena and put it on steroids. 💉 Consider the aerodynamic efficiency of a bird's wings – a concept we've amplified to create the marvels of airplanes and rockets. ✈️ 🚀 We're seeing something similar right with LLMs. The transformer approach to linking knowledge seems to produce an eerily similar result to what we do. I've seen LLMs hallucinate in a similar way to my 5 year old kid! 😵‍💫 We took the body of knowledge on the internet and created 100+ billion parameter models that hold information that any human mind can. 🧠 But there's more to the natural phenomena of intelligence. There's a few more unlocks that need to be discovered. Like the mechanisms behind novel problem solving. 🧮 It's only a matter of time – in my opinion – until we crack those, put those on steroids and then we're no longer in the pole position of the most intelligent entities. 🤖

3

6 Comments

🧩 One thing we've noticed with #VentureIQ technology is how well it can distill and communicate complex technical material 🧩 Whether it's a #deeptech venture, a novel #AI application, or even a patent submission, we can quickly distill the business and strategic implications for investors...and sometimes even the founders/PIs themselves! 🤯 Based on our work so far, the tech can handle a wide array of research areas and technological sectors -- anything from blockchain algorithms to vaccine development. It handles the nuance of the field, the specific terminology, and extracts the key concepts which matter for venture-building. 🤓 To demonstrate, I took a patent I helped write with Eric Laber on reinforcement learning. I ran it through #Ventureiq to build a commercial assessment (key differentiators, target markets). Then for fun I had #NotebookLM make a podcast out of it. I've uploaded the result it here (DM me if you'd like the actual report): https://lnkd.in/eiTejsny This is more than just automation or streamlining operations - it's about unlocking clarity and insight when it was previously unattainable, and the ability to do it over and over again no matter the sector or vertical. Interested in more info? DM me so we can chat.

11

2 Comments

Reimagining Healthcare Workforce Platfforms: Turning Capital Into Labor The future isn’t just about filling shifts. It’s about scaling labor intelligently, driving better outcomes for systems, staff, and patients alike. Andreessen Horowitz and Alastair (Alex) Rampell reinforced this Vision in a recent post and it applies to the next phase of healthcare workforce evolution. Healthcare workforce marketplaces plus AI are at the tipping point of transformation, evolving into systems of record that don’t just manage labor—they optimize it. Much like EHRs centralized patient care data, these marketplaces can centralize workforce operations, aligning talent supply with clinical demand. But there’s a bigger opportunity here: turning capital into labor. Here’s what I mean. Historically, industries (including healthcare) have focused on enterprise computing tasks—streamlining data entry, compliance, and back-office functions. While valuable, this approach often stops short of transforming the real-world, repetitive processes that make up the bulk of work in healthcare. Think beyond enterprise software. The next frontier lies in leveraging embodied AI and workforce marketplaces to automate and enhance labor-driven processes, transforming capital investments into productive labor outputs. For healthcare, this means turning staffing costs into scalable, dynamic systems that deliver value far beyond filling shifts: 1. Dynamic Labor Matching: Capital invested in marketplace platforms enables real-time matching of labor supply with patient demand, replacing outdated scheduling models with predictive, automated systems. 2. Workflow Automation: From credentialing to compliance and shift bidding, embodied AI can streamline traditionally manual tasks, freeing human resources for higher-value work. 3. Labor as a Strategic Asset: Workforce marketplaces shift the focus from static staffing budgets to proactive labor deployment, ensuring that every dollar invested in labor drives outcomes and efficiency. It is about the billions of repetitive, planned tasks that AI can improve. In healthcare, that means automating everything from staffing logistics to clinical task assignments, creating a horizontal system of engagement for labor (think Zendesk) that integrates seamlessly with vertical, workflow-specific platforms (think Toast for staffing operations). The result? Hundreds of billions in untapped market potential—and a healthcare workforce model that transforms how care is delivered. By turning capital into labor through smarter marketplaces and automation, we don’t just solve staffing challenges; we redefine what’s possible in healthcare operations and ShiftMed is leading the way with health systems moving beyond tired models. #capitalintolabor #systemsofrecord #healthworkforce #aiworkforce #healthsystems #hospitals #cno #hospitalceo #healthcareinnovation

11

2 Comments

🚨🚨 🚨 Unlocking Innovation: The Power of the Adjacent Possible Innovation programs can stall when the team tries to ideate way beyond their collective perspective and frame of reference. Like a software engineer brainstorming genetic modification of mycelia, or a senior executive ideating process improvements which they haven't been participated in for decades. It's challenging, exhausting, and ultimately self-defeating. Enter the concept of the "Adjacent Possible" - a game-changer for innovation. What is it? The Adjacent Possible, coined by Stuart Kauffman, represents the realm of new ideas within reach based on our current knowledge, resources, and capabilities. Why it matters: ➡️ Realistic Innovation: it focuses on achievable advancements, not far-fetched concepts. ➡️ Incremental Progress: each innovation opens doors to new possibilities. How to leverage it: • Constantly explore the boundaries of your adjacent possible. What's in your line of sight is what you know best. • Combine existing ideas in novel ways. Even small perturbations from status quo can generate large innovation leaps. • Stay curious about developments in adjacent industries. Cross-domain patterns create fresh sources of ideas, while also expanding the adjacent possible. Most of all, it takes the 'genius' pressure off the team. No one knows everything, but each one of us knows a lot about something, and we can all drive plenty of innovation potential by focusing on the spaces we know best. Are you exploring your Adjacent Possible? Share your thoughts below! 👇 #Innovation #innovationsystems #AdjacentPossible

8

2 Comments

Cost-aware inference is important, but currently LLM prompts are not interoperable. Prompts that work good on one LLM may show worse performance on the other, even more advanced LLM or even on the different versions of the same LLM. Once interoperability problem is solved it will also be possible to implement cost-aware inference that strategically manages computational resources for prompt processing, ensuring sustainable costs. This approach includes model routing https://www.notdiamond.ai/ - automatically selecting the most appropriate model for each task. Startups in this area are actively supported by the industry veterans.

4

2 Comments

🎯Data was, is, and will be the only fuel. Analogy with the fossil fuel is a good one, since the data we have today is as dirty as oil and coal. What big tech companies tried is to put a lot of "garbage" data, and what they did get was fantastic. Yet, we are at the point of diminishing returns. Data is the beginning and the end of this cycle.” Great thread, particularly this comment 👆from Ilija Lazarevic

20

2 Comments

This is just incredible. Neal Ghosh's demonstration of how #VentureIQ takes deeply technical and complicated content across a range of industrial use cases and ages/stages through an AI-generated conversational podcast (a la #notebookLM) is really mind-blowing. Check out his post, below, and if you haven't seen VentureIQ, yet, let's get you set up to learn more. You can visit VentureIQ.ai or DM any of us over here to book a demo!

2

We are quickly entering the "trough of disillusionment" in the hype cycle for generative AI. While GPTs excel in automating certain tasks (and can even automate away large portions of some jobs) they often fall short in others. Like all new technology, the issue lies in misapplying generative AI for tasks it wasn't designed for. This is a problem compounded by the GPTs themselves suggesting they can handle these tasks (often cheerfully!). This misalignment creates frustration and unmet expectations which we're starting to see more of these days. As the dust settles I firmly believe we'll recognize GPTs as a transformative technology across many industries. However it's crucial to understand their limitations and apply them appropriately. What are your thoughts on the current state of generative AI and its future applications?

2

2024 has been a game-changer for spatial computing 🚀 With the Vision Pro dropping, Quest 3 making waves - we're seeing this tech leap from "maybe one day" to "happening right now." What's wild is how different industries are running with it: 1️⃣ Surgeons practicing procedures in 3D 2️⃣ Kids exploring the solar system from their classroom 3️⃣ Trying on clothes without stepping in a store And property? That's where we've been putting in the work. Ensuring everyone has the chance to experience their can step inside their future home before it's built. To Explore their space in lifelike detail across any device, from smartphone to vr headset. Started this journey years ago because I saw how painful it was trying to sell off plans and blueprints. Now? We're watching people walk through unbuilt spaces like they're already there. Across any device they've got. But here's what keeps me up at night (in a good way) - this feels like we're just scratching the surface. What space do you think spatial computing will shake up next? #SpatialComputing #PropTech #CGI #ArchViz

20

ex Google CEO Eric Schmidt spoke at Stanford this week. Lots of nuggets here, but most interesting for the near term, Schmidt believes in the next year AI is set to make a big leap forward. He predicts AI will combine three important features: 1. Vast knowledge retention (1 million token models) 2. Text-to-action capability 3. Personal AI agent fleets While the full impact is unknown, everyone may soon command their own AI teams. Here's an example: Imagine you're developing new quantum computing algorithms. Your AI assistants could: - Continuously scan and synthesize global quantum research papers - Generate novel algorithm ideas based on this knowledge - Simulate and test these algorithms across various quantum architectures - Automatically document findings and prepare draft papers - Identify potential collaborators and draft outreach emails All initiated by a command like "Advance our quantum algorithm research." This could dramatically accelerate R&D cycles and scientific breakthroughs.. https://lnkd.in/eJbg6cnD #frontiertech #AI #futurefrontier

22

8 Comments

In today's episode, the renowned RLHF thought-leader Dr. Nathan Lambert digs into the origins of RLHF, its role today in fine-tuning LLMs, emerging alternatives to RLHF... and how GenAI may democratize (human) education! Nathan:  • Is a Research Scientist at the Allen Institute for AI (AI2) in Seattle, where he’s focused on fine-tuning Large Language Models (LLMs) based on human preferences as well as advocating for open-source AI. • He’s renowned for his technical newsletter on AI called "Interconnects".  • Previously helped build an RLHF (reinforcement learning from human feedback) research team at Hugging Face. • Holds a PhD from University of California, Berkeley in which he focused on reinforcement learning and robotics, and during which he worked at both Meta AI and Google DeepMind. Today’s episode will probably appeal most to hands-on practitioners like data scientists and machine learning engineers, but anyone who’d like to hear from a talented communicator who works at the cutting edge of AI research may learn a lot by tuning in. In today’s episode, Nathan details:  • What RLHF is and how its roots can be traced back to ancient philosophy and modern economics.  • Why RLHF is the most popular technique for fine-tuning LLMs. • Powerful alternatives to RLHF such as RLAIF (reinforcement learning from A.I. feedback) and direct distilled preference optimization (dDPO). • Limitations of RLHF. • Why he considers AI to often be more alchemy than science. Many thanks to Amazon Web Services (AWS) and Crawlbase for supporting this episode of the "Super Data Science Podcast with Jon Krohn", enabling the show to be freely available on all major podcasting platforms as well as the video version we publish on YouTube. This is Episode #791! #superdatascience #machinelearning #ai #llms #rlhf #reinforcementlearning

74

10 Comments

The newest issue of The Pragmatic Engineer found a surprise uptick in eng hiring in the typically slow summer season - I'm curious to see how the macro environment impacts this uptick as we head into the fall, but I remain hopeful. I asked Gemini to give me the tldr of the article to share with my team (sorry, Gergely Orosz) and found it missed one of the most interesting pieces of the article. Gemini's highlights - Unexpected surge: Tech recruitment has seen an unusual spike in June and July, contrary to typical trends. Increased demand: Startups, especially AI-focused ones, are driving the hiring uptick. Global phenomenon: This trend isn't just limited to the US; Europe is also experiencing increased recruitment activity. Reasons for hiring: Companies are backfilling positions, investing in growth due to improved financials, and responding to increased VC funding. Challenges remain: While the job market is improving, finding qualified candidates and offering competitive compensation remains difficult for many companies. What I found most interesting - The nature of the backfills: the article finds that a lot of new headcount are actually backfills of folks that were "over-slashed" during rounds of layoffs. Not entirely surprising with the "trim the fat" and "rebuild lean" mentality, but interesting nonetheless. Either way, the uptick is encouraging (and don't always rely on Gemini's tldrs). #hiring #startups #VCbacked #softwareengineering

11

1 Comment