Carlos Adrian Lopez Castro

The more I work with #Elixir the more I come to appreciate the language and its #community. We at DAT AI Systems Pvt Ltd did a major migration from #Kafka to #AMQP without any downtime or client impact 💪. #Queues are the unsung heroes of #reliable, #scalable, and #distributed systems. With the AMQP protocol, an open standard widely adopted across industries, you can easily integrate #messaging into your stack without worrying about vendor lock-in. Why should you use queues in your architecture? - Decouple services for better scalability and resilience - Handle #asynchronous workloads efficiently - Ensure message #reliability and guaranteed delivery - Benefit from strong AMQP support across cloud and on-prem environments As businesses grow, embracing #open standards like AMQP ensures #flexibility, #portability, and long-term #stability. Ready to #future-proof your system? Check out my latest blog on the benefits of queues and AMQP. dev.to: https://lnkd.in/gDvce_nb Medium: https://lnkd.in/gVp9euNu #AMQP #MessageQueues #CloudArchitecture #Scalability #OpenStandards #EnterpriseTech #DistributedSystems

17

3 Comments

Insightful explanation of how do go channels work behind the scenes. Its all about yielding the ptocessor for other goroutines. https://lnkd.in/gbyQ4yH9

1

Convoluted World of Contra Melody Convoluted world of contra melody! Is it really convoluted? Well, the answer depends on who you ask. For a well trained musician, especially in Western music, it is natural. For most common folks, it is assumed to be there in the Bollywood music, but they will feel the absence rather than presence. Further, they cannot tell you what is missing, but they can tell you something major is missing. We just expect it to be there. Contra melody has a love-hate relationship with the main song. It loves the main song because it enhances the song if the contra-melody is played in the background. It hates the main song because the background volume is low (really low) and the tune does NOT mimic the actual song. The contra melody, or harmony, originated in Western music. In Indian Classical or Semi Classical music we do not use it. This has been well documented by B. R. Deodhar in his books. There is nothing right or wrong about it. Western music took one direction, and Indian music took other direction. The स्वर शुद्धता, for example is much deeper in Indian music. But that is a different topic altogether.  We do talk about this fusion or that fusion today, but the biggest fusion happened in Bollywood music after 1950s. At that point the Goan musicians came to Mumbai (called Bombay that time) and made a major contribution.  Now let us take one more song, where I will play the contra melody by itself, followed by song and harmonium. Our first piece is Madan Mohan gem, Zarasi Ahat. The song begins with a soothing intro piece, followed by Lata’s ad-lib (without taal) singing. Unlike many songs, the taal picks up very softly and naturally; without any fanfare. The contra pieces keep going in the background. The interlude is outstanding, and then again Lata takes over. I have a BIG complaint. Because of Lata/Asha/Rafi/Kishors of the world, it is indeed hard to concentrate on the background music. Second stanza has a very nice, small alaap that only Lata can execute. But I digress, we are not talking about Lata, but rather the background music. Our second and final song for this episode is dil hai chhota sa chhoti si asha by Rahman. In a typical Rahman style, the song begins with soft rhythm followed by a quiet intro piece. The violins make appearance soon enough and start filling out the soundscape. It is unmistakable. Notice the rhythm is guitar chords. I always think Roja was the best creation by Rahman, but he got Oscar later for different movie. Click on https://lnkd.in/gTpVbzcK then press the triangular “Play” button.  Enjoy

3

https://lnkd.in/gFWsZBEM Keeping pace with LLVM: compatibility strategies

10

2 Comments

A Window Into The Autonomous Future. Last weekend, we had the chance to experience Waymo's fully autonomous service in San Francisco. Throughout the 25-minute ride to Oracle Park we were struck by the service's ease, ubiquity, and comfort. Waymo's service, which stretches across the entirety of SF, Daly City, Colma, and Broadmoor, operates 24/7 and is the culmination of 15+ years of Alphabet investment. It's a testament to the capital intensity of autonomy, the industry's progress to date, and a peak into the future of transportation in cities. This week, Waymo plans to start testing its service on Bay Area highways. Read more from TechCrunch here: https://lnkd.in/gqv4KANc

4

While there are certainly individual variations in skill and experience when discussing modern software development the story is much more nuanced than pure individual effort.  * software development is a team sport -- individual performance is heavily impacted by the system in which they are asked to operate in.  * we pair skill and experience to this model of understanding performance by expecting people to be able to influence and adapt in direct proportion to their seniority, aka the more senior you are the more responsible you are for the outcomes of your work, the less senior you are the more your manager and management chain are responsible.  * humans want to succeed, we're social animals who derive purpose from demonstrating skill, and working collectively. All of which is to say there is no way you have over 1000 people underperforming at your company without senior leadership deeply implicated in.  If nearly 10% of your company is failing, versus just having the market move against you, you need to fire the CEO.

150

9 Comments

Check out the latest in our "Debuggability" blog series! This blog is authored by Kevin Downey Jason Johl and me and talks about how we built a Debuggability Paved Road at Intuit using Ephemeral Containers and Argo Workflows. We'd love to hear your thoughts on the topic. Also, what tools do you build as-a-platform to help debug service, compute and network issues in Kubernetes at scale? #intuit #kubernetes #debug

23

Satya Nadella sparked a new (or reignited) debate about death of apps as a result of AI agents. While he makes a great point on the Agentic AI architecture and how traditional architectures will be obsolete, wondering if front-end apps will go away. Often, tools like Excel or well-designed user interfaces help me identify the right questions to ask. Can AI alone replace the value of that interactive discovery process? What do you think? #ArtificialIntelligence #AI #AgenticAI #AIApplications #FutureOfApps https://lnkd.in/g8UKWQmf

8

1 Comment

Coffee & Systems (Study Group - Bengaluru) Week#5 (HPBN Speedread - Part 3 [HTTP Cont.]) January 04, 2024, 4:00 PM → 5:30 PM (Satruday) - The Market RMZ Ecoworld ------ Continuing from last week we explore HTTP/2 and HTTP3/QUIC. They promise to make our applications faster, simpler, and more robust. HTTP/2 was specifically created to reduce the load latency of web pages by addressing some of the well-known performance limitations of HTTP/1.1. At the same time, QUIC/HTTP3 presents a new transport mechanism altogether to replace TCP. Companies are still rolling out a lot of these optimisations. This represents the cutting edge of advancements in networking protocols. Happy reading and see you all this Saturday :) - HTTP/2 - Chapter from HPBN --> https://hpbn.co/http2/ - QUIC: next-generation multiplexed transport over UDP --> https://lnkd.in/gc4M8ZFg - Explaining QUIC: the protocol that is both very similar to and very different from TCP By Peter Door --> https://lnkd.in/gnu2QBnV - HTTP/3: the past, the present, and the future --> https://lnkd.in/g6MSCpaS

30

"American culture 'has venerated mediocrity over excellence,' leading to a nation that does 'not produce the best engineers.'" 🤦🏽Look, if you want to do business in the U.S., it’s reasonable to expect investment in its citizens through hiring, training, or supporting education. Many nations demand far more just for market access to sell products. Ignoring education and workforce development leaves the population vulnerable to manipulation—an issue both political parties seem to tolerate, as high school remains a four-year standard unchanged for over a century. Education is the primary pathway to the American dream. Neglecting it while relying on talent from countries that prioritize education undermines fairness and sustainability for the nation you’re operating in.

6

1 Comment

Attending the #NVIDIAAISummit in Mumbai was truly inspiring! and it’s clear—India is set to dominate the future of AI! 🇮🇳 The Open Cloud Compute initiative by People+ AI is breaking barriers by democratizing GPU infrastructure for startups, the Open Cloud Compute (OCC) initiative by People+ AI enabling startups and enterprises to scale their AI efforts without being tied to specific cloud providers. while #NVIDIA’s partnerships with Yotta and Tata are pushing AI capabilities to the next level. 🔥 To top it off, #Reliance is building a massive AI-dedicated data center in Jamnagar, aiming to power the next wave of generative AI and large language models. This isn’t just progress—it’s a leap toward making India the global hub for AI innovation. 🌏💡 The future is here, and it’s AI-powered! #AI #CloudComputing #GPUs #DigitalTransformation #Reliance #TechForGood #IndiaAI #Innovation #NVIDIASummit

40

🛠️ 𝐎𝐋𝐀𝐏, 𝐎𝐋𝐓𝐏, 𝐃𝐚𝐭𝐚 𝐋𝐚𝐤𝐞, 𝐑𝐚𝐭𝐞 𝐋𝐢𝐦𝐢𝐭𝐢𝐧𝐠 𝐚𝐧𝐝 𝐏𝐮𝐛/𝐒𝐮𝐛 — #𝐌𝐮𝐬𝐭𝐊𝐧𝐨𝐰𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠𝐓𝐞𝐫𝐦𝐬 𝐏𝐚𝐫𝐭 #9 🛠️ In this ninth part of the series, we explore five fundamental concepts that power modern system architectures, enabling scalability, data-driven decision-making, and reliable communication. Whether you’re designing real-time systems or managing massive datasets, these terms are essential to understand. Here’s a clear, beginner-friendly breakdown 👇: 𝐎𝐋𝐀𝐏 (𝐎𝐧𝐥𝐢𝐧𝐞 𝐀𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐚𝐥 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠): OLAP systems are designed for querying and analyzing large datasets to generate business insights. ➡️ Powers dashboards, reporting, and data analytics for strategic decision-making. ➡️ Data is aggregated, pre-processed, and stored in multi-dimensional cubes for fast analytical queries. ➡️ Tools like Snowflake, Google BigQuery, or Amazon Redshift are used for OLAP workloads. 𝐎𝐋𝐓𝐏 (𝐎𝐧𝐥𝐢𝐧𝐞 𝐓𝐫𝐚𝐧𝐬𝐚𝐜𝐭𝐢𝐨𝐧 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠): OLTP systems handle real-time, high-frequency transactional workloads, like inserting, updating, or deleting data. ➡️ Used in operational systems like e-commerce, banking, and ticketing where speed and accuracy are critical. ➡️ Transactions are executed with ACID properties (Atomicity, Consistency, Isolation, Durability) for reliability. ➡️ Relational databases like MySQL, PostgreSQL, and Oracle are ideal for OLTP use cases. 𝐃𝐚𝐭𝐚 𝐋𝐚𝐤𝐞: A data lake is a centralized repository that stores raw, unstructured, semi-structured, or structured data at scale. ➡️ Supports diverse data types (e.g., logs, images, tables) for analytics, machine learning, and advanced processing. ➡️ Data is ingested in its native format (e.g., JSON, CSV, Parquet) and processed later as needed. ➡️ Cloud-based solutions like AWS S3, Azure Data Lake, or Google Cloud Storage are commonly used for building data lakes. 𝐑𝐚𝐭𝐞 𝐋𝐢𝐦𝐢𝐭𝐢𝐧𝐠: Rate limiting controls how many requests a user or system can make to an API or service within a given time frame. ➡️ Prevents system overloads, protects against abuse (e.g., DoS attacks), and ensures fair resource usage. ➡️ Requests exceeding the set limit (e.g., 100 requests/minute) are either delayed, throttled, or rejected with an error code (e.g., HTTP 429). ➡️ Tools like AWS API Gateway, Nginx, or libraries like Token Bucket implement rate limiting. 𝐏𝐮𝐛/𝐒𝐮𝐛 (𝐏𝐮𝐛𝐥𝐢𝐬𝐡-𝐒𝐮𝐛𝐬𝐜𝐫𝐢𝐛𝐞): Publish-Subscribe is a messaging pattern where senders (publishers) broadcast messages to topics, and receivers (subscribers) consume those messages asynchronously. ➡️ Decouples communication between services and enables scalable, real-time message processing. ➡️ Publishers send events to a message broker (e.g., Kafka, RabbitMQ), and subscribers listening to topics receive the events they’re subscribed to. ➡️ Systems like Apache Kafka, Google Pub/Sub, or AWS SNS implement Pub/Sub.

10

2 Comments

AI Chips & Potential Nvidia Challenger Google TPU, AWS Trainium and Microsoft Athena (coming soon) are purpose built AI chips to run ML, DL and LLM/Transformer workloads more cost efficiently and flexibly in their respective Cloud environments. But all three Hyperscalers have no choice to rely upon the latest Nvidia GPUs to i) speed to innovate and market (primarily due to Nvidia's vertical integration with CUDA and developer network effect), ii) run both AI and non AI workloads conveniently and iii) provide a broader choice for the startup and enterprise customers. And, two related developments to notice from the recent AWS re:Invent are: i) Apple's use of AWS Trainium which is a strong endorsement for the Trainium AI chip. BTW, one expected Apple to have such a partnership with Google given a lucrative Search deal (that’s the Mr Market angle 😊 but Apple and Google may think that it is mutually beneficial ) ii). Confirmation that AI is the new tentpole AWS primitive like AWS Compute, Storage and Databases. So, if AI is going to be an ubiquitous transformational technology (Industrial revolution equivalent in Jensen's words given large/global scale manufacturing of Intelligence) with TAM of 1.3 Trillion by 2032 as Bloomberg reports, one wonders which AI chip/system will emerge as a good alternative to Nvidia. Besides the marginal competition from AMD (seems much to catch up on the Software side) and Hyperscalers, Silicon Valley based Cerebras System seems to be the most promising Nvidia competitor in the startup space. Here are the impressive Llama 3.1 405B model inference benchmark stats with Cerebras's flagship CS-3 system powered by its Wafer-Scale Engine (WSE) which boasts 4 Trillion transistors (50x more than largest GPU), 900K Compute cores and 44 GB of SRAM.  - 969 output Tokens per second (75x better than Cloud based GPU alternatives, https://lnkd.in/g5HPxAMJ) - much better Time to First Token in 240 milliseconds Cerebras Nasdaq IPO filing is taking more time to clear because of CFIUS (Committee of Foreign Investment in US) review due to its largest UAE/Abu Dhabi based G42 customer having ties with the Chinese government. The startup is planning to raise $1B with IPO at $7 to $8B valuation and prominent VC Sequoia and Sam Altman are investors in the company. Cerebras seems like a good bet (especially if one missed the Nvidia ride 😊 ), but waiting for the IPO would be a less risky choice (not sure whether it is the same G42 China risk but typical IPO leading GS, MS and Chase banks are also missing in the IPO) instead of an immediate investment using a pre-IPO shares platform like Forge Global or EquityZen.

13

1 Comment

After an incredible 11-year journey with the Siri team, I am retiring from Apple. While I will miss the remarkable team at Apple, I am excited to embark on my next chapter. My first stint at Apple began in 1990, right after completing my PhD at Carnegie Mellon. I am indebted to my thesis advisor and mentor, Richard Stern, and my committee —Raj Reddy, Jose M F Moura, Kumar, and Kai-Fu Lee— for preparing me for my career. I was honored to be Kai-Fu Lee’s first hire at Apple, where our team shipped PlainTalk, a groundbreaking speaker-independent continuous-speech recognition system for the Mac. Unlike other commercial PC systems of the time, PlainTalk required no additional hardware. I enjoyed optimizing the HMM to fit the Mac's constrained memory. I later joined Telefonica in Spain to fulfill my Fulbright scholarship's 2-year residency requirement. I returned to the US in 1994 to join Microsoft Research, founded by Rick Rashid in 1991. Rick fostered a CMU-like culture, attracting CMU faculty like Xuedong Huang, to whom I am deeply grateful for hiring me into his speech team. I later became the speech group manager under Henrique Malvar and we produced many impactful publications, including the 2010 research with Li Deng, Dong Yu, and Frank Seide on replacing Gaussian mixtures in HMM output probabilities with DNNs, significantly reducing word error rates. It was exhilarating to play a pivotal role in the deep learning revolution. I also found rewarding that many learned about the field from the textbook I co-authored with Xuedong Huang and Hsiao-Wuen Hon. I returned to Apple in 2013 to join Siri, the first mainstream voice assistant. After the launch of Siri in 2011, Apple decided to build the speech technology in-house so I am grateful to William Stasior for hiring me for the unique opportunity to impact millions. My first task was to attract researchers to Apple, which wasn't publishing papers at the time. By 2017, I convinced Apple executives to allow publishing. My team, which grew to 500, shipped faster, more accurate products with higher quality voices, ensuring everything ran on-device for privacy and reliability. This included industry-firsts like on-device neural TTS on a smartphone in 2019 and on-device dictation on a smartwatch in 2020. I thank my managers John Giannandrea and Robby Walker for their support, and the outstanding Siri team for making it happen. While the technological progress we have collectively made is remarkable, what truly touches me is its impact on society. Millions of people around the world save time by dictating messages or setting timers with Siri. Driving is safer with our verbal directions. Siri regularly steps in during emergencies, enabling hands-free calls that can bridge the gap between life and death. Our speech technology makes our products accessible to users with vision and motor impairments, and Personal Voice allows people to use their own voice with loved ones after losing their ability to speak.

3,594

293 Comments

Searching segments concurrently improves search latency across a large variety of workloads. Check out https://lnkd.in/gx3-Sfg7 Jay Deng Sorabh Hamirwasia #opensearch #opensource #searchperformance

43

LLMs and LangChain: The Dynamic Duo 🦸‍♀️🤖 Just finished a fun project where we built a Q&A bot using these two powerhouses. It's like having a personal AI assistant that's always ready to answer your burning questions! 🔥 Here's what I learned: LLMs are wizards: They can conjure up answers from thin air (or, uh, the internet). 🧙‍♂️ LangChain is the glue: It holds everything together and makes it easy to use. 🔗 Endless possibilities: This tech can be used for anything from customer support to writing catchy social media posts. 📝 Want to see it live (obvio a test server link 😛 ): https://lnkd.in/dZNAVCSV Note: it's a render link, they will take down the instance because of no use, you can hit the link and wait for two minutes, they will spin up the instance and you can try it out. Want to see the code? Check it out here: https://lnkd.in/dzjh4r47 #AI #MachineLearning #NLP #LangChain #LLM #Python #Developer #FunProject"

22

Changed CPU frequency governor to "performance" and MyRocks worst-case QPS is ~2X larger for sysbench https://lnkd.in/gfx8EgK4

11

1 Comment

Our trajectory with Google Cloud epitomizes a transformative strategic pivot. What began as a challenging market positioning has evolved into a compelling narrative of operational resilience and technological leadership. Over seven pivotal years, we've fundamentally reimagined our enterprise value proposition—transitioning from a peripheral cloud solution to a mission-critical AI innovation partner. The financial metrics tell a powerful story: we've systematically converted recurring quarterly deficits into a robust framework for sustainable profitability. Buckle up the next 7 years are going to be epic @ Google Cloud! 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 🚀 #google #googlecloud #GCP #gcpcloud

30

1 Comment