Rajesh Trivedi

Congrats to the Tabnine team!! - Gartner evaluated them across all 5 AI use cases in Gartner® Critical Capabilities for AI Code Assistants against 11 other vendors and ranked Tabnine #first for #CodeGeneration, #CodeDebugging, and #CodeExplanation use cases, and second for #CodeModernization and #ArtifactBuilding and #Testing use cases. The company also released the newest chapter of their O'Reilly guide on AI for the #SDLC. Customers are enjoying the choice between various #LLM's including #Claude 3.5 Sonnet and #GPT-4o in real-time. I love #investing in #extraordinary #founders - we're living in the Wow Era!

20

1 Comment

Researchers from Beihang and Microsoft introduce a novel method named MoRA, which employs a square matrix for high-rank updating while maintaining the same number of trainable parameters as LoRA. This approach leverages non-parameter operators to adjust the input and output dimensions of the square matrix, ensuring seamless integration with existing LLMs. The comprehensive evaluation of MoRA across various tasks, including instruction tuning, mathematical reasoning, and memory-intensive tasks, demonstrates its superiority in scenarios requiring significant memorization and comparable performance in other areas.   The study highlights the efficiency of PEFT methods like LoRA, which significantly reduce memory requirements and facilitate the storage and deployment of fine-tuned models. Despite LoRA's broad applicability, it struggles with tasks requiring the enhancement of knowledge and capabilities through fine-tuning. To validate these observations, a memorization task using pseudo-data revealed that LoRA performed significantly worse than full fine-tuning (FFT), even with a large rank.   Inspired by these findings, MoRA was developed to maximize the rank in the weight update matrix while maintaining the same number of trainable parameters. The method employs a square matrix and corresponding non-parameter operators to achieve high-rank updating, enhancing the model's capacity to store new information. In pretraining experiments, MoRA demonstrated superior performance compared to LoRA and ReLoRA, a variant that merges low-rank matrices into the model during training to increase the rank of the weight update matrix. The analysis of the spectrum of singular values for the learned weight update matrix further supports the effectiveness of MoRA's high-rank updating approach.   MoRA represents a significant advancement in PEFT methods for LLMs, addressing the limitations of low-rank updating and enhancing the model's ability to learn and memorize new knowledge. The method's ability to achieve high-rank updating while maintaining the same number of trainable parameters as LoRA allowing for LLM performance improvement across a large group of tasks    Arxiv: https://lnkd.in/enEWr5p2

1

💡 #MOCHAX #PORTFOLIO ➡️ TwinMatrix Technologies (tmt) 🦄 TwinMatrix Technologies (TMT) operates in the spatial computing sector that is underpinned by several key technologies. 🚀 Market Size and Growth: Current Market Size: The spatial computing market was valued at approximately $81.8 billion in 2022. Projected Growth: It is expected to grow to around $269.8 billion by 2030, with a compound annual growth rate (CAGR) of 23.5% from 2024 to 2031 (The Brainy Insights) (AB Newswire). #SpatialTwins #DigitalTwins #Web3 #Innovation #MOCHAX

1

New Tesla Patent Reveals Clues to an Exciting Future of Humanoid Robots and AI Integration In a interesting discussion, Herbert Ong and Scott Walter dive deep into Tesla's recently published patent application WO2024072984A1 (link in comments). Entitled "Actuator and actuator design methodology," the patent primarily focuses on controlling robot movement through strategic actuator placement. However, the document also unveils important clues about the potential for end-to-end neural net training of humanoid robots, reminiscent of Tesla's approach to training its vehicles with FSD. Ong and Walter explore the concept of personalized humanoid skills. Imagine purchasing a bot with built-in capabilities, then having the option to augment and customize those skills through a "Skills Store" akin to Apple's App Store. This opens up a world of possibilities for tailoring robots to specific tasks and preferences. The discussion also touches on the potential for various robot form factors, each designed to excel at particular skills. Picture a tennis-playing robot that comes pre-trained with basic volleying instructions, but requires a "Skills Upgrade" to perform at a master level. This raises questions about the need to manufacture and train a diverse range of robot body types and sizes, mirroring how humans possess ideal physiological characteristics for different activities. Later, Ong and Walter discuss a scenario in which Tesla builds the hardware – including automobiles, humanoids, and other bot form factors – while xAI develops the brains. This arrangement opens up opportunities for licensing agreements between the two companies, that may help the companies navigate future antitrust concerns as these technologies are deployed at scale. The convergence of advanced robotics and artificial intelligence holds the potential to catalyze a profound societal transformation. As Tesla and xAI continue to push the boundaries of what's possible, I can envision a future where intelligent, adaptable robots become integral to various aspects of our lives – from manufacturing and transportation to healthcare, recreation, and beyond. The seamless integration of cutting-edge hardware and software will revolutionize the way we live and work, ushering in an era of unprecedented efficiency, productivity, and innovation. While there are still challenges to overcome and ethical considerations to address, the prospect of these combined technologies driving positive change on a global scale is awe-inspiring. #FrontierFrontier #Humanoids #AI #Robots

7

1 Comment

China's AI leap: A single generative AI model running across multiple data centers. This breakthrough could redefine AI development, bypassing chip sanctions and pushing technological boundaries. What does this mean for the future of global AI competition and collaboration? #AIInnovation #TechBreakthrough #GlobalAI #ChinaTech #FutureOfComputing

4

As we confront today’s online harms, we must prepare for the next frontier: an embodied, immersive internet powered by #AI, #biotech, #decentralization, and #quantum #computing. While tech companies distract us with superficial features and short-term solutions, they remain opaque about their true vision for our digital future—one that will fundamentally reshape human experience, society and childhood. As we vitally address the online harms of today, my focus is on the next iteration of the internet—the embodied internet, a transformative evolution fueled by #quantumcomputing, #AI, #biotech, and #decentralization. These technologies are converging to create a digital landscape that is more immersive, personalized, interconnected and powerful than ever before. 🔆 AI is driving unprecedented advancements in how we interact with technology, enabling systems to adapt and respond to human behavior in real time. 🔆 Biotech is blurring the lines between the physical and digital, opening possibilities for human augmentation and new forms of interaction. 🔆 Decentralization is reshaping power structures, offering the potential for greater equity and autonomy in digital spaces, but also raising questions about governance and accountability. 🔆 Quantum computing is unlocking new possibilities in data processing, encryption, and simulation, providing the computational power needed to support these transformative technologies. As we move towards an internet enhanced with #spatialcomputing, where digital experiences become increasingly embodied and integrated into our physical world, we must prioritize the development of frameworks that protect and empower users. I'm committed to fostering these conversations and helping shape a future where innovation and responsibility go hand in hand. . 📚 Essential reading for understanding this future: "The Age of Surveillance Capitalism" by Shoshana Zuboff "Life 3.0: Being Human in the Age of Artificial Intelligence" by Max Tegmark "Reality+" by David Chalmers For more on my work and insights: www.ninajanepatel.com 📸 NBC News #CuriosityShapesTomorrow #SpatialComputing #EmbodiedInternet #DigitalSafety #EmergingTech #AI #Biotech #Decentralization

30

1 Comment

Did a quick GAT analysis of the AI startup ecosystem from 2013 and identified the top 10 most influential investors, including Sequoia Capital, Insight Partners, and NVIDIA, who shape the landscape through their investments and partnerships. Findings provide valuable insights for AI startup founders seeking to raise funds at different stages, with recommendations on which investors to focus on for Series A, Series B, and later rounds. Just a small experiment, have fun. https://lnkd.in/gMJkHqvq

68

5 Comments

👏 The AI-Native Paradigm: Trends and Opportunities in Enterprise AI - In-Depth Enterprise AI Report from the CEOs, CTOs, Chief AI Officers, CISO, EVPs, VPs and IEEE Fellows, ACM Fellows from Pinterest, Zoom, Meta, Amazon, Google and many others led by Fellows Fund! Thorough insights into over 100 companies from Fortune 10 to innovative startups. Thank you for featuring LiveX AI Inc. as one of the AI Native companies! Quote: "Customer Support: AI chatbots and virtual assistants are transforming customer service. Such services on platforms and tools developed by Decagon. ai, Sierra, MavenAGI, and LiveX.ai, provide 24/7, personalized assistance, enhancing user satisfaction and loyalty. They streamline support processes, improve self-service automation, resolve issues faster, and free up human agents for complex tasks. Besides customer support chatbots, LiveX AI elevates support by engaging users early with AI agents, delivering on-the-spot solutions including search and QR codes. It proactively manages churn by addressing issues such as product confusion and cost instantly before escalation, surpassing traditional post-cancellation tactics." Congratulations on others being included 1. Aeolus Robotics 2. Agentic Labs 3. Anglera 4. Anthropic 5. Anyware Robotics 6. Arini 7. Artisan AI 8. Assort Health 9. Automat 10. AWS (Amazon Web Services) 11. Buster so 12. CapCut (Bytedance) 13. Cascading AI 14. Casualy 15. Chef Robotics 16. Chroma 17. Coderabbit 18. Consensus 19. Contextual AI 20. Copy AI 21. Covariant 22. Credal AI 23. Cursor AI 24. DataRobot 25. Databricks 26. Datology 27. Decagon AI 28. Didero AI 29. Dili AI 30. Eleven Labs 31. Evenup 32. Fileread AI 33. Fireworks AI 34. Fume 35. Gamma 36. Google 37. Google DeepMind 38. GCP (Google Cloud Platform) 39. Glean 40. Gretel 41. Greenlite AI 42. Grit 43. Guardrails AI 44. Harvey 45. Hebbia 46. Heygen 47. Hugging Face 48. Hyperbound 49. Imbue 50. InVia Robotics 51. Jasper AI 52. Kaito 53. Kater ai 54. Komment AI 55. Klu AI 56. Langchain 57. Leya 58. LiveX AI 59. LlamaIndex 60. Manifest AI 61. MavenAGI 62. Menza AI 63. Meta 64. Microsoft 65. Motion 66. Nexa AI 67. Newton Research 68. Nomic 69. Norm AI 70. Nvidia 71. Oliv AI 72. Omnisynk AI 73. OpenAI 74. OpusClip 75. Ozaru 76. Patronus AI 77. Perplexity 78. Physical Intelligence 79. Pinecone 80. Play HT 81. Poly AI 82. Qevlar AI 83. Retell AI 84. Second 85. ServiceNow 86. Sierra 87. Skild AI 88. Solve Intelligence 89. Stack AI 90. Suno 91. Taskade 92. Tauvus 93. Tennr 94. Thoughtly 95. Tofu 96. Together AI 97. Tortus ai 98. Truewind 99. Tusk 100. Tutor Intelligence 101. Typeface ai 102. Unstructure 103. Vantage Discovery 104. Vatic Labs 105. Vellum 106. Voyage ai 107. Voiceflow 108. Writesonic 109. Yuma 110. Zendesk #genai #ainative #aiagents #cx #churn #growth

50

2 Comments

Ahead of COMPUTEX 2024... NVIDIA founder and CEO Jensen Huang delivered a keynote address tonight with a focus on what's next for the AI ecosystem and what to expect from the NVIDIA pipeline. His two-hour long speech, including demo, was presented in front of a packed audience at the National Taiwan University auditorium. Jensen's address was live-streamed on YouTube and broadcast on TVBS HD, the leading local cable TV channel. The event upstages tomorrow's COMPUTEX opening keynote by Lisa Su, the CEO of AMD, and speeches by Pat Gelsinger, Intel CEO, Cristiano Amon, CEO of Qualcomm, among other tech luminaries. #nvidia #ai #products #demos #hardware #software

21

3 Comments

From Strategy to Execution: Enterprise AI Deployment Playbook https://buff.ly/4fkQRwC by @rafaigual framework encompassing prep, training, application, and tracking, emphasizing the importance of both company-led and employee-driven Enterprise AI Adoption initiatives! #rafAIgual

2

2 Comments

#AI has become such a pioneering field that it now headlines The Nobel Prize results, marking a historic moment for AI in both physics and chemistry. Geoffrey Hinton and John Hopfield have been awarded the 2024 Nobel Prize in #Physics for their foundational work in artificial neural networks, which are now driving innovation in machine learning. Their breakthroughs have revolutionised how we interact with technology, enabling advancements from language translation to image recognition and even aiding complex physics research. Simultaneously, Sir Demis Hassabis and John Jumper of Google DeepMind have won the Nobel Prize in #Chemistry for their work on AlphaFold, a groundbreaking AI system that predicts protein folding with unprecedented accuracy. This achievement is transforming the fields of biology and medicine, accelerating drug discovery and deepening our understanding of molecular structures. These awards highlight the immense impact of AI across scientific disciplines, proving that machine learning is not just a technological advancement—it’s at the forefront of modern scientific discovery. #NobelPrize2024 #AI #MachineLearning #Physics #Chemistry #DeepMind #AlphaFold #ScientificBreakthroughs #FutureOfAI

10

🔍 OpenAI Strategy Unveiled: Broadcom Partnership in Focus 🚀 Diversification and Strengthening Supply Chain 🔄 Reducing Dependency on Nvidia: OpenAI is aiming to decrease its reliance on Nvidia, a major supplier of GPUs and chips for AI and machine learning. This strategic move seeks to avoid potential supply chain bottlenecks and pricing issues from depending too heavily on one supplier. 🛠️ 🤝 Exploring New Partnerships: By engaging in talks with semiconductor designers like Broadcom, OpenAI is exploring new partnerships. This diversification provides more flexibility and security in its hardware supply chain. 🔗 💡 Developing Custom Chips: OpenAI aims to develop new, custom chips tailored to its AI needs. These chips can be optimized for performance, efficiency, and cost, giving OpenAI a technological edge. ⚙️ 🔧 Strengthening Supply Chain: This move will bolster OpenAI's supply chain, ensuring a more reliable and cost-effective supply of necessary hardware, while mitigating risks associated with supply chain disruptions. 🏗️ 📈 Overall Strategy Implications 🏆 Technological Leadership: Developing custom chips will enhance OpenAI's capabilities, enabling faster innovation and the handling of more complex AI computations. #TechLeadership 💲 Cost Management: Reducing dependency on Nvidia and lowering hardware costs through custom solutions will help OpenAI manage operational costs more effectively. #CostManagement 🔐 Risk Mitigation: Diversifying suppliers and creating in-house solutions will protect OpenAI from supply chain issues and geopolitical risks that could affect a single supplier like Nvidia. #RiskMitigation ⚔️ Competitive Advantage: Custom hardware can offer performance benefits that off-the-shelf solutions might not, potentially giving OpenAI an edge over competitors using standard components. #CompetitiveEdge 🔑 Summary: OpenAI's strategy focuses on diversifying its hardware supply chain, developing custom semiconductor solutions, and reducing reliance on a single supplier. This will enhance its technological capabilities, manage costs, and mitigate risks. #OpenAIStrategy #BroadcomPartnership #TechInnovation

2

Today let's check out what Stanford HAI's AI Index Report found about the utilization of AI in science and medicine.

2

AI agents are evolving rapidly, merging reasoning with tool-calling abilities to tackle complex tasks. This fusion is reshaping how AI interacts with its environment, from web searches to API calls. But it's not without challenges – balancing multiple tasks and selecting the right tools are critical hurdles. As the field progresses, expect to see more specialized models emerge, each fine-tuned for specific functions like planning or tool execution. #AIAgents #GenerativeAI #MachineLearning #TechInnovation #FutureOfAI What specialized AI models are you most excited to see develop?

5