Lee Jones

I've read some debate around whether or not to skip this badge, but I'd definitely recommend to do the Databricks Certified Data Engineer Associate exam, it reinforces and demonstrates core product knowledge. Looking forward to self-prepping the Professional badge over the coming weeks! #databricks #dataengineer #dataarchitect #databrickscertified

23

5 Comments

Metadata is a key asset in your data estate, but the term is broadly used. So let’s break it down… In the latest episode of our “Data Engineering in Five Minutes" series, Harry Cummings—our Principal Technical Consultant—discusses the different categories of “data about data.” #DataManagement #MetaData #DataEngineering

31

Brendan Grady of Qlik has some advice for enterprise companies thinking of building their own LLMs. Please don’t! Join Brian Booden and George Beaton every Tuesday fortnight for another episode of TDM - The Data Mix where we chat with the best guest from the world of data and technology. Or catch us on our YouTube channel at https://lnkd.in/eVwkBNXW

2

Exciting news! Cortex Analyst now supports joins for Star and Snowflake schemas, empowering business users to generate insights from complex, multi-table data with ease. With a remarkable 92% SQL accuracy, Cortex Analyst surpasses other solutions, ensuring reliable answers for intricate queries. 🌟 Supporting joins in a text-to-SQL system is far from as simple as just joining two tables. It requires thoughtful handling of join paths, join types, disambiguation, aggregation, and distinctness, along with careful parsing to generate SQL that accurately reflects the user’s question. Learn more about our approach to solving these challenges while maintaining high accuracy: https://okt.to/VNhGXZ

166

7 Comments

AI isn’t the end for data practitioners. Very much the opposite. Barry McCardel, the co-founder and CEO of Hex, is bullish on a new golden era of data teams, because, “There's an infinite demand for insight and an infinite demand for data work.” Barry joins Tristan Handy on the Analytics Engineering Podcast to discuss the hype cycle of data science, how AI is different, the experience of building AI products, and how AI will impact data practitioners. https://lnkd.in/d-hfmisr

53

It's Day 2 in our Snowflake mini-series. Since being founded in 2012, it's fair to say Snowflake has been pretty transformative to data teams' lives worldwide. Here are some of the ways how Snowflake revolutionised Big Data: 1️⃣ Separation of Storage and Compute: - Before Snowflake, businesses had to deal with monolithic architectures where storage and compute were tightly coupled, leading to inefficiencies and high costs - Snowflake’s architecture decoupled storage from compute resources, allowing businesses to scale independently. This means you only pay for what you use, optimising costs and performance. 2️⃣ Data Sharing and Collaboration: - Sharing data across organisations used to mean cumbersome data transfers and security risks. - Snowflake’s secure data-sharing features allows for instant, controlled access to live data without the need to move or copy it. - This has enabled real-time collaboration across organisations and created a dynamic ecosystem where partners, vendors, and customers can seamlessly interact. 3️⃣ True Multi-Cloud Capability: - With Snowflake, you’re not tied to a single cloud provider. Businesses can deploy across AWS, Google Cloud, and Microsoft Azure, leveraging the strengths of each. - This multi-cloud strategy ensures high availability, disaster recovery, and vendor independence, offering unparalleled flexibility and global reach. - Previously, organisations were often locked into a single cloud provider, limiting flexibility and increasing risk. If you want to find out how Orchestra can further revolutionise life for Snowflake users, check out for yourself down below! ➡ https://lnkd.in/eM6uqgCU #BigData #CloudComputing #Snowflake #Innovation

6

2 Comments

The Future of AI and Data Management: Key Takeaways from Databricks 💡 Chris Marshall, Lead Architect at Optima Partners, recently attended the Databricks Data+AI World Tour in London, where AI and data management took centre stage. He shared key insights on: ➡ How generative AI is revolutionising complex processes and accelerating innovation. ➡ Tools like AI/BI Genie are simplifying access to valuable insights. ➡ Why open-source AI is affordable, powerful, and levelling the playing field for businesses. ➡ The growing focus on data governance and compliance in the age of AI. Read his full insights here: https://lnkd.in/eDUNcZ84 #Databricks2024 #AI #GenerativeAI #MachineLearning #OptimaPartners #Innovation #DataGovernance

30

3 Comments

👏 Opendatasoft joins Databricks partner program 🤝 Opendatasoft today announced its partnership with Databricks, the data and AI company, becoming a Validated Databricks Technical Partner, enabling it to deliver innovative new ways to access data, and help organisations maximise value from their data programs. 🔄️ As a validated Databricks Technical Partner, Opendatasoft has developed an integration connector to enable its customers to seamlessly access and reuse data assets. ""We are focused on accelerating data use to increase productivity, enable better decision-making and reduce risk. This partnership offer users innovative new ways to access and harness information"" - Jean-Marc Lazard, CEO and co-founder, Opendatasoft. 🔎 Read the full press release here: https://lnkd.in/ey2nQP5F #data #dataportal #datademocratization

10

On Wednesday 29th May (so, next week!) Susan Walsh - The Classification Guru, will be hosting a roundtable for Solutions Review on the Impact of Bad Data on GenAI, with Darshana Sivakumar from Databricks, and Millie Beetham from ZoomInfo. What you can expect: 💡 Why bad data is the problem 💡 How data experts help companies build a unified data foundation that fixes the bad data problem 💡 How this foundation can be leveraged to easily scale and use data + AI for GenAI If you want to join in on this fantastic discussion, you can do so right here on LinkedIn ➡ https://lnkd.in/e-3emib2

30

2 Comments

What if setting up a Data Lakehouse didn’t have to be complicated? 🤔 Join our free, hands-on workshop held in our London office, led by our very own Simon Whiteley, bringing extensive experience with Databricks. Get to grips with the Databricks Lakehouse - no fluff, just practical, essential guidance. Here’s what we’ll cover: 🏅 Medallion Architecture 📑 Basic Reading, Writing & Transforming 🤝 Governing with Unity Catalog + Feature Overview 🤖 Databricks SQL for Warehousing and Analysing Data If you want to explore how this can improve your data architecture, we’d love to see you there. Spaces are limited, so we're using a waitlist system - grab your spot now! 🔗 Register here: https://hubs.la/Q02QVgwc0 #Databricks #DataEngineering #SQL #UnityCatalog

80

1 Comment

Happening tomorrow! Wednesday 29th May - Susan Walsh - The Classification Guru, will be hosting a roundtable for Solutions Review on the Impact of Bad Data on GenAI, with Darshana Sivakumar from Databricks, and Millie Beetham from ZoomInfo. What you can expect: 💡 Why bad data is the problem 💡 How data experts help companies build a unified data foundation that fixes the bad data problem 💡 How this foundation can be leveraged to easily scale and use data + AI for GenAI If you want to join in on this fantastic discussion, you can do so right here on LinkedIn ➡ https://lnkd.in/e-3emib2

12

2 Comments

🦆 What makes a Great Data Leader? 🦆 Data Engineers London recently had the pleasure of hearing from Nik Walker, Head of Data Engineering at Co-op, who delivered an absolutely quack-tastic talk on the power of human-centric leadership for data teams. Nik certainly brought his learned own views, but not just that; he guided us through a thoughtful exploration of how empathy, trust, and open communication are the real engines driving successful teams. And yes, there were a few quacks along the way to keep things lively! 🦆😅 The best part? Nik’s insights aren’t just for those leading teams - there’s something valuable here for anyone working in data. Trust us, it’s worth a watch! Some of the highlights! 🎥 Human-Centric Leadership 🤝  People over technology. Understanding your team’s emotions and needs is key to tackling any challenge. Trust & Vulnerability 🚀  Effective leaders build trust by being open and showing vulnerability—this creates a space where teams feel empowered to innovate and take risks. Psychological Safety 💬  Safe spaces aren’t just buzzwords. They’re essential for fostering honest conversations, admitting mistakes, and driving innovation. Inclusivity 🌍  Valuing every voice on the team leads to richer ideas and solutions—diversity truly drives creativity. Continuous Learning 🧠  Never stop learning! Encouraging ongoing development keeps the team adaptable and engaged in a fast-changing field. And perhaps the most resonant takeaway? Servant Leadership 🏅 Prioritising the team’s needs above your own cultivates a loyal, motivated, and highly effective team. Check it out now! - https://lnkd.in/eN8d4rye Thanks to our sponsors Kyndryl for your support, and Zego for hosting us! And thanks from us to you all in the community! Make sure you join our community page for the next event! Anna Aleshko, Jamie Marney & Harry Duddridge #DataEngineering #Leadership #EmpathyInTech #Data #TeamCulture #ContinuousLearning #Humancentricleadership

8

3 Comments

Databricks users - it's time to take your geo cloud-native! ☁️ Our integration with Databricks allows you to perform advanced spatial analysis & visualizations right where your data lives, meaning improved speed, security & scalability! Get started 👉 https://hubs.ly/Q02LrmkB0

10

Great way to get started as you plan your data governance and discoverability evolution with #Azure Databricks Unity Catalog. The first part of any journey, is knowing where you're starting from. Love this initiative to help customer get started Advancing Analytics 🙌

5

Is AI going to replace data teams? Not quite. There’s a lot of buzz (and many misconceptions) about AI’s potential role within data teams—and it’s easy to get caught up in the hype. In our latest post, we tackle four common myths about adopting AI:
 1️⃣ AI replaces data teams

 2️⃣ Implementing AI is plug-and-play
 3️⃣ AI runs itself 4️⃣ AI solves all data problems Time to put these myths to bed. ➡️ https://hubs.li/Q02W6XxL0 #data #ai #dataculture

8

The data engineering landscape is evolving! 🚀 The shift from a “modern” to a “postmodern” data stack is reducing complexity and paving the way for productivity, AI integration, and enhanced governance. Explore insights from Matillion’s CEO Matthew Scullion and data expert Joe Rees on how this unified approach transforms data strategies.

2