Meltano

🔧 𝐁𝐮𝐢𝐥𝐝 𝐨𝐧𝐜𝐞. 𝐃𝐞𝐩𝐥𝐨𝐲 𝐚𝐧𝐲𝐰𝐡𝐞𝐫𝐞. We’ve published a practical guide to deploying Meltano + Airflow using modular Terraform and GitHub Actions, with native support for both AWS and Azure. ✅ Environment-specific infrastructure ✅ Container-based orchestration with on-demand Meltano execution ✅ Secure, scalable, and GitOps-friendly ✅ Works across clouds — not tied to one provider 📖 𝐑𝐞𝐚𝐝 𝐭𝐡𝐞 𝐟𝐮𝐥𝐥 𝐚𝐫𝐭𝐢𝐜𝐥𝐞: http://bit.ly/3GCu6YE #dataengineering #elt #meltano #airflow #terraform #aws #azure #githubactions #dataops #snowflake #devops

We've been cooking something new Arch and we're getting closer to bringing more folks on. If you're a data engineer who's tired of getting woken up at 3 am by pipeline failures or spending hours debugging runs that should have been caught automatically - we might have something for you. Imagine you had an ambient data engineer who never sleeps, monitors your data platform, and handles some of the toil of dealing with failed pipelines. We've been dogfooding this internally for our customers and love what it's done for our productivity. If this piques your interest, I'd love either a comment about what challenges you're actually facing with failed pipelines or you can go to our website and signup to be notified when we're ready to open the doors. Drop a comment or check the link below!

ducklake Meltano target coming soon! amazing how responsive DuckDB team is... Mark Raasveldt (DuckDB co-founder) jumping on Github issues within hours.

Data pipelines should be simple, modular, and reproducible from the beginning, especially for a lean data team. That's exactly what I am building with Meltano at SmartTerm Limited: ✅ Meltano EL (extract & load) plugins. ✅ dbt Labs for SQL transformations. ✅ CI/CD orchestrates the entire workflow—no need for Airflow, just seamless automation! ✅ Docker and Makefile ensure everything is reproducible. A special shoutout to Jan Soubusta at GoodData for inspiring this latest project! 🔥 #datapipeline

🐦⬛ Meet Mel, your AI Data Engineer Agent! 🐦⬛ Arch's Agentic AI Data Engineer takes the complexity out of data engineering, making it simple and proactive for your business. From setting up tenants to syncing HubSpot data into Postgres, Mel handles the heavy lifting so you can focus on insights. ✅ Automated setup of tenants, databases, and connections. ✅ Seamless integration, syncing your data to your SaaS and databases. ✅ Proactive health checks and issue resolution—all without manual intervention. Arch isn’t just another AI tool. It’s built to truly understand your data, delivering customized workflows and real-time solutions. 🎥 Watch the video to see how Mel🐦⬛takes care of the boring data business, so you can focus on the business that matters. #AgenticAI #DataEngineering #AIAnalytics https://lnkd.in/gmMswr2m

🌟 New release! We're calling it the "Your data deserves better!" version 🌟(for real) Managing business data shouldn’t be a second job, even for business users! That’s why we built the Arch Data Engine—the powerhouse behind our AI Data Analyst. Don't believe us? See it for yourself here🎥🎥🎥 ✅ Connects directly to your tools—no exporting, no importing. ✅ Organizes your data to fit your business, down to the last metric. ✅ Proactively fills data gaps, so you’re always one step ahead. Say goodbye to dashboard fatigue and hello to instant, tailored insights. Watch the video, read the blog, and discover how Arch makes your data work for you. 👉 https://lnkd.in/empEZkHh #GenAI #Data #Analytics #BusinessIntelligence #Insights

Thrilled to be speaking at The Open Source Analytics Conference (OSA Con) 24 next week! I'll be sharing how Meltano from Arch helps you move data without all the drama (yes that's a thing in the data world!) Whether you're just starting out with data pipelines or looking to streamline an existing setup, this should be a good session for you. Join me on November 19-21 for insights on making data work for you, not the other way around. It’s free and online – hope to see you there! Register at osacon.io #OSACon24 #DataMovement #Meltano #DataWorkflow