Search Results for "pipeline"
Sort By:
Showing 105 open source projects for "pipeline"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
1
Kestra
Kestra is an infinitely scalable orchestration and scheduling platform
...By bringing Infrastructure as Code best practices to data pipelines, Kestra allows you to build reliable workflows and manage them with confidence. Thanks to the declarative YAML interface for defining orchestration logic, everyone who benefits from analytics can participate in the data pipeline creation process. The UI automatically adjusts the YAML definition any time you make changes to a workflow from the UI or via an API call. Therefore, the orchestration logic is defined declaratively in code, even if some workflow components are modified in other ways. -
2
simple-java-maven-app
For an introductory tutorial on how to use Jenkins
...and includes unit tests to validate functionality, with test results exported in JUnit XML format. The repository provides an example that demonstrates how to configure a Jenkins Pipeline for building and delivering applications. It also includes scripts that define commands executed in pipeline stages, showcasing automation in continuous integration and delivery (CI/CD). This project is designed as an entry-level resource for developers learning Jenkins. By following the tutorial, users gain practical experience in setting up pipelines and integrating testing with Maven. -
3
Logstash
Centralize, transform and stash your data
Logstash is a server-side data processing pipeline that dynamically ingests data from numerous sources, transforms it, and ships it to your favorite “stash” regardless of format or complexity. It supports and ingests data of all shapes, sizes and sources, dynamically transforms and prepares this data, and transports it to the output of your choice. Logstash is extensible, with over 200 plugins available to let you create and configure your pipeline how you choose. -
4
AGI (Android GPU Inspector)
Android GPU Inspector
...It helps developers analyze Vulkan and OpenGL ES applications at the system, frame, and draw-call levels to uncover GPU and CPU bottlenecks. AGI captures detailed performance counters, timelines, and pipeline state to reveal stalls, overdraw, shader hotspots, and inefficient resource usage. Its frame debugger lets you step through commands, inspect render targets and textures, review shaders, and experiment with pipeline changes to validate optimizations. Beyond per-frame analysis, AGI correlates GPU activity with CPU threads and system events to diagnose contention, scheduling issues, and thermal or power constraints. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
Dolphin Scheduler
A distributed and extensible workflow scheduler platform
Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available `out of the box`. Dedicated to solving the complex task dependencies in data processing, making the scheduler system out of the box for data processing. Decentralized multi-master and multi-worker, HA is supported by itself, overload processing. All process definition operations are visualized, Visualization process defines key information at a glance, One-click deployment. ... -
6
Apache SeaTunnel
SeaTunnel is a distributed, high-performance data integration platform
SeaTunnel is a very easy-to-use ultra-high-performance distributed data integration platform that supports real-time synchronization of massive data. It can synchronize tens of billions of data stably and efficiently every day, and has been used in the production of nearly 100 companies. There are hundreds of commonly-used data sources of which versions are incompatible. With the emergence of new technologies, more data sources are appearing. It is difficult for users to find a tool that can... -
7
Flink CDC
Flink CDC is a streaming data integration tool
...It leverages Change Data Capture (CDC) technology to stream data changes into Apache Flink, enabling real-time analytics and data processing. Flink CDC simplifies data pipeline development with its declarative YAML configurations. -
8
X's Recommendation Algorithm
Source code for the X Recommendation Algorithm
...It provides transparency into how tweets are selected, prioritized, and surfaced to users, reflecting Twitter’s move toward openness in recommendation algorithms. The repository contains the recommendation pipeline, which incorporates signals such as engagement, relevance, and content features, and demonstrates how they combine to form ranked outputs. Written primarily in Scala, it shows the architecture of large-scale recommendation systems, including candidate sourcing, ranking, and heuristics. While certain components (such as safety layers, spam detection, or private data) are excluded, the release provides valuable insights into the design of real-world machine learning–driven ranking systems. ... -
9
SoapUI
SoapUI is a free and open source cross-platform functional testing
...See the SoapUI website to learn more. By downloading our software, you agree to our license and privacy policy. Automate and fit API testing into your team’s continuous delivery pipeline with the next-generation tool built for validation of REST, SOAP, GraphQL, microservices, and other back-end services. This is for developers and testers looking to accelerate their ability to deliver REST, SOAP, and GraphQL APIs. SoapUI Open Source is the simplest and easiest way to begin your API testing journey. APIs, or Application Programming Interfaces, have become the center of software development, connecting and transferring data and logic across disparate systems and applications. ... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Stanford CoreNLP
Stanford CoreNLP, a Java suite of core NLP tools
...CoreNLP enables users to derive linguistic annotations for text, including token and sentence boundaries, parts of speech, named entities, numeric and time values, dependency and constituency parses, coreference, sentiment, quote attributions, and relations. CoreNLP currently supports 6 languages, Arabic, Chinese, English, French, German, and Spanish. The centerpiece of CoreNLP is the pipeline. Pipelines take in raw text, run a series of NLP annotators on the text, and produce a final set of annotations. Pipelines produce CoreDocuments, data objects that contain all of the annotation information, accessible with a simple API, and serializable to a Google Protocol Buffer. CoreNLP generates a variety of linguistic annotations, including parts of speech, named entities, dependency parses, and coreference. -
11
Armeria
Your go-to microservice framework for any situation
Build a reactive microservice at your pace, not theirs. Armeria is your go-to microservice framework for any situation. You can build any type of microservice leveraging your favorite technologies, including gRPC, Thrift, Kotlin, Retrofit, Reactive Streams, Spring Boot and Dropwizard. Let's embrace the reality, we almost always have to deal with more than one protocol. It was once Thrift, today it's gRPC, and REST never gets old. At the same time, you sometimes have to handle health check... -
12
Apache Baremaps
Create custom vector tiles from OpenStreetMap
Baremaps is an Apache Incubator project that provides tools and a Java-based pipeline for building and rendering vector tiles from OpenStreetMap (OSM) data. It’s designed for fast map generation, serving tiles, and supporting real-time updates, making it a powerful backend for map-based applications. -
13
FIT Framework
An enterprise-level AI development framework
FIT Framework is an open-source infrastructure designed to support the development, training, and evaluation of machine learning and AI models through a modular and scalable architecture. It aims to streamline the lifecycle of AI systems by providing standardized components for data processing, model training, evaluation, and deployment. The framework is particularly useful for research and production environments where reproducibility and consistency are critical, as it enforces structured... -
14
wlmedia
Next audio and video player SDK
wlmedia is a multimedia processing and playback project designed to provide tools for handling video and audio content in lightweight environments. It focuses on integrating FFmpeg capabilities into streamlined workflows for decoding, encoding, and playback. The project includes support for multiple media formats and emphasizes performance and efficiency in resource-constrained systems. It demonstrates how to build media pipelines that handle playback, processing, and format conversion.... -
15
Glide
Android image loading & caching library focused on smooth scrolling
...It supports fetching, decoding and displaying images, video stills as well as animated GIFs, with a simple and easy to use interface and API. Glide offers a performant and extensible resource decoding pipeline and automatic resource pooling, and a flexible API that allows developers to plug in to just about any network stack. It is primarily focused on making any type of a list of images as smooth and fast as possible, and is able to achieve this through smart and automatic downsampling and caching, aggressive re-use of resources and deep lifecycle integration. ... -
16
Spring for GraphQL
Spring Integration for GraphQL
Spring for GraphQL provides support for Spring applications built on GraphQL Java. It is a joint collaboration between the GraphQL Java team and Spring engineering. Our shared philosophy is to provide as little opinion as we can while focusing on comprehensive support for a wide range of use cases. Spring for GraphQL is the successor of the GraphQL Java Spring project from the GraphQL Java team. It aims to be the foundation for all Spring, GraphQL applications. The project reached version... -
17
Spring Cloud Config Server
External configuration (server and client) for Spring Cloud
...The concepts on both client and server map identically to the Spring Environment and PropertySource abstractions, so they fit very well with Spring applications but can be used with any application running in any language. As an application moves through the deployment pipeline from dev to test and into production, you can manage the configuration between those environments and be certain that applications have everything they need to run when they migrate. The default implementation of the server storage backend uses git, so it easily supports labelled versions of configuration environments as well as being accessible to a wide range of tooling for managing the content. ... -
18
Google Cloud Dataflow Template Pipelines
Cloud Dataflow Google-provided templates for solving data tasks
DataflowTemplates is the source repository for Google-provided Dataflow templates that are intended to solve large-scale in-cloud data processing tasks without requiring users to build everything from scratch in a full development environment. The repository is centered on templated pipelines powered by Google Cloud Dataflow and Apache Beam, making it easier to run common integration and movement jobs such as data import, export, backup, restore, and bulk API operations. Its structure shows... -
19
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
Confidently evaluate, test, and monitor LLM applications. Opik is an open-source platform for evaluating, testing, and monitoring LLM applications. Built by Comet. Record, sort, search, and understand each step your LLM app takes to generate a response. Manually annotate, view, and compare LLM responses in a user-friendly table. Log traces during development and in production. Run experiments with different prompts and evaluate against a test set. Choose and run pre-configured evaluation... -
20
Siddhi Core Libraries
Stream Processing and Complex Event Processing Engine
Fully open source, cloud-native, scalable, micro streaming, and complex event processing system capable of building event-driven applications for use cases such as real-time analytics, data integration, notification management, and adaptive decision-making. Event processing logic can be written using Streaming SQL queries via graphical and source editors, to capture events from diverse data sources, process and analyze them, integrate with multiple services and data stores, and publish... -
21
GoCD
Main repository for GoCD, continuous delivery server
...GoCD excels at modeling complex CD workflows for fast feedback with its modeling constructs, parallel execution and dependency management. No plugin required, out of box CD. GoCD helps you troubleshoot a broken pipeline by tracking every change from commit to deploy in real time. Compare content, both files and commit messages, across any two arbitrary builds. GoCD integrates with many popular external tools and services via its extensible plugin architecture. We have put a lot of thought into making sure GoCD upgrades are painless and non-breaking even when you are using plugins. -
22
Netty
An event-driven asynchronous network application framework
Netty is an asynchronous, event-driven networking framework for the JVM that simplifies building high-performance clients and servers. It wraps Java NIO with a channel/handler pipeline model, enabling clean composition of codecs, TLS, and application logic with minimal overhead. Its ByteBuf abstractions, buffer pooling, and zero-copy techniques help reduce GC pressure and improve throughput under heavy I/O. Support for common protocols—HTTP/1.1, HTTP/2, WebSocket, and raw TCP/UDP—makes it a foundation for RPC frameworks, proxies, and messaging systems. ... -
23
Fresco
An Android library for managing images and the memory they use
Fresco’s image pipeline will load images from the network, local storage, or local resources. To save data and CPU, it has three levels of cache; two in memory and another in internal storage. Fresco’s Drawee shows a placeholder for you until the image has loaded and then automatically shows the image when it arrives. When the image goes off-screen, it automatically releases its memory. -
24
Jaffree
Java ffmpeg and ffprobe command-line wrapper
Jaffree is a Java library that provides a clean and modern API for interacting with FFmpeg, allowing developers to programmatically execute multimedia processing tasks. It abstracts the complexity of command-line FFmpeg usage by offering strongly typed Java classes for configuring inputs, outputs, codecs, and filters. The library supports streaming data, handling real-time processing scenarios, and integrating FFmpeg pipelines directly into Java applications. It is designed for flexibility... -
25
Pentaho
Pentaho offers comprehensive data integration and analytics platform.
Pentaho couples data integration with business analytics in a modern platform to easily access, visualize and explore data that impacts business results. Use it as a full suite or as individual components that are accessible on-premise, in the cloud, or on-the-go (mobile). Pentaho enables IT and developers to access and integrate data from any source and deliver it to your applications all from within an intuitive and easy to use graphical tool. The Pentaho Enterprise Edition Free Trial...
