Showing 1251 open source projects for "pipeline"

View related business solutions
  • One Monitoring Tool for IT, OT and Cloud | Free Trial Icon
    One Monitoring Tool for IT, OT and Cloud | Free Trial

    Vendor-agnostic monitoring across on-prem servers, cloud platforms and OT devices, all in one dashboard. No more tool sprawl.

    Modern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
    Try PRTG Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    IVY

    IVY

    The Unified Machine Learning Framework

    Take any code that you'd like to include. For example, an existing TensorFlow model, and some useful functions from both PyTorch and NumPy libraries. Choose any framework for writing your higher-level pipeline, including data loading, distributed training, analytics, logging, visualization etc. Choose any backend framework which should be used under the hood, for running this entire pipeline. Choose the most appropriate device or combination of devices for your needs. DeepMind releases an awesome model on GitHub, written in JAX. We'll use PerceiverIO as an example. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Eden Emulator

    Eden Emulator

    Free and opensource (FOSS) Switch 1 emulator

    Eden Emulator is an experimental open-source emulator designed to replicate Nintendo Switch hardware with a focus on stability and performance improvements. It builds on modern emulation techniques to deliver smoother gameplay and better compatibility with newer titles. The project emphasizes frequent updates that reduce graphical glitches, improve rendering pipelines, and enhance overall system stability. Eden supports multiple platforms, including desktop and mobile environments, expanding...
    Downloads: 138 This Week
    Last Update:
    See Project
  • 3
    AI Website Cloner Template

    AI Website Cloner Template

    Clone any website with one command using AI coding agents

    ...It automates the process of analyzing a target website, extracting its design system, and rebuilding it using technologies such as Next.js, React, and Tailwind CSS. The system operates through a multi-stage pipeline that includes reconnaissance, component specification, parallel generation, and final assembly, ensuring high fidelity to the original design. It leverages AI agents to perform tasks such as capturing layouts, extracting styles, and generating code for each component. The template is designed for flexibility, allowing developers to customize the generated output or adapt it for different use cases such as migrations or learning. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 4
    learn-ffmpeg

    learn-ffmpeg

    Learn audio and video knowledge, organize materials

    ...It covers a wide range of topics, including encoding, decoding, transcoding, and streaming workflows. The repository is designed to guide users from basic command usage to advanced media pipeline development. It includes practical examples that demonstrate how to apply FFmpeg in real-world scenarios. The content is organized to serve both as a learning resource and a quick reference for developers. It also highlights common patterns and best practices for working with multimedia systems. Overall, it functions as a comprehensive guide for understanding FFmpeg capabilities and applications.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Start Free
  • 5
    AutoResearchClaw

    AutoResearchClaw

    Autonomous research from idea to paper. Chat an Idea. Get a Paper 🦞

    AutoResearchClaw is an open-source framework designed to automatically generate full academic research papers from a single idea or topic. Built in Python, it orchestrates a multi-stage research pipeline that gathers literature, formulates hypotheses, runs experiments, analyzes results, and writes the final paper. The system retrieves real academic references from sources such as arXiv and Semantic Scholar to ensure credible citations. It can automatically generate code for experiments, run them in a sandbox environment, and analyze the results with statistical methods. ...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 6
    gpt-llm-trainer

    gpt-llm-trainer

    Experimental notebook pipeline for creating language models

    gpt-llm-trainer is an experimental notebook pipeline for creating task-specific fine-tuned language models from a plain task description. It reduces the work normally required to collect examples, format a dataset, split training and validation data, and run fine-tuning code. The system can generate prompts and responses with larger models, then prepare that synthetic dataset for model training.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 7
    deepface

    deepface

    A Lightweight Face Recognition and Facial Attribute Analysis

    DeepFace is a lightweight face recognition and facial attribute analysis (age, gender, emotion and race) framework for python. It is a hybrid face recognition framework wrapping state-of-the-art models: VGG-Face, FaceNet, OpenFace, DeepFace, DeepID, ArcFace, Dlib, SFace and GhostFaceNet. Experiments show that human beings have 97.53% accuracy on facial recognition tasks whereas those models already reached and passed that accuracy level.
    Downloads: 23 This Week
    Last Update:
    See Project
  • 8
    Covalent workflow

    Covalent workflow

    Pythonic tool for running machine-learning/high performance workflows

    Covalent is a Pythonic workflow tool for computational scientists, AI/ML software engineers, and anyone who needs to run experiments on limited or expensive computing resources including quantum computers, HPC clusters, GPU arrays, and cloud services. Covalent enables a researcher to run computation tasks on an advanced hardware platform – such as a quantum computer or serverless HPC cluster – using a single line of code. Covalent overcomes computational and operational challenges inherent...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 9
    Ansible Semaphore

    Ansible Semaphore

    Modern UI for Ansible

    ...We understand this and therefore are actively developing Ansible Semaphore in this direction. The separation of task into build and deployment allows you to safely update your production environment. The pipeline is a key element of any CI/CD system. Thanks to it, the system goes from code to finished product. Ansible Semaphore is beautiful web interface for running Ansible playbooks. You do not need to change your playbooks to start using it.
    Downloads: 3 This Week
    Last Update:
    See Project
  • Veeam Data Platform v13.1 Icon
    Veeam Data Platform v13.1

    Move workloads across hypervisors and clouds with no vendor lock-in. Try VDP free today.

    Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
    Try Now
  • 10
    KrillinAI

    KrillinAI

    Video translation and dubbing tool powered by LLMs

    KrillinAI is an end-to-end content localization, translation, and dubbing tool aimed at helping creators transform videos into multiple languages with minimal manual effort. It integrates several stages of the pipeline: video acquisition (either from local files or remote via download tools), speech recognition (ASR), subtitle segmentation and alignment, machine translation (with context-aware translation to preserve semantics), and voice cloning + text-to-speech (TTS) to produce dubbed audio tracks. KrillinAI supports both landscape and portrait videos, which makes it suitable for a wide range of platforms — from YouTube to TikTok or other vertical-video sites — and ensures correct formatting and layout for the final video. ...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 11
    GitVersion

    GitVersion

    From git log to SemVer in no time

    ...Gitversion is highly configurable and can be made to support your specific versioning scheme, almost regardless of what it may be. Expose version variables in different formats to the tools you use. Use GitVersion locally or in a build pipeline with TeamCity, AppVeyor, Jenkins or any of the other supported build servers. GitVersion is a tool that generates a Semantic Version number based on your Git history. The version number generated from GitVersion can then be used for various different purposes. GitVersion can be used in a Continuous Server pipeline to generate a version number that both labels the build itself and makes the different version variables available to the rest of the build pipeline.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Drone

    Drone

    Drone is a Container-Native, Continuous Delivery Platform

    ...Drone works with any language, database, or service that runs inside a Docker container. Choose from thousands of public Docker images or provide your own. Drone uses containers to drop pre‑configured steps into your pipeline. Choose from hundreds of existing plugins, or create your own. Drone makes advanced customization easy. Implement custom access controls, approval workflows, secret management, yaml syntax extensions, and more.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    RuView

    RuView

    Turn WiFi signals into real-time human sensing and spatial awareness.

    RuView is an edge AI perception system that transforms ordinary WiFi signals into real-time environmental sensing and human pose estimation. Built on the concept of WiFi DensePose, it analyzes disturbances in WiFi Channel State Information (CSI) caused by human movement to reconstruct body position, breathing patterns, heart rate, and presence. Unlike traditional vision systems, RuView operates without cameras, wearables, or cloud connectivity, making it a privacy-first sensing solution. The...
    Downloads: 237 This Week
    Last Update:
    See Project
  • 14
    SAG

    SAG

    SQL-Driven RAG Engine

    ...These vectors allow the system to identify relationships between concepts and construct a graph representation of knowledge at runtime. The architecture also includes a three-stage retrieval pipeline consisting of recall, expansion, and reranking steps to improve search accuracy. The engine integrates semantic vector similarity with traditional full-text search to improve both recall and precision. Because the knowledge graph is generated dynamically, the system can adapt to new information without requiring manual graph maintenance.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 15
    Concourse

    Concourse

    Concourse is a container-based continuous thing-doer written in Go

    Built on the simple mechanics of resources, tasks, and jobs, Concourse presents a general approach to automation that makes it great for CI/CD. Concourse is designed to be expressive, versatile, and safe, remaining intuitive as the complexity of your project grows. A Concourse pipeline is like a distributed, continuous Makefile. Each job has a build plan declaring the job's input resources and what to run with them when they change. Your pipeline is then visualized in the web UI, taking only one click to get from a failed job to seeing why it failed. The visualization provides a "gut check" feedback loop: if it looks wrong, it probably is wrong. ...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 16
    OpenMontage

    OpenMontage

    World's first open-source, agentic video production system

    OpenMontage is an open-source, agent-driven video production system that transforms AI coding assistants into fully automated multimedia creation pipelines. Instead of focusing on a single capability such as text-to-video generation, it treats video production as a structured, multi-stage workflow that mirrors how a real production team operates, including research, scripting, asset generation, editing, and final rendering. The system orchestrates a large collection of tools and models...
    Downloads: 160 This Week
    Last Update:
    See Project
  • 17
    AI Hedge Fund

    AI Hedge Fund

    An AI Hedge Fund Team

    ...The project underlines AI’s potential in investment strategies but also carries disclaimers that it is for research and not financial advice. The implementation is designed so developers can study the pipeline end-to-end: from data ingestion through modeling to simulated portfolio management.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    Career-Ops

    Career-Ops

    AI-powered job search system built on Claude Code

    Career Ops is an open-source platform designed to help individuals manage their job search process with a structured, operations-style approach that treats career development like a pipeline. It provides a system for organizing job applications, tracking progress across different stages, and maintaining visibility into opportunities, much like a lightweight CRM tailored for job seekers. The project emphasizes clarity and accountability, enabling users to monitor applications, follow-ups, and outcomes in a centralized environment. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 19
    TradingAgents

    TradingAgents

    Chinese Financial Trading Framework Based on Multi-Agent LLM

    ...It organizes market-related tasks into roles and stages so different agents can contribute research, reasoning, aggregation, and decision support in a structured pipeline. The project is oriented toward practical usage, including a stack that can be run in a modern development environment and commonly paired with containerized backends, configuration files, and service components. It also pays attention to distribution and misuse risks, clearly warning users about unauthorized commercial repackaging and stating that commercial use requires explicit authorization while personal use is open.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 20
    Apache SeaTunnel

    Apache SeaTunnel

    SeaTunnel is a distributed, high-performance data integration platform

    SeaTunnel is a very easy-to-use ultra-high-performance distributed data integration platform that supports real-time synchronization of massive data. It can synchronize tens of billions of data stably and efficiently every day, and has been used in the production of nearly 100 companies. There are hundreds of commonly-used data sources of which versions are incompatible. With the emergence of new technologies, more data sources are appearing. It is difficult for users to find a tool that can...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 21
    Goose Swift

    Goose Swift

    Goose Swift proof-of-concept README

    ...It turns available signals into health, recovery, sleep, strain, stress, cardio, energy, coach, and debug views. The project includes a SwiftUI app, a Rust bridge, HealthKit support, a workout Live Activity extension, and internal documentation for its MVP pipeline. It is best understood as an experimental, independent wearable-data project rather than a finished consumer health tracker.
    Downloads: 40 This Week
    Last Update:
    See Project
  • 22
    WeKnora

    WeKnora

    LLM framework for document understanding and semantic retrieval

    ...WeKnora is designed with a modular architecture that separates components for document processing, search strategies, and model inference, allowing developers to customize or extend different parts of the pipeline. It supports knowledge base management and conversational question answering built on top of structured and unstructured documents.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 23
    X's Recommendation Algorithm

    X's Recommendation Algorithm

    Source code for the X Recommendation Algorithm

    ...It provides transparency into how tweets are selected, prioritized, and surfaced to users, reflecting Twitter’s move toward openness in recommendation algorithms. The repository contains the recommendation pipeline, which incorporates signals such as engagement, relevance, and content features, and demonstrates how they combine to form ranked outputs. Written primarily in Scala, it shows the architecture of large-scale recommendation systems, including candidate sourcing, ranking, and heuristics. While certain components (such as safety layers, spam detection, or private data) are excluded, the release provides valuable insights into the design of real-world machine learning–driven ranking systems. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 24
    nanoGPT

    nanoGPT

    The simplest, fastest repository for training/finetuning models

    ...It distills the GPT architecture into a few hundred lines of Python code, making it far easier to understand than large, production-scale implementations. The repo is organized with a training pipeline (dataset preprocessing, model definition, optimizer, training loop) and inference script so you can train a small GPT on text datasets like Shakespeare or custom corpora. It emphasizes readability and clarity: the training loop is cleanly written, and the code avoids heavy abstractions, letting students follow the architecture step by step. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 25
    DeepSeek-OCR

    DeepSeek-OCR

    Contexts Optical Compression

    ...The system treats OCR not simply as “read the text” but as “understand what the text is doing in the image”—for example distinguishing captions from body text, interpreting tables, or recognizing handwritten versus printed words. It supports local deployment, enabling organizations concerned about privacy or latency to run the pipeline on-premises rather than send sensitive documents to third-party cloud services. The codebase is written in Python with a focus on modularity: you can swap preprocessing, recognition, and post-processing components as needed for custom workflows.
    Downloads: 4 This Week
    Last Update:
    See Project