Open Source Realtime Processing Software

The Open Source Computer Vision Library has >2500 algorithms, extensive documentation and sample code for real-time computer vision. It works on Windows, Linux, Mac OS X, Android, iOS in your browser through JavaScript. Languages: C++, Python, Julia, Javascript Homepage: https://opencv.org Q&A forum: https://forum.opencv.org/ Documentation: https://docs.opencv.org Source code: https://github.com/opencv Please pay special attention to our tutorials! https://docs.opencv.org/master Books about the OpenCV are described here: https://opencv.org/books.html

This is YOLO-v3 and v2 for Windows and Linux. YOLO (You only look once) is a state-of-the-art, real-time object detection system of Darknet, an open source neural network framework in C. YOLO is extremely fast and accurate. It uses a single neural network to divide a full image into regions, and then predicts bounding boxes and probabilities for each region. This project is a fork of the original Darknet project.

OpenFace is an advanced facial behavior analysis toolkit intended for computer vision and machine learning researchers, those in the affective computing community, and those who are simply interested in creating interactive applications based on facial behavior analysis. The OpenFace toolkit is capable of performing several complex facial analysis tasks, including facial landmark detection, eye-gaze estimation, head pose estimation and facial action unit recognition. OpenFace is able to deliver state-of-the-art results in all of these mentioned tasks. OpenFace is available for Windows, Ubuntu and macOS installations. It is capable of real-time performance and does not need to run on any specialist hardware, a simple webcam will suffice.

reacTIVision is a computer vision framework for the fast and robust tracking of markers attached on physical objects, and the creation of multi-touch surfaces. It was designed for the rapid development of table-based tangible user interfaces.

The Simd Library is a free open source image processing library, designed for C and C++ programmers. It provides many useful high performance algorithms for image processing such as: pixel format conversion, image scaling and filtration, extraction of statistic information from images, motion detection, object detection (HAAR and LBP classifier cascades) and classification, neural network. The algorithms are optimized with using of different SIMD CPU extensions. In particular the library supports following CPU extensions: SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2 and AVX-512 for x86/x64, VMX(Altivec) and VSX(Power7) for PowerPC, NEON for ARM. The Simd Library has C API and also contains useful C++ classes and functions to facilitate access to C API. The library supports dynamic and static linking, 32-bit and 64-bit Windows, Android and Linux, MSVS, G++ and Clang compilers, MSVS project and CMake build systems.

The Integrating Vision Toolkit (IVT) is a powerful and fast C++ computer vision library with an easy-to-use object-oriented architecture. It offers its own multi-platform GUI toolkit. OpenCV is integrated optionally. Website: http://ivt.sourceforge.net

Marvin is an image processing framework that provides features for image and video frame manipulation, multithreading image processing, image filtering and analysis, unit testing, performance analysis and addition of new features via plug-in.

A paint program where the canvas is the visual cortex of a simple kind of artificial intelligence. You paint with the mouse into its dreams and it responds by changing what you painted gradually. There will also be an API for using it with other programs as a general high-dimensional space. Each pixel's brightness is its own dimension. Bayesian nodes have exactly 3 childs because that is all thats needed to do NAND in a fuzzy way as Bayes' Rule which is NAND at certain extremes. NAND can be used to create any logical system. In this early version, I'm still working on edge detection and its understanding of the same shapes at different brightnesses. This will be a module of the bigger Human AI Net project and will be used for adding realtime intuitive high dimensional intelligence in audio and visual interactions with the user.

Real time face tracking and recognition refers to the task of locating human faces in a video stream and identifying the faces by matching them against the database of known faces.

Action Camera Yi Desktop App 2nd Version is an application that can be used to control Action Camera Yi through Desktop / Computer. This application offers faster data processing. In the Features section, You can see the features offered by this app. This app has the following advantages : -Low Latency Live Streaming.You can use this application for streaming to Streaming Provider (i.e. Youtube). -Adjustable Live Streaming Video’s FPS (Frame Per Second). -Selectable Image Processing for Live Streaming Video using Faster Image Processing. -Download Photo and Video from Album Feature, directly from Computer. -Configurable Action Camera Yi’s Setting from Settings Feature. -Object Detection -Simple Face Detection More Details, New Updates: http://bit.ly/2QHnRHS

Near the surface (even horizon) of a black hole, there is maximum information density in units of squared plancks (and some translation to qubits). Similarly, our imagination is the set of all possible things we can draw onto our most dense layer of visual cortex in electricity patterns. Bigger layers have more neurons to handle those possibilities. A Black Hole Cortex is a kind of visual cortex that has density of neuron layers similar to density at various radius from a black hole. What we think our eyes see, the imagination, is the densest and smallest layer. SphereSurfaces outside it recursively have more neurons, more surface area, but less density since it has to eventually dimension-reduce to high level ideas, like there are 10000 Wikipedia page names that cover most parts of the world. We can think of Wikipedia as a layer above our brains, a global SphereSurface of large surface area (a cortex layered on billions of minds) and small (10000 most important pages) density.

EStereo is a computer vision C++ library for real-time disparity estimation. It computes dense stereo matching from 2 or 3 images as well as 3D scene reconstruction. The library also comes with a GUI-based application (StereoPlus).

An open source computer vision library for TI TMS320C64x DSP. It is compatible with OpenCV.

C++ Computer vision library

Genjutsu-vision is a networked computer vision framework for OpenGL. Based upon GLFW and IPP for optimization, networked computer vision development technologies enable vision analysis of data from multiple sources.

Video processing and computer vision library for GNU/Linux offering interfaces to do image- and video-I/O with ImageMagick/Magick++, Xine, firewire digital camera (DC1394), and video for linux (V4L2). Note that this version of HornetsEye is deprecated. HornetsEye now is released as multiple packages on RubyGems.org. The source code is available on Github.com (see https://wedesoft.github.io/hornetseye-doc/ for more information).

This is an open-source real-time object detection and tracking software for H.264/AVC videos. It applies probabilistic spatiotemporal macroblock filtering (PSMF) and partial decoding processes to effectively detect and track multiple objects with fast computation in H.264|AVC bitstreams with stationary background. The codes were written in Visual C++. For more details, please visit https://www.wonsangyou.com/research/aivision. If you need technical help, please send an email to wyou(at)kaist.ac.kr. When you use this software for your publications, please cite as follows. 1. Wonsang You, M.S. Houari Sabirin, and Munchurl Kim, "Moving object tracking in H.264/AVC bitstream," Lecture Notes in Computer Science, vol. 4577, 2007, pp. 483-492. 2. Wonsang You, M.S. Houari Sabirin, and Munchurl Kim, "Real-time detection and tracking of multiple objects with partial decoding in H.264/AVC bitstream domain," Proceedings of SPIE, vol. 7244, 72440D (February 2009).

A .NET wrapper for OpenCV, a computer vision library. The wrapper is fully developed in C#, making the OpenCV library available to all the .NET based languages, like C#, VB.NET, managed C++, IronPython, F#, etc.

PyTorch-NLP is a library for Natural Language Processing (NLP) in Python. It’s built with the very latest research in mind, and was designed from day one to support rapid prototyping. PyTorch-NLP comes with pre-trained embeddings, samplers, dataset loaders, metrics, neural network modules and text encoders. It’s open-source software, released under the BSD3 license. With your batch in hand, you can use PyTorch to develop and train your model using gradient descent. For example, check out this example code for training on the Stanford Natural Language Inference (SNLI) Corpus. Now you've setup your pipeline, you may want to ensure that some functions run deterministically. Wrap any code that's random, with fork_rng and you'll be good to go. Now that you've computed your vocabulary, you may want to make use of pre-trained word vectors to set your embeddings.

RoboRealm Extensions are plugins to the RoboRealm application that allow you to extend RoboRealm in whatever way you need. RoboRealm is a powerful computer vision based application for use in machine vision, image analysis, and image processing systems.

This is an object recognition library written on top of OpenCV. Scalable Multimodal Object Recognition (SMORs) is designed for real time highly accurate object detection.

Scene is a computer vision framework that performs background subtraction and object tracking, using two traditional algorithms and three more recent algorithms based on neural networks and fuzzy classification rules. For each detected object, Scene sends TUIO messages to one or several client applications. The present release features GPU accelerated versions of all the background subtraction methods and morphological post processing of the object blobs with dilation and erosion filters, implemented in OpenCL. The framework was mainly designed as a toolkit for the rapid development of interactive art projects that explore dynamics of complex environments. The Scene GUI runs and compiles under Windows, Linux, and MacOS X, and is available in both 32 bit and 64 bit versions.

This software uses computer vision algorithms for mining sequence data from telemonitoring data with CBRs. We propose an approach which treats the detection of changes in behavior detected with a sensor/video fusion, which occur at radically different time-scales, through a CBR in two levels: low and high level. The system is always updating the database with the daily data.

Python framework for video processing and content analysis using CUDA for acceleration.

Visage is a human computer interface that aims to replace the traditional mouse with the face. Using a webcam and Visage the movement of the face becomes the movement of the mouse pointer. Left/right Eye blinks fire left/right mouse click events.