Tools tagged with "Reranking"

llama.cpp is a local LLM inference engine for developers building AI applications or running models on hardware they control. It supports language and vision-language models, with command-line tools and a server API for using the engine directly or connecting other software.

OpenRAG is a self-hosted platform for searching documents and asking questions about them through an AI chat interface. It brings Langflow, OpenSearch, and Docling together for developers and teams that want a document knowledge base with control over its retrieval workflows. It's open source under Apache 2.0 and supports self-managed deployment with Docker or Podman.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

vllm-mlx is a local LLM inference server for developers who want to connect AI apps and coding assistants to models running on an Apple Silicon Mac. One process exposes both OpenAI-compatible and Anthropic-compatible APIs. It's open source under Apache 2.0 and runs on macOS with at least 8 GB of unified memory.

Open WebUI is a self-hosted chat workspace for individuals and teams using local LLMs and cloud models. It can work entirely offline with local models.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

RuoYi AI is a self-hosted AI assistant platform for teams building assistants that answer questions about their documents or perform tasks with external tools. It has separate user and admin interfaces.

Vellium is a desktop AI app for writers and people who want conversations with fictional characters. It combines multi-character roleplay with writing projects and lets you choose the model provider.

sage-wiki turns a document collection into a linked wiki and knowledge graph for researchers, teams, and AI agents that need reusable knowledge across tasks.

AQBot is a desktop AI workspace for people who want model chat, coding agents and document search in one app. It keeps application data and user files locally, while requests to cloud models go to their providers.

JARVIS RD Assistant is an open source, self-hosted workspace for researchers who want to search scientific literature and trace AI-generated answers back to papers. It runs on your own hardware with Ollama and connects literature review with PDF annotation, learning cards and research projects. It uses the Apache 2.0 license.

funes gives coding agents a searchable memory of past work. It's for developers who want earlier decisions, reasoning and findings to remain available when they start another session or switch agents.

RESTai is a self-hosted AI platform for developers and teams building document assistants, agents and AI services for other applications. Its web interface manages projects with separate models, prompts and tools, plus a chat playground for testing them.

MindsDB Query Engine gives developers building AI agents one SQL interface for business data and document search. It runs as a standalone server and can also provide data access to MindsHub agents.

M Flow is a self-hosted memory engine for developers whose AI agents need to recall past conversations and work preferences. It runs in Python or Docker and supports Ollama for local model use, alongside providers such as OpenAI and Anthropic. Choosing a cloud provider sends model requests to that service.

Sonar serves language and multimodal models for developers and teams running AI applications on their own hardware. It builds on vLLM and works with Hugging Face-compatible models.

aichat is a terminal AI assistant for people who want to discuss files, generate shell commands and use model-powered tools from the command line. It connects to Ollama, OpenAI, Claude, Gemini and OpenAI-compatible API providers.

LazyLLM is a Python framework for developers building applications with multiple AI agents. It brings application workflows, model training and evaluation together so teams can refine a prototype using task-specific data.

MemSearch gives coding assistants searchable project history across sessions. It's for developers who want to recover earlier fixes, revisit design decisions or continue work in another agent.

PyTerrier is a Python framework for researchers and developers building search systems or the retrieval part of a RAG application. It builds on Terrier and lets you combine retrieval and reranking components into pipelines, then compare their search effectiveness on standard datasets.

total-agent-memory gives AI coding agents persistent memory of decisions, fixes and project conventions across sessions and repositories. It's for developers who don't want to keep explaining earlier work to Claude Code, Codex CLI, Cursor or another MCP client.

ZettaBrain RAG is a self-hosted document assistant for individuals and small teams working with policies, contracts and internal manuals. It helps them find answers and draft documents from files they already keep on their own infrastructure.

MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.

Minima lets you ask questions about your own documents, with a choice of local inference or an external model. It's a self-hosted RAG tool for people and teams who want document-based answers while controlling where indexing and AI processing happen. It runs in Docker containers and is open source under the Mozilla Public License 2.0.

LibreChat is a self-hosted ChatGPT alternative for people and teams who want to use different AI providers in one chat workspace. It lets you switch models while keeping conversations in the same interface.

FlashRank is a Python library that runs reranking models locally on CPU, without Torch or Transformers. It's for developers building search systems or retrieval-augmented generation (RAG) apps who want to reorder retrieved passages by relevance before passing them to an LLM.

Scira is an AI search engine for researching questions across live sources and checking the evidence behind an answer. You can self-host the application, but live research needs internet access and external services.

kotaemon is an open source document chat app for people who want to ask questions across their files and inspect the evidence behind an answer. Developers can also use it to build custom document question-answering applications.

llama-swap is a local AI proxy for people who want several models available to their apps without keeping them all loaded. It starts the server a request needs and replaces the active server when another model is requested.

Sentence Transformers is a Python library for developers building search and document retrieval on their own hardware. It helps match content by meaning and rank results against a query.

Zep Community Edition is a self-hosted memory service for developers building AI agents and conversational assistants. It turns chat history into connected facts so an assistant can recall context across conversations and distinguish current preferences from older ones.

ThinkRAG answers questions about your own documents using a knowledge base on your laptop. It's for researchers, students and other knowledge workers who want to find information across their files, with particular attention to Chinese text.

Twinny is an AI coding assistant for developers who want completion and help with their repository inside VS Code, using models on their own hardware or a chosen server.

Quivr is a content search and monitoring engine for developers building applications around incoming material and topics they want to follow over time. It's at an evaluation stage, and the project advises against production use because its API may change without notice.

Graphiti is a Python framework for developers building AI agents that need to remember information as it changes. It turns conversations, structured records and unstructured text into a queryable graph with a history of facts.

Marginalia is a research agent for people whose papers, notes and working files are spread across a mixed document library. It reads relevant parts of the original files before writing answers with citations.