Audience
IT teams requiring a service for creating and managing Apache Kafka clusters
About Yandex Managed Service for Apache Kafka
Focus on developing data stream processing applications and don’t waste time maintaining the infrastructure. Managed Service for Apache Kafka is responsible for managing Zookeeper brokers and clusters, configuring clusters, and updating their versions. Distribute your cluster brokers across different availability zones and set the replication factor to ensure the desired level of fault tolerance. The service analyzes the metrics and status of the cluster and automatically replaces it if one of the nodes fails. For each topic, you can set the replication factor, log cleanup policy, compression type, and maximum number of messages to make better use of computing, network, and disk resources. You can add brokers to your cluster with just a click of a button to improve its performance, or change the class of high-availability hosts without stopping them or losing any data.
Other Popular Alternatives & Related Software
Yandex Managed Service for Elasticsearch
Get access to new functionalities, security patches, and other Elasticsearch improvements with official subscriptions. You can deploy a ready-to-use cluster in just a few minutes. Elasticsearch and Kibana stack settings are initially optimized for the cluster size you selected. Invest your time in your project, and we’ll take care of cluster maintenance, software backups, monitoring, fault tolerance, and updates. Index sharding reduces the load on each host and makes it easy to scale a cluster under peak loads. It’s much easier to develop an infrastructure if you have a visual representation of system behavior. Create trends, make forecasts, and evaluate system stability in a user-friendly interface. To create fault-tolerant geo-distributed Elasticsearch and Kibana clusters, just select the number of hosts and specify availability zones. Select the necessary computing capacity and create a ready-to-use Elasticsearch cluster.
Learn more
Apache Kafka
Apache Kafka® is an open-source, distributed streaming platform. Scale production clusters up to a thousand brokers, trillions of messages per day, petabytes of data, hundreds of thousands of partitions. Elastically expand and contract storage and processing. Stretch clusters efficiently over availability zones or connect separate clusters across geographic regions. Process streams of events with joins, aggregations, filters, transformations, and more, using event-time and exactly-once processing. Kafka’s out-of-the-box Connect interface integrates with hundreds of event sources and event sinks including Postgres, JMS, Elasticsearch, AWS S3, and more. Read, write, and process streams of events in a vast array of programming languages.
Learn more
Yandex Managed Service for ClickHouse
Invest your time in your project, and we’ll take care of database maintenance: software backups, monitoring, fault tolerance, and updates. ClickHouse is great at handling queries to large amounts of data in real time, while column-based storage saves space due to strong data compression. All DBMS connections are encrypted using the TLS protocol. Data is secured in accordance with the requirements of local regulatory, GDPR, and ISO industry standards. Visualize the data structure in your ClickHouse cluster and send SQL queries to databases from the management console. The service also provides data replication between database hosts (both inside and between availability zones) and automatically switches the load over to a backup replica in the event of a failure.
Learn more
Apache Helix
Apache Helix is a generic cluster management framework used for the automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes. Helix automates reassignment of resources in the face of node failure and recovery, cluster expansion, and reconfiguration. To understand Helix, you first need to understand cluster management. A distributed system typically runs on multiple nodes for the following reasons: scalability, fault tolerance, load balancing. Each node performs one or more of the primary functions of the cluster, such as storing and serving data, producing and consuming data streams, and so on. Once configured for your system, Helix acts as the global brain for the system. It is designed to make decisions that cannot be made in isolation. While it is possible to integrate these functions into the distributed system, it complicates the code.
Learn more
Company Information
Yandex
United Arab Emirates
cloud.yandex.com/en/services/managed-kafka
Videos and Screen Captures
Other Useful Business Software
Build Data Resilience - Take the Assessment Today
Is your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
Product Details
Platforms Supported
Cloud
Training
Documentation
Support
Phone Support
Online
