Scribd
Upload
15 views

Installation_Guide_Kafka_Scala_Spark

Installation

Uploaded by

anuk93620
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
15 views

Installation_Guide_Kafka_Scala_Spark

Installation

Uploaded by

anuk93620
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

Installation Guide for Apache Kafka, Scala, and Apache Spark

This document outlines the step-by-step process to install Apache Kafka, Scala, and Apache
Spark on a Linux-based system. The expected outputs at each stage are also described to
help verify the success of the installation.

---

Prerequisites
Ensure the following before proceeding:

- A Linux-based system with sudo access.

- Java Development Kit (JDK) version 8 or later installed.

- Sufficient disk space and memory for running Kafka and Spark.

---

1. Install Apache Kafka

Step 1: Download Kafka


 Visit the [Apache Kafka Downloads](https://kafka.apache.org/downloads) page.
 Copy the link for the latest binary package (e.g., `kafka_2.13-3.6.0.tgz`).
 Run: `wget https://downloads.apache.org/kafka/3.6.0/kafka_2.13-3.6.0.tgz`

**Expected Output:**

Saving to: ‘kafka_2.13-3.6.0.tgz’

...

100% [=============================================>] 50M in 10s

Step 2: Extract Kafka


 Run: `tar -xvf kafka_2.13-3.6.0.tgz`
 Move: `mv kafka_2.13-3.6.0 /usr/local/kafka`

**Expected Output:**

Files extracted successfully without errors.

Step 3: Configure Environment Variables


 Add Kafka’s `bin` directory to the PATH in `~/.bashrc`:
 `echo 'export PATH=$PATH:/usr/local/kafka/bin' >> ~/.bashrc`
 `source ~/.bashrc`
Step 4: Start Kafka
 Start Zookeeper: `zookeeper-server-start.sh
/usr/local/kafka/config/zookeeper.properties`
 Start Kafka Server: `kafka-server-start.sh /usr/local/kafka/config/server.properties`

**Expected Output:**

INFO Binding to port 0.0.0.0/0.0.0.0:2181

INFO [KafkaServer id=0] started (kafka.server.KafkaServer)

You might also like