HBase
1
HBase: Part of Hadoop’s
Ecosystem
HBase is built on top of HDFS
HBase files are
internally stored
in HDFS
2
HBase: Overview
• HBase is a distributed column-oriented datas store built on top of HDFS
• HBase is an Apache open-source project whose goal is to provide storage
for the Hadoop Distributed Computing
• Data is logically organized into tables, rows and columns
Example Schema of Table in HBase
• Table is a collection of rows.
• Row is a collection of column families.
• Column family is a collection of columns.
• Column is a collection of key value pairs.
3
HBase vs. HDFS
• Both are distributed systems that scale to hundreds or
thousands of nodes
• HDFS is good for batch processing (scans over big files)
• Not good for record lookup
• Not good for incremental addition of small batches
• Not good for updates
• It provides only sequential access of data.
4
HBase vs. HDFS (Cont’d)
• HBase is designed to efficiently address the above points
• Fast record lookup
• Support for record-level insertion
• Support for updates (not in place)
• HBase internally uses Hash tables and provides random
access, and it stores the data in indexed HDFS files for
faster lookups.
5
HBase vs. HDFS (Cont’d)
If application has neither random reads or writes then Stick to HDFS
6
HBase Data Model
7
HBase Data Model
• A column-oriented database stores data in cells grouped into columns,
not rows
• HBase is based on Google’s Bigtable model
• Key-Value pairs
8
HBase Data Model
1. Table & 2. Row
•Several Rows are multiple in Hbase Table. Columns have values assigned to them. HBase sorts rows alphabetically by
row key.
•The main goal is to store data so that related rows are closer together. The domain of the site is used as a common row-
key pattern. For example, if our row keys are domains, we should store them in reverse, i.e. org.apache.www or
org.apache.mail or org.Apache.Jira. This way, all Apache domains are close to each other in the HBase table.
3. Column
•An HBase column consists of a column family and a column qualifier separated by the : (colon) character.
•A. Column family: Column families physically house a set of columns and their values; then, Each column family has a
set of storage properties, such as how its data is compressed, whether its values should be cached, how its row keys are
encoded, and more. Each row in an HBase table has the same column families.
•b. Column qualifications: A column qualifier for qualification is added to the column family to provide an index for that
data part. Example: the column family is content, then the column qualifier can be content: HTML or content: pdf. The
Column families are fixed during table creation, but column qualifiers are mutable and vary widely between rows.
4. The cell
•A cell is essentially a combination of a row, a column family, and a column qualifier. Contains a value and a timestamp
that represents the version of the value.
5. Timestamp
•A timestamp is an identifier for a given value version and is written next to each value. The timestamp default represents
the time on the RegionServer when the data was written. However, we can specify a different timestamp value when
inserting data into a cell.
HBase: Keys and Column
Families
Each record is divided into Column Families
Each row has a Key
Each column family consists of one or more Columns
10
Column family named “anchor”
Column family named “Contents”
• Key
• Byte array
• Serves as the primary key
for the table
Column named “apache.com”
• Indexed far fast lookup
• Column Family
• Has a name (string)
• Contains one or more
related columns
• Column
• Belongs to one column
family
• Included inside the row
• familyName:columnName
11
Version number for each row
• Version Number
• Unique within each
key value
• By default→
System’s timestamp
• Data type is Long
• Value (Cell)
• Byte array
12
Notes on Data Model
• HBase schema consists of several Tables
• Each table consists of a set of Column Families
• Columns are not part of the schema
• HBase has Dynamic Columns
• Because column names are encoded inside the cells
• Different cells can have different columns
“Roles” column family
has different columns
in different cells
13
Notes on Data Model (Cont’d)
• The version number can be user-supplied
• Even does not have to be inserted in increasing order
• Version number are unique within each key
• Table can be very sparse
• Many cells are empty
Has two columns
• Keys are indexed as the primary key [cnnsi.com & my.look.ca]
HBase Physical Model
15
HBase Physical Model
• Each column family is stored in a separate file (called HTables)
• Key & Version numbers are replicated with each column family
• Empty cells are not stored
HBase maintains a multi-
level index on values:
<key, column family, column
name, timestamp>
16
Example
17
Column Families
18
HBase Regions
• Each HTable (column family) is partitioned horizontally
into regions
• Regions are counterpart to HDFS blocks
Each will be one region
19
HBase Architecture
20
Three Major Components
• The HBaseMaster
• One master
• The HRegionServer
• Many region servers
• The HBase client
21
HBase Components
• Region
• A subset of a table’s rows, like horizontal range partitioning
• Automatically done
• RegionServer (many slaves)
• Manages data regions
• Serves data for reads and writes (using a log)
• Master
• Responsible for coordinating the slaves
• Assigns regions, detects failures
• Admin functions
https://www.analyticsvidhya.com/blog/2022/10/a-brief-introduction-to-apache-hbase-and-its-architecture/
22
Big Picture
23
ZooKeeper
• HBase depends on ZooKeeper
• By default HBase manages the
ZooKeeper instance
• E.g., starts and stops
ZooKeeper
• HMaster and HRegionServers
register themselves with
ZooKeeper
24
Creating a Table
HBaseAdmin admin= new HBaseAdmin(config);
HColumnDescriptor []column;
column= new HColumnDescriptor[2];
column[0]=new HColumnDescriptor("columnFamily1:");
column[1]=new HColumnDescriptor("columnFamily2:");
HTableDescriptor desc= new HTableDescriptor(Bytes.toBytes("MyTable"));
desc.addFamily(column[0]);
desc.addFamily(column[1]);
admin.createTable(desc);
25
Operations On Regions: Get()
• Given a key → return corresponding record
• For each value return the highest version
• Can control the number of versions you want
26
Operations On Regions: Scan()
27
Select value from table where
Get() key=‘com.apache.www’ AND
label=‘anchor:apache.com’
Time
Row key Column “anchor:”
Stamp
t12
t11
“com.apache.www”
t10 “anchor:apache.com” “APACHE”
t9 “anchor:cnnsi.com” “CNN”
t8 “anchor:my.look.ca” “CNN.com”
“com.cnn.www”
t6
t5
t3
Select value from table
Scan() where anchor=‘cnnsi.com’
Time
Row key Column “anchor:”
Stamp
t12
t11
“com.apache.www”
t10 “anchor:apache.com” “APACHE”
t9 “anchor:cnnsi.com” “CNN”
t8 “anchor:my.look.ca” “CNN.com”
“com.cnn.www”
t6
t5
t3
Operations On Regions: Put()
• Insert a new record (with a new key), Or
• Insert a record for an existing key
Implicit version number
(timestamp)
Explicit version number
30
Operations On Regions: Delete()
• Marking table cells as deleted
• Multiple levels
• Can mark an entire column family as deleted
• Can make all column families of a given row as deleted
• All operations are logged by the RegionServers
• The log is flushed periodically
31
HBase: Joins
• HBase does not support joins
• Can be done in the application layer
• Using scan() and get() operations
32
Altering a Table
Disable the table before changing the schema
33
Logging Operations
34
HBase Deployment
Master
node
Slave
nodes
35
HBase vs. HDFS
36
HBase vs. RDBMS
37
When to use HBase
38
References
• https://www.bmc.com/blogs/hadoop-hbase/
• https://towardsdatascience.com/hbase-working-principle-a-part-of-hadoop-architecture-fbe0453a031b
• https://medium.com/hands-on-apache-hbase/an-introduction-to-apache-hbase-2cdd1d9ff13
• https://builtin.com/data-science/hbase
• https://www.analyticsvidhya.com/blog/2022/10/a-brief-introduction-to-apache-hbase-and-its-
architecture/
• https://www.tutorialspoint.com/hbase/hbase_overview.htm
• https://www.geeksforgeeks.org/apache-hbase/
• https://www.simplilearn.com/tutorials/hadoop-tutorial/hbase
