Scribd
Upload
2K views

HDFS Commands

This document lists and describes various commands used for interacting with the Hadoop Distributed File System (HDFS). Commands like fsck check HDFS health, ls and mkdir manage directories, put and get copy files between local and HDFS, and rm deletes files or entire directories from HDFS. Other commands like count, cp, mv, and expunge manage file properties, copy/move files, and empty the trash.

Uploaded by

Raghavendra Prabhu
Copyright
© © All Rights Reserved
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
2K views

HDFS Commands

This document lists and describes various commands used for interacting with the Hadoop Distributed File System (HDFS). Commands like fsck check HDFS health, ls and mkdir manage directories, put and get copy files between local and HDFS, and rm deletes files or entire directories from HDFS. Other commands like count, cp, mv, and expunge manage file properties, copy/move files, and empty the trash.

Uploaded by

Raghavendra Prabhu
Copyright
© © All Rights Reserved
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
You are on page 1/ 2

HDFS commands:

fsck --HDFS Command to check the health of the Hadoop file system.
hdfs fsck /

ls --
hdfs dfs -ls /

mkdir
hdfs dfs -mkdir /Raghav

touchz
hdfs dfs -touchz /Raghav/Sample

du --HDFS Command to check the file size.

cat --HDFS Command that reads a file on HDFS and prints the
content of that file to the standard output.

text --HDFS Command that takes a source file and outputs the file in
text format.

copyFromLocal --HDFS Command to copy the file from a Local file system to HDFS.
Usage: hdfs dfs -copyFromLocal <localsrc> <hdfs
destination>
Command: hdfs dfs –copyFromLocal
/home/edureka/test /new_edureka

copyToLocal --HDFS Command to copy the file from HDFS to Local File System.
Usage: hdfs dfs -copyToLocal <hdfs source> <localdst>
Command: hdfs dfs –copyToLocal /new_edureka/test
/home/edureka

put --HDFS Command to copy single source or multiple sources


from local file system to the destination file system.
Usage: hdfs dfs -put <localsrc> <destination>
Command: hdfs dfs –put /home/edureka/test /user

get --HDFS Command to copy files from hdfs to the local file
system.
Usage: hdfs dfs -get <src> <localdst>
Command: hdfs dfs –get /user/test /home/edureka

count --HDFS Command to count the number of directories, files, and


bytes under the paths that match the specified file pattern.
Usage: hdfs dfs -count <path>
Command: hdfs dfs –count /user

rm --HDFS Command to remove the file from HDFS.


Usage: hdfs dfs –rm <path>
Command: hdfs dfs –rm /new_edureka/test

rm -r --HDFS Command to remove the entire directory and all of its


content from HDFS.

Usage: hdfs dfs -rm -r <path>


Command: hdfs dfs -rm -r /new_edureka
cp --HDFS Command to copy files from source to destination.
This command allows multiple sources as well, in which case the destination must be
a directory.
Usage: hdfs dfs -cp <src> <dest>
Command: hdfs dfs -cp /user/hadoop/file1
/user/hadoop/file2
Command: hdfs dfs -cp /user/hadoop/file1
/user/hadoop/file2 /user/hadoop/dir

mv --HDFS Command to move files from source to destination.


This command allows multiple sources as well, in which case the destination needs
to be a directory.
Usage: hdfs dfs -mv <src> <dest>
Command: hdfs dfs -mv /user/hadoop/file1
/user/hadoop/file2

expunge --HDFS Command that makes the trash empty.


Command: hdfs dfs -expunge

rmdir --HDFS Command to remove the directory.


Usage: hdfs dfs -rmdir <path>
Command: hdfs dfs –rmdir /user/hadoop

usage --HDFS Command that returns the help for an individual command.

Usage: hdfs dfs -usage <command>


Command: hdfs dfs -usage mkdir
Note: By using usage command you can get information
about any command.

help --HDFS Command that displays help for given command or all
commands if none is specified.
Command: hdfs dfs -help

You might also like