NameNode (NN) NN holds the metadata of the files in HDFS, maintains the entire metadata in RAM It is important to run NN from a machine that has lots of RAM at its disposal. The higher the number of files in HDFS, the higher the consumption of RAM In case the namenode daemon is restarted Read fsimage…
This will add a quick note on how to install necessary Hadoop ecosystem by Installing Apache BigTop for Hadoop Development. Remember that we need a 64-bit OS to be able to run Big Data project. First, add a new repo. The latest BigTop repo (0.8.0) is located at http://www.apache.org/dist/bigtop/bigtop-0.8.0/repos/ and we just need to add appropriate repo…