Reply To: Memory configuration for 1NN (16GB RAM ) and 4 DN (8GB RAM)

Hi Vikash,

You must work out how many containers can run on your cluster. This is done by taking the MINIMUM of the following calculations:

2 x Number of Cores
1.8 * Number of disks (configured for your cluster to use – dfs.data.dirs)
8GB (RAM / 1024 (as 8 < x > 24)

This should leave you with:
2 x 4 (maybe) = 8
1.8 * disks (lets say 4 disks) = 7
8192 / 1024 = 8

So number of containers is 7 – this is fixed by hardware.

Then you should use:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.10/bk_installing_manually_book/content/rpm-chap1-11.html

To set the memory settings correctly. I know this is a 2.1 document but the formatting is much easier to read.

Thanks

Dave