Hi,
I’m running the YARN example hadoop-yarn-applications-distributedshell-2.2.0.2.0.11.0-1.jar and would like to know what the allocatedCnt means.
I have two data nodes and am asking for 20 containers.
In the log I see :
14/10/23 01:45:29 INFO distributedshell.ApplicationMaster: Requested container ask: Capability[<memory:1024, vCores:0>]Priority[0] *20
14/10/23 01:45:31 INFO distributedshell.ApplicationMaster: Got response from RM for container ask, allocatedCnt=2
14/10/23 01:45:32 INFO impl.NMClientAsyncImpl: Processing Event EventType: START_CONTAINER for Container container_1413991714325_0008_01_000004
14/10/23 01:45:32 INFO impl.NMClientAsyncImpl: Processing Event EventType: START_CONTAINER for Container container_1413991714325_0008_01_000005
14/10/23 01:45:32 INFO impl.NMClientAsyncImpl: Processing Event EventType: QUERY_CONTAINER for Container container_1413991714325_0008_01_000004
14/10/23 01:45:32 INFO impl.NMClientAsyncImpl: Processing Event EventType: QUERY_CONTAINER for Container container_1413991714325_0008_01_000005
It seems that allocatedCnt means that my request for 20 containers will be performed in steps of 2 ?
Is there anyway to control the allocatedCnt ? Even if I lower the container_memory and number of containers allocatedCnt is always 2.
Cheers