I found the solution after some trial error, googling!
Sharing the solution to save time for others.
For each user there needs to be a directory present on the HDFS under /user/<userName> and this directory needs to have proper access setup.
Regards,
Arpan