Quantcast
Viewing all articles
Browse latest Browse all 3435

WebHDFS to filter directories

In my scenario, there is a folder for each source system, under each source there are multiple folder for table and each table folder has a folder per day created for data.

http://server.:50070/webhdfs/v1/<sournceName>/<tableName>?op=LISTSTATUS

When I use above webHDFS URL, it fetches me all the records that are present in tableName folder, while I am interested in the last 5 recent folder i.e. the ones created in last 5 days.

Is there a way I can use webHDFS to fulfill my requirement.

Regards
Vineet Rawat


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>