hadoop - How can I access HDInsight Blob Storage from C# Mapper? -
i have "hadoop on windows" cluster blob storage (log-container
@ logfstore
) default storage configured (input , output read , written from/to there).
i'm using mapreduce sdk write , manage mapper , reducer in c#.
how can access other files on blob storage within c# code?
i tried following:
file.readalllines(@"/log100by10/input/filelist_short.txt");
result: not find part of path 'c:\log100by10\input\filelist_short.txt' exception
file.readalllines(@"log100by10/input/filelist_short.txt");
result: not find part of path 'c:\apps\temp\hdfs\nm-local-dir\usercache\admin\appcache\application_1453123456785_0006\container_1453123456785_0006_01_000002\log100by10\input\filelist_short.txt'
file.readalllines(@"wasb://log100by10/input/filelist_short.txt");
result: given path's format not supported
file.readalllines(@"wasb://log-container@logfstore/log100by10/input/filelist_short.txt");
result: given path's format not supported
the whole mapper looks like:
using system; using system.collections.generic; using system.io; using microsoft.hadoop.mapreduce; namespace azuretest.multitest { class multitestmapper : mapperbase { public override void map(string inputline, mappercontext context) { string path = @"/log100by10/input/filelist_short.txt"; try { string[] text = file.readalllines(path); context.emitkeyvalue("****input ",text[0]); } catch(exception ex) { context.emitkeyvalue("****error ", ex.message); } } } }
Comments
Post a Comment