hadoop - How can I access HDInsight Blob Storage from C# Mapper? -


i have "hadoop on windows" cluster blob storage (log-container @ logfstore) default storage configured (input , output read , written from/to there).

i'm using mapreduce sdk write , manage mapper , reducer in c#.

how can access other files on blob storage within c# code?

i tried following:

  1. file.readalllines(@"/log100by10/input/filelist_short.txt");

    result: not find part of path 'c:\log100by10\input\filelist_short.txt' exception

  2. file.readalllines(@"log100by10/input/filelist_short.txt");

    result: not find part of path 'c:\apps\temp\hdfs\nm-local-dir\usercache\admin\appcache\application_1453123456785_0006\container_1453123456785_0006_01_000002\log100by10\input\filelist_short.txt'

  3. file.readalllines(@"wasb://log100by10/input/filelist_short.txt");

    result: given path's format not supported

  4. file.readalllines(@"wasb://log-container@logfstore/log100by10/input/filelist_short.txt");

    result: given path's format not supported

the whole mapper looks like:

using system; using system.collections.generic; using system.io; using microsoft.hadoop.mapreduce;  namespace azuretest.multitest {     class multitestmapper : mapperbase     {          public override void map(string inputline, mappercontext context)         {             string path = @"/log100by10/input/filelist_short.txt";             try             {                 string[] text = file.readalllines(path);                 context.emitkeyvalue("****input ",text[0]);             }             catch(exception ex)             {                 context.emitkeyvalue("****error ", ex.message);             }         }     } } 


Comments

Popular posts from this blog

Hatching array of circles in AutoCAD using c# -

ios - UITEXTFIELD InputView Uipicker not working in swift -

Python Pig Latin Translator -