CopybookInputFormat Can you please guide me how to use this code in hadoop to convert mainframe file to hdfs file using copybook

Can you please guide me how to use this code in hadoop to convert mainframe file to hdfs file using copybook

Open Nandakishore43 opened this issue 8 years ago • 3 comments

Hi I had a requirement to deal with data from mainframe , I had ftp'ed the data in Ebcdic format to hdfs ,

But i want to convert that data using mainframe copybook in haddop , I can convert in mainframe but i don't want to do that ,

Can some one help me with the code to use in hadoop to convert mainframe file to hdfs file ? (i need to handle comp 3 and occurance fields as well).

Also tell me how to execute in hadoop? please....

Feb 22 '17 11:02 Nandakishore43

This code should work. It is old but so is copybook :)

You may have to make some changes but the main idea will work. The only thing this doesn't support is variable length files.

Feb 22 '17 15:02 TedBear42

Thanks for your reply , can you give me the steps how to use this in hadoop ? please , I am still beginer

Feb 22 '17 15:02 Nandakishore43

BTW , I don't want to create Hive table , i just need HDFS file , HDFC file from mainframe file , IS it possible ?

Feb 22 '17 16:02 Nandakishore43