Hbase:cloudera-quickstart-vm-5.4.2-0需要合适的jar文件

时间:2015-08-21 18:58:16

标签: hadoop hbase

我正在尝试通过API将数据从平面文件加载到Hbase。但是我收到了以下错误          ================================================== ======                                                                                       java.lang.NumberFormatException.forInputString       (NumberFormatException.java:65)     在java.lang.Integer.parseInt(Integer.java:492)     在java.lang.Integer.parseInt(Integer.java:527)     在org.apache.hadoop.hbase.HServerAddress。(HServerAddress.java:63)     at org.apache.hadoop.hbase.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:63)     at org.apache.hadoop.hbase.client.HConnectionManager $ HConnectionImplementation.getMaster(HConnectionManager.java:354)     在org.apache.hadoop.hbase.client.HBaseAdmin。(HBaseAdmin.java:94)     在Hbase.readFromFile.main(readFromFile.java:16)

代码:

     package Hbase;

     import java.io.BufferedReader;
     import java.io.File;
     import java.io.FileReader;
     import java.io.IOException;
     import java.util.StringTokenizer;

     import org.apache.hadoop.conf.Configuration;
   import org.apache.hadoop.hbase.HBaseConfiguration;
   import org.apache.hadoop.hbase.HColumnDescriptor;
   import org.apache.hadoop.hbase.HTableDescriptor;
    import org.apache.hadoop.hbase.client.HBaseAdmin;
   import org.apache.hadoop.hbase.client.HTable;
   import org.apache.hadoop.hbase.client.Put;
   import org.apache.hadoop.hbase.util.Bytes;


    public class readFromFile {
    public static void main(String[] args) throws IOException{
     if(args.length==1)
        {
        Configuration conf = HBaseConfiguration.create(new      Configuration());
        HBaseAdmin hba = new HBaseAdmin(conf);
        if(!hba.tableExists(args[0])){
            HTableDescriptor ht = new HTableDescriptor(args[0]);
            ht.addFamily(new HColumnDescriptor("sample"));
            ht.addFamily(new HColumnDescriptor("region"));
            ht.addFamily(new HColumnDescriptor("time"));
            ht.addFamily(new HColumnDescriptor("product"));
            ht.addFamily(new HColumnDescriptor("sale"));
            ht.addFamily(new HColumnDescriptor("profit"));
            hba.createTable(ht);
            System.out.println("New Table Created");

            HTable table = new HTable(conf,args[0]);

            File f = new File("/home/training/Desktop/data");
            BufferedReader br = new BufferedReader(new FileReader(f));
            String line = br.readLine();
            int i =1;
            String rowname="row";
            while(line!=null && line.length()!=0){
                System.out.println("Ok till here");
                StringTokenizer tokens = new StringTokenizer(line,",");
                rowname = "row"+i;
                Put p = new Put(Bytes.toBytes(rowname));
                                                                                       p.add(Bytes.toBytes("sample"),Bytes.toBytes("sampleNo."),
       Bytes.toBytes(Integer.parseInt(tokens.nextToken())));
                p.add(Bytes.toBytes("region"),Bytes.toBytes("country"),
              Bytes.toBytes(tokens.nextToken()));
                p.add(Bytes.toBytes("region"),Bytes.toBytes("state"),
              Bytes.toBytes(tokens.nextToken()));
                p.add(Bytes.toBytes("region"),Bytes.toBytes("city"),
              Bytes.toBytes(tokens.nextToken()));
                p.add(Bytes.toBytes("time"),Bytes.toBytes("year"),
             Bytes.toBytes(Integer.parseInt(tokens.nextToken())));
                p.add(Bytes.toBytes("time"),Bytes.toBytes("month"),
              Bytes.toBytes(tokens.nextToken()));
                                                                                        p.add(Bytes.toBytes("product"),Bytes.toBytes("productNo."),
            Bytes.toBytes(tokens.nextToken()));
                p.add(Bytes.toBytes("sale"),Bytes.toBytes("quantity"),
            Bytes.toBytes(Integer.parseInt(tokens.nextToken())));
                p.add(Bytes.toBytes("profit"),Bytes.toBytes("earnings"),
              Bytes.toBytes(tokens.nextToken()));
                i++;
                table.put(p);
                line = br.readLine();
            }
                br.close();
                table.close();
            }
        else
            System.out.println("Table Already exists.
           Please enter another table name");
    }
    else
        System.out.println("Please Enter the table 
         name through command line");       
    }
    }

请告诉我们是否需要添加任何合适的罐子..我正在使用cloudera cloudera-quickstart-vm-5.4.2-0

谢谢, VJ

2 个答案:

答案 0 :(得分:0)

如果您阅读了错误,则表示Integer.parseInt方法引发了NumberFormatException。这意味着您尝试将无效格式的String转换为Integer。在您的代码中,您可以在此行中调用该方法:

Bytes.toBytes(Integer.parseInt(tokens.nextToken())));

您需要查看通过tokens.nextToken()传递给此方法的令牌,并确保每个令牌都可以转换为整数。

答案 1 :(得分:0)

我认为问题在于使用的cloudera jar版本。请检查它,这应该工作。