更新Hive表中指定时间范围的列值

时间:2015-03-13 02:27:49

标签: hadoop hive

Hive表"员工"包含一列"时间范围",数据为

timerange
1:10
1:13
1:17
1:21
1:26

如果最后一个数字范围介于(0和4)之间,则数据必须更新为0.如果最后一个数字范围介于(5& 9)之间,则必须更新为5.

预期输出

timerange
1:10
1:10
1:15
1:20
1:25

我该怎么做?

2 个答案:

答案 0 :(得分:1)

您可以通过内置字符串操作来完成此操作:

SELECT CASE WHEN SUBSTRING(timerange, LENGTH(timerange)) < "5"
            THEN CONCAT(SUBSTRING(timerange, 1, LENGTH(timerange) - 1), "0")
            ELSE CONCAT(SUBSTRING(timerange, 1, LENGTH(timerange) - 1), "5")
       END AS timerange
FROM Employee;

答案 1 :(得分:0)

您可以创建通用UDF(GenericUDF)。

以下是UDF示例:

import org.apache.hadoop.hive.ql.exec.UDFArgumentException;
import org.apache.hadoop.hive.ql.exec.UDFArgumentLengthException;
import org.apache.hadoop.hive.ql.metadata.HiveException;
import org.apache.hadoop.hive.ql.udf.generic.GenericUDF;
import org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector;
import org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils;
import org.apache.hadoop.hive.serde2.objectinspector.primitive.IntObjectInspector;
import org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorFactory;
import org.apache.hadoop.hive.serde2.objectinspector.primitive.StringObjectInspector;

public class TimeRangeConverter GenericUDF {

    @Override
    public ObjectInspector initialize(ObjectInspector[] arguments) throws UDFArgumentException {
        if (arguments.length != 1) {
            throw new UDFArgumentLengthException("The function time_range_converter(time_rage) requires 1 argument.");
        }

        ObjectInspector timeRangeVal = arguments[0];

        if (!(timeRangeVal instanceof StringObjectInspector)) {
            throw new UDFArgumentException("First argument must be of type String (time_range as String)");
        }
        return PrimitiveObjectInspectorFactory.writableStringObjectInspector;
    }

    @Override
    public Object evaluate(DeferredObject[] arguments) throws HiveException {
        String timeRangeVal = (String) ObjectInspectorUtils.copyToStandardJavaObject(arguments[0].get(),
                PrimitiveObjectInspectorFactory.javaStringObjectInspector);

        char[] characters = timeRangeVal.toCharArray();

        if (characters[characters.length - 1] > '5') {
            characters[characters.length - 1] = '5';
        } else {
            characters[characters.length - 1] = '0';
        }

        return String.valueOf(characters);
    }

    @Override
    public String getDisplayString(String[] arguments) {
        assert (arguments.length == 1);
        return "time_range_converter(" + arguments[0] + ")";
    }
}

调用Hive更新语句,如:

CREATE TEMPORARY FUNCTION time_range_converterAS 'TimeRangeConverter';

UPDATE 
    Employee 
SET 
    timerange = time_range_converter(timerange);