jq解析日期到时间戳

Question

我有以下脚本：

curl -s -S 'https://bittrex.com/Api/v2.0/pub/market/GetTicks?marketName=BTC-NBT&tickInterval=thirtyMin&_=1521347400000' | jq -r '.result|.[] |[.T,.O,.H,.L,.C,.V,.BV] | @tsv | tostring | gsub("\t";",") | "(\(.))"'

这是输出;

(2018-03-17T18:30:00,0.00012575,0.00012643,0.00012563,0.00012643,383839.45768188,48.465051)
(2018-03-17T19:00:00,0.00012643,0.00012726,0.00012642,0.00012722,207757.18765437,26.30099514)
(2018-03-17T19:30:00,0.00012726,0.00012779,0.00012698,0.00012779,97387.01596624,12.4229077)
(2018-03-17T20:00:00,0.0001276,0.0001278,0.00012705,0.0001275,96850.15260027,12.33316229)

我想用时间戳替换日期。

我可以在shell中使用date进行此转换

date -d '2018-03-17T18:30:00' +%s%3N
1521325800000

我想要这个结果：

(1521325800000,0.00012575,0.00012643,0.00012563,0.00012643,383839.45768188,48.465051)
(1521327600000,0.00012643,0.00012726,0.00012642,0.00012722,207757.18765437,26.30099514)
(1521329400000,0.00012726,0.00012779,0.00012698,0.00012779,97387.01596624,12.4229077)
(1521331200000,0.0001276,0.0001278,0.00012705,0.0001275,96850.15260027,12.33316229)

此数据存储在mysql中。

是否可以在单个命令行中使用jq或其他命令（如awk，sed，perl）执行日期转换？

此致

Answer 1

这是一个假设“Z”（UTC + 0）时区的全jq解决方案。

简而言之，只需将.T替换为：

((.T + "Z") | fromdate | tostring + "000")

要验证这一点，请考虑：

timestamp.jq

[splits("[(),]")]
| .[1] |= ((. + "Z")|fromdate|tostring + "000")  # milliseconds
| .[1:length-1]
| "(" + join(",") + ")"

调用

jq -rR -f timestamp.jq  input.txt

输出

(1521311400000,0.00012575,0.00012643,0.00012563,0.00012643,383839.45768188,48.465051)
(1521313200000,0.00012643,0.00012726,0.00012642,0.00012722,207757.18765437,26.30099514)
(1521315000000,0.00012726,0.00012779,0.00012698,0.00012779,97387.01596624,12.4229077)
(1521316800000,0.0001276,0.0001278,0.00012705,0.0001275,96850.15260027,12.33316229)

Answer 2

这是一个不可移植的awk解决方案。它不可移植，因为它依赖于系统date命令;在我正在使用的系统上，相关的调用如下：date -j -f "%Y-%m-%eT%T" STRING "+%s"

awk -F, 'BEGIN{OFS=FS}
  NF==0 { next }
  { sub(/\(/,"",$1);
    cmd="date -j -f \"%Y-%m-%eT%T\" " $1 " +%s";
    cmd | getline $1;
    $1=$1 "000";     # milliseconds
    printf "%s", "(";
    print;
  }' input.txt

输出

(1521325800000,0.00012575,0.00012643,0.00012563,0.00012643,383839.45768188,48.465051)
(1521327600000,0.00012643,0.00012726,0.00012642,0.00012722,207757.18765437,26.30099514)
(1521329400000,0.00012726,0.00012779,0.00012698,0.00012779,97387.01596624,12.4229077)
(1521331200000,0.0001276,0.0001278,0.00012705,0.0001275,96850.15260027,12.33316229)

Answer 3

使用sed解决方案：

 sed -e 's/(\([^,]\+\)\(,.*\)/echo "(\$(date -d \1 +%s%3N),\2"/g' | ksh

测试：

  <commande_curl> | sed -e 's/(\([^,]\+\)\(,.*\)/echo "(\$(date -d \1 +%s%3N),\2"/g' | ksh

或：

  <commande_curl> > results_curl.txt
  cat results_curl.txt | sed -e 's/(\([^,]\+\)\(,.*\)/echo "(\$(date -d \1 +%s%3N),\2"/g' | ksh