我尝试导入一些时间序列数据并将其转换为UTC,以便将其与其他数据集合并。此数据似乎有24小时数据,并且没有DST调整。 This post给出了类似的答案,但他们只是放弃了这一行。我需要移动它,以便将其与其他数据合并。
当我运行我的代码时:
df = pd.read_csv('http://rredc.nrel.gov/solar/old_data/nsrdb/1991-2010/data/hourly/{}/{}_{}_solar.csv'.format(723898,723898,1998), usecols=["YYYY-MM-DD", "HH:MM (LST)","Meas Glo (Wh/m^2)","Meas Dir (Wh/m^2)","Meas Dif (Wh/m^2)"])
def clean_time(obj):
hour = int(obj[0:-3])
hour = str(hour - 1)
if len(str(hour)) == 2:
return hour+":00"
else:
return "0" + hour + ":00"
df['HH:MM (LST)'] = df['HH:MM (LST)'].apply(clean_time)
df['DateTime'] = df['YYYY-MM-DD'] + " " + df['HH:MM (LST)']
df = df.set_index(pd.DatetimeIndex(df['DateTime']))
df.drop(["YYYY-MM-DD", "HH:MM (LST)",'DateTime'],axis=1,inplace=True)
df.index = df.index.tz_localize('US/Pacific', ambiguous='infer')
我明白了:
pytz.exceptions.AmbiguousTimeError: Cannot infer dst time from 1998-10-25 01:00:00 as there are no repeated times
如果我留下歧义='加注' (默认),它给了我:
pytz.exceptions.NonExistentTimeError: 1998-04-05 02:00:00
因此,我在夏令时的开始或结束时都会陷入困境。
我需要合并这些数据集(多年来多个网站)中的相当一部分,所以我不想手动编写特定时间来转移,但我仍然是新手,并不能完全弄明白我的下一步。
感谢帮助!
答案 0 :(得分:0)
最小繁殖情况:
from datetime import datetime, timedelta
import pandas as pd
df = pd.DataFrame([[datetime(2019, 10, 27, 0) + timedelta(hours=i), i] for i in range(24)], columns=['dt', 'i']).set_index('dt')
df.index.tz_localize('Europe/Amsterdam', ambiguous='infer')
pytz.exceptions.AmbiguousTimeError:由于没有重复时间,因此无法推断从2019-10-27 02:00:00开始的夏令时间
解决方案:手动指定必须将哪些日期时间对象视为DT(夏令时)或DST(夏令时)。另请参阅:https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.tz_localize.html
from datetime import datetime, timedelta
import numpy as np
import pandas as pd
df = pd.DataFrame([[datetime(2019, 10, 27, 0) + timedelta(hours=i), i] for i in range(24)], columns=['dt', 'i']).set_index('dt')
infer_dst = np.array([False] * df.shape[0]) # all False -> every row considered DT, alternative is True to indicate DST. The array must correspond to the iloc of df.index
df.index.tz_localize('Europe/Amsterdam', ambiguous=infer_dst) # no error