我正在尝试找到一种更好的搜索日志表的方法。该表记录在站点上执行的所有搜索,并且可以在单个条件上包含多个过滤器。例如,用户可以在一个搜索中搜索多个县的家庭和多个属性类型。我需要能够运行报告,以查找具有特定属性类型/类型的特定县/县内搜索的用户数。搜索当前记录在下表中:
存储搜索的维度定义:
CREATE TABLE [dbo].[LogSearchDimensions](
[ID] [int] IDENTITY(1,1) NOT NULL,
[VarName] [nvarchar](50) NOT NULL,
[Label] [nvarchar](50) NOT NULL,
[Description] [nvarchar](1024) NOT NULL,
[Created] [datetime] NOT NULL,
CONSTRAINT [PK_LogSearchDimensions] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
示例数据:
ID VarName Label
----------- -------------------------------------------------- --------------------------------------------------
3 City_ID City ID
5 County_ID County ID
7 PageNum Page Number
8 PriceLow Lowest Price
9 PriceHigh Highest Price
10 Region_ID Region ID
11 Site_ID Site ID
14 AcreLow Lowest Acreage
15 AcreHigh Highest Acreage
16 State_ID State ID
17 Style Style
18 SiteStateID Site State ID
19 Distance Distance
20 FIPS FIPS Code
存储主要搜索信息,例如执行搜索时以及执行搜索的人员:
CREATE TABLE [dbo].[LogSearches](
[ID] [numeric](18, 0) IDENTITY(1,1) NOT NULL,
[RecordCount] [int] NOT NULL,
[PageNumber] [int] NOT NULL,
[IPAddress] [varchar](15) NOT NULL,
[Domain] [nvarchar](150) NOT NULL,
[ScriptName] [nvarchar](500) NOT NULL,
[QueryString] [varchar](max) NULL,
[Referer] [nvarchar](1024) NOT NULL,
[SearchString] [nvarchar](max) NOT NULL,
[UserAgent] [nvarchar](2048) NULL,
[Processed] [datetime] NOT NULL,
[Created] [datetime] NOT NULL,
[IntegerIP] [int] NULL,
CONSTRAINT [PK_LogSearches] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
存储每次搜索的尺寸。这可以是单个记录,也可以是50,具体取决于执行的搜索:
CREATE TABLE [dbo].[LogSearchesDimensions](
[ID] [numeric](18, 0) IDENTITY(1,1) NOT NULL,
[LogSearch_ID] [numeric](18, 0) NOT NULL,
[LogSearchDimension_ID] [int] NOT NULL,
[SearchValue] [bigint] NULL,
CONSTRAINT [PK_LogSearchesDimensions] PRIMARY KEY CLUSTERED
(
[ID] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]
) ON [PRIMARY]
GO
ALTER TABLE [dbo].[LogSearchesDimensions] WITH CHECK ADD CONSTRAINT [FK_LogSearchesDimensions_LogSearchDimensions] FOREIGN KEY([LogSearchDimension_ID])
REFERENCES [dbo].[LogSearchDimensions] ([ID])
ON DELETE CASCADE
GO
ALTER TABLE [dbo].[LogSearchesDimensions] CHECK CONSTRAINT [FK_LogSearchesDimensions_LogSearchDimensions]
GO
ALTER TABLE [dbo].[LogSearchesDimensions] WITH CHECK ADD CONSTRAINT [FK_LogSearchesDimensions_LogSearches] FOREIGN KEY([LogSearch_ID])
REFERENCES [dbo].[LogSearches] ([ID])
ON DELETE CASCADE
GO
ALTER TABLE [dbo].[LogSearchesDimensions] CHECK CONSTRAINT [FK_LogSearchesDimensions_LogSearches]
GO
在LogSearchesDimensions表中,如果用户在一次搜索中搜索了多个县,我可以拥有County_ID(LogSearchDimension_id 5)的多条记录。假设用户在5,6,7,12和15个县进行了搜索。当我运行报告时,这个单一搜索需要显示在所有被搜索的5个县的报告中。如果我运行了一个组合了5和6县的报告,那么它应该只显示一次。
我知道这是很多信息,可能仍然不够,但我希望有人做过类似的事情可以分享一些提示,让这种类型的过滤器以一定的速度工作。
我目前有一个非常复杂的查询,有各种各样的连接,并且有条件尝试找到具有适当匹配数的搜索,但它的表现根本不好。我附上了表格图表来显示关系。alt text http://www.dansshorts.com/searchdiagram.png
我目前正在使用以下方法进行搜索:
CREATE VIEW [dbo].[vwLogSearchesCounty]
AS
SELECT dbo.LogSearches.ID, CAST(FLOOR(CAST(dbo.LogSearches.Created AS FLOAT)) AS DATETIME) AS Created, C.county, C.County_ID, S.state, S.state_ID
FROM dbo.LogSearches WITH (NOLOCK) INNER JOIN
dbo.LogSearchesDimensions AS D WITH (NOLOCK) ON dbo.LogSearches.ID = D.LogSearch_ID AND D.LogSearchDimension_ID = 5 INNER JOIN
propertyControlCenter.dbo.county AS C WITH (NOLOCK) ON C.County_ID = D.SearchValue INNER JOIN
propertyControlCenter.dbo.state AS S WITH (nolock) ON C.state_ID = S.state_ID
DECLARE @LowDate DATETIME, @HighDate DATETIME;
SET @LowDate = '2010-01-01' ;
SET @HighDate = '2010-02-01' ;
SELECT
CONVERT(varchar, Created, 107) AS displayDate
, County , County_ID
, reportCount
FROM (
SELECT
Created
, County_ID , County , reportCount
, DENSE_RANK() OVER(ORDER BY MaxRecords DESC, County) AS theRank
FROM (
SELECT
v.County_ID
, v.Created
, C.county + ' County, ' + S.State_Code AS County
, COUNT(DISTINCT v.ID) AS reportCount
, MAX(COUNT(DISTINCT v.ID)) OVER(PARTITION BY v.County_ID) AS MaxRecords
FROM
vwLogSearchesCounty v (NOLOCK)
INNER JOIN propertyControlCenter.dbo.county C (NOLOCK) ON
v.County_ID = C.County_ID
AND v.Created BETWEEN @LowDate AND @HighDate
AND c.State_ID = 48
INNER JOIN propertyControlCenter.dbo.state S (NOLOCK) ON C.state_ID = S.state_ID
INNER JOIN LogSearchesDimensions D (NOLOCK) ON v.ID = D.LogSearch_ID AND D.LogSearchDimension_ID IN (8, 9, 14, 15, 17)
WHERE
1 = 0
OR (
D.LogSearchDimension_ID = 17
AND D.SearchValue IN (2,5,6 )
)
GROUP BY
v.Created
, v.County_ID
, C.County
, S.State_Code
HAVING COUNT(v.ID) >= 3 ) d
GROUP BY
Created
, County
, County_ID
, reportCount
, MaxRecords )
ranking
WHERE theRank <= 5
ORDER BY theRank, County_ID, Created
当前记录数: LogSearches:8,970,000 LogSearchesDimensions:37,630,000
上述查询需要24秒才能运行(对于我们的目的而言太长)并返回以下数据:
displayDate County County_ID reportCount
------------------------------ ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------- -----------
Jan 01, 2010 Bastrop County, TX 6218 49
Jan 02, 2010 Bastrop County, TX 6218 84
Jan 03, 2010 Bastrop County, TX 6218 76
Jan 04, 2010 Bastrop County, TX 6218 118
Jan 05, 2010 Bastrop County, TX 6218 92
Jan 06, 2010 Bastrop County, TX 6218 59
Jan 07, 2010 Bastrop County, TX 6218 45
Jan 08, 2010 Bastrop County, TX 6218 84
Jan 09, 2010 Bastrop County, TX 6218 71
Jan 10, 2010 Bastrop County, TX 6218 91
Jan 11, 2010 Bastrop County, TX 6218 67
Jan 12, 2010 Bastrop County, TX 6218 52
Jan 13, 2010 Bastrop County, TX 6218 76
Jan 14, 2010 Bastrop County, TX 6218 104
Jan 15, 2010 Bastrop County, TX 6218 69
Jan 16, 2010 Bastrop County, TX 6218 51
Jan 17, 2010 Bastrop County, TX 6218 105
Jan 18, 2010 Bastrop County, TX 6218 76
Jan 19, 2010 Bastrop County, TX 6218 72
Jan 20, 2010 Bastrop County, TX 6218 69
Jan 21, 2010 Bastrop County, TX 6218 32
Jan 22, 2010 Bastrop County, TX 6218 54
Jan 23, 2010 Bastrop County, TX 6218 60
Jan 24, 2010 Bastrop County, TX 6218 76
Jan 25, 2010 Bastrop County, TX 6218 95
Jan 26, 2010 Bastrop County, TX 6218 73
Jan 27, 2010 Bastrop County, TX 6218 64
Jan 28, 2010 Bastrop County, TX 6218 57
Jan 29, 2010 Bastrop County, TX 6218 41
Jan 30, 2010 Bastrop County, TX 6218 87
Jan 31, 2010 Bastrop County, TX 6218 67
Feb 01, 2010 Bastrop County, TX 6218 66
Jan 01, 2010 Montgomery County, TX 6199 51
Jan 02, 2010 Montgomery County, TX 6199 70
Jan 03, 2010 Montgomery County, TX 6199 69
Jan 04, 2010 Montgomery County, TX 6199 74
Jan 05, 2010 Montgomery County, TX 6199 44
Jan 06, 2010 Montgomery County, TX 6199 60
Jan 07, 2010 Montgomery County, TX 6199 37
Jan 08, 2010 Montgomery County, TX 6199 39
Jan 09, 2010 Montgomery County, TX 6199 40
Jan 10, 2010 Montgomery County, TX 6199 71
Jan 11, 2010 Montgomery County, TX 6199 63
Jan 12, 2010 Montgomery County, TX 6199 54
Jan 13, 2010 Montgomery County, TX 6199 51
Jan 14, 2010 Montgomery County, TX 6199 46
Jan 15, 2010 Montgomery County, TX 6199 54
Jan 16, 2010 Montgomery County, TX 6199 45
Jan 17, 2010 Montgomery County, TX 6199 73
Jan 18, 2010 Montgomery County, TX 6199 70
Jan 19, 2010 Montgomery County, TX 6199 30
Jan 20, 2010 Montgomery County, TX 6199 57
Jan 21, 2010 Montgomery County, TX 6199 59
Jan 22, 2010 Montgomery County, TX 6199 43
Jan 23, 2010 Montgomery County, TX 6199 49
Jan 24, 2010 Montgomery County, TX 6199 72
Jan 25, 2010 Montgomery County, TX 6199 86
Jan 26, 2010 Montgomery County, TX 6199 43
Jan 27, 2010 Montgomery County, TX 6199 69
Jan 28, 2010 Montgomery County, TX 6199 57
Jan 29, 2010 Montgomery County, TX 6199 46
Jan 30, 2010 Montgomery County, TX 6199 52
Jan 31, 2010 Montgomery County, TX 6199 107
Feb 01, 2010 Montgomery County, TX 6199 40
Jan 01, 2010 Fayette County, TX 6240 58
Jan 02, 2010 Fayette County, TX 6240 65
Jan 03, 2010 Fayette County, TX 6240 50
Jan 04, 2010 Fayette County, TX 6240 61
Jan 05, 2010 Fayette County, TX 6240 52
Jan 06, 2010 Fayette County, TX 6240 48
Jan 07, 2010 Fayette County, TX 6240 44
Jan 08, 2010 Fayette County, TX 6240 40
Jan 09, 2010 Fayette County, TX 6240 25
Jan 10, 2010 Fayette County, TX 6240 56
Jan 11, 2010 Fayette County, TX 6240 51
Jan 12, 2010 Fayette County, TX 6240 47
Jan 13, 2010 Fayette County, TX 6240 43
Jan 14, 2010 Fayette County, TX 6240 47
Jan 15, 2010 Fayette County, TX 6240 43
Jan 16, 2010 Fayette County, TX 6240 37
Jan 17, 2010 Fayette County, TX
答案 0 :(得分:0)