我有一个运行#tag趋势的测试页面存储在我的数据库中。在显示内容之前,页面需要很长时间才能加载(最多2分钟),只有一个功能使用该页面
网址:http://www.sudanesetweeps.com/trendingtopics.php
如何调整语句,以便在更短的时间内加载页面?
这是我的代码:
<?php
require_once("dbconnect.php");
require_once("lib_isarabic.php");
$query = "SELECT COUNT( * ) cnt, hashtags
FROM tweets
WHERE tweeted_at >= DATE_SUB( NOW( ) , INTERVAL 2 DAY )
AND hashtags != ''
GROUP BY hashtags
ORDER BY cnt DESC LIMIT 100";
$res = mysql_query($query);
while($row = mysql_fetch_assoc($res) ) {
$count = $row['cnt'];
$hashtags = explode( " ", $row['hashtags'] );
foreach($hashtags as $hashtag ) {
if( strtolower($hashtag) != 'sudan' && strtolower($hashtag) != 'new' && strtolower($hashtag) != 'new' )
if( is_arabic($hashtag) )
$topics_ara[strtolower( trim($hashtag) )] += $count;
else
$topics_eng[strtolower( trim($hashtag) )] += $count;
}
}
array_multisort($topics_ara, SORT_DESC);
array_multisort($topics_eng, SORT_DESC);
$index = 0;
foreach($topics_eng as $key=>$value) {
$query = "SELECT count(*) cnt FROM (
SELECT count(*), tweeted_by FROM tweets
WHERE hashtags like '%$key%'
AND tweeted_at >= DATE_SUB( NOW( ) , INTERVAL 2 DAY )
GROUP BY tweeted_by
) AS T";
/* $query = "
SELECT count(*) FROM tweets
WHERE hashtags like '%$key%'
AND tweeted_at > DATE_SUB( NOW( ) , INTERVAL 1 DAY ) ";
*/
$res = mysql_query($query);
$row = mysql_fetch_assoc($res);
if($row['cnt'] > 1) {
$index++;
if($key != "" ) {
$trending_eng[$key] = $value;
}
}
if($index > 30)
break;
}
$index = 0;
foreach($topics_ara as $key=>$value) {
$query = "SELECT count(*) cnt FROM (
SELECT count(*), tweeted_by FROM tweets
WHERE hashtags like '%$key%'
AND tweeted_at >= DATE_SUB( NOW( ) , INTERVAL 2 DAY )
GROUP BY tweeted_by
) AS T";
$res = mysql_query($query);
$row = mysql_fetch_assoc($res);
if($row['cnt'] > 1) {
$index++;
if($key != "" ) {
$trending_ara[$key] = $value;
}
}
if($index > 30)
break;
}
//var_dump($trending_eng) ;
//var_dump($trending_ara) ;
?>
答案 0 :(得分:3)
抱歉,您的数据模型有缺陷。
您没有对推文进行规范化,而是对全局文本进行全文搜索(通过hashtags like '%$key%'
),这意味着时间间隔内所有推文的完整文本必须通过CPU密集型流程运行 - 不仅一次,而且通过两个foreach()
循环,每次循环30次。
所以你做了60次全文扫描 - 祝你好运。
正确的方法是在接收推文时对推文进行规范化,拆分主题标签并创建类似于hashtag | user | count