我有一个foreach循环,读取一个包含大约200000行的文件,这是我的PHP:
foreach ($this->file as $row)
{
if ($this->file->valid())
{
//init client array
$this->initInvoicesArray($row);
$this->prepareInvoice();
$row = null;
$this->key = $this->file->key();
//add msisdn to msisdn array, and client to clients array
self::$MsisdnArray[] = $this->msisdn;
self::$InvoicesArray[$this->msisdn] = $this->client;
if ($i % 3000 == 0)
{
//get valid users from table
$this->prepareAndSaveValidClients();
}
$i++;
}
}
这是prepareAndSaveValidClients()函数:
public function prepareAndSaveValidClients(){
$query = Doctrine_Query::create()
->select('p.gender, p.email2, u.username, u.first_name, u.last_name, u.email_address, u.is_active, p.msisdn, p.user_id, p.city_id, p.street, p.zipcode, p.msisdn_status')
->from('sfGuardUser u')
->innerJoin('u.Profile as p ON u.id = p.user_id')
->whereIn('p.msisdn', self::$MsisdnArray)
->whereIn('p.status', self::$AllowedStatus);
$results = $query->fetchArray();
//instanciat an object collection for payment_notifications
$collection = new Doctrine_Collection("payment_notifications");
if (!empty($results))
{
foreach ($results as $key => $client)
{
$invoice = self::$InvoicesArray[$client['Profile']['msisdn']];
$this->initInvoicesArray($invoice);
$this->prepareInvoice();
$this->prepareUserProfile($client);
$this->prepareClient();
$paymentNotifications = new paymentNotifications();
$paymentNotifications->fromArray($this->client);
$collection->add($paymentNotifications);
$tel = $client['Profile']['msisdn'];
$client = null;
}
$collection->save();
//clear memory
$results = null;
$collection = null;
self::$MsisdnArray = null;
self::$InvoicesArray = null;
$this->logSection('tel num', 'added :' . $tel . ' Memory usage : ' . memory_get_usage());
$duration = microtime(true) - $this->startTime;
$this->logSection('payment : ', sprintf('added in %s', $duration));
}
}
至于功能:
$this->initInvoicesArray($invoice);
$this->prepareInvoice();
$this->prepareUserProfile($client);
$this->prepareClient();
他们只是为了准备$this->client
这是内存使用,因为它显示每个循环:
>> tel num added :0699946185 Memory usage : 89287596
>> payment : added in 8.6373870372772
>> tel num added :0699983919 Memory usage : 165854544
>> payment : added in 18.373502969742
>> tel num added :0699949623 Memory usage : 241338788
>> payment : added in 29.336947917938
>> tel num added :0699854750 Memory usage : 319173092
>> payment : added in 40.880628824234
如您所见,我试图释放这些变量:
$results = null;
$collection = null;
self::$MsisdnArray = null;
self::$InvoicesArray = null;
但是徒劳无功,每次循环后Memory Usage都会不断增加,导致An Allowed Memory size exausted
致命错误。我该如何优化它?
谢谢。
答案 0 :(得分:3)
Doctrine对象有循环引用,php无法释放。为了解决这个问题,doctrine提供了free()
方法,在将它设置为null之前在集合上调用它:
$collection->free(true);
$collection = null;
答案 1 :(得分:1)
致电$this->prepareAndSaveValidClients();
后,您还可以使用gc_collect_cycles()
功能。它将有助于可能的内存泄漏。
答案 2 :(得分:0)
我在2个月前解决了这个问题,Memory_usage变得稳定了,但我忘了在这里发布解决方案。
我做了什么,是 I removed Doctrine, and I used mere PDO and Sql for the select query
。