Redis的新手,使用phpredis客户端在一个只有512Mb RAM的小盒子上用php测试它。
将3m整数值插入集合中。但该集合的sCard()
方法仅返回约270k计数。
这是我面临的内存限制吗?如何在插入时检查错误?
应用程序:有两个二进制文件存储四字节无符号整数的序列,我想加载到Redis中以实现快速的内存中差异。这是我的插入方法(跳过错误检查行):
function loadToRedis( $id, $filename){
$length = filesize( $filename) / 4; // how many ids are there? Each is 4 bytes.
$divisor = 100; // how many ids to insert in a single batch
printf( "Length of %s: %d 4-byte numbers\n", $filename, $length);
$FP = fopen($filename, 'r');
for( $b=0; $b<=floor( $length/ $divisor); $b++){
$set = array( $id);
for( $i=$b*$divisor; $i < min(( $b+1)*$divisor, $length); $i++) {
$bytes = unpack( "L", fread( $FP, 4));
array_push( $set, array_shift( $bytes));
}
call_user_func_array( array( $this->redis, 'sAdd'), $set);
}
fclose($FP);
printf( "%d items in the list named %s\n", $this->redis->sCard( $id), $id);
}
因此,在阅读了两个3m值文件中的第一个后,第一组的大小只有大约270k,而第二个文件似乎完全错过了Redis:
Length of /var/www/.../dat/OLD_26750264: 3123758 4-byte numbers
270457 items in the list named OLD_26750264
Length of /var/www/.../dat/NEW_26750264: 3125000 4-byte numbers
0 items in the list named NEW_26750264
在此之后Redis INFO输出:
redis_version:2.4.10
redis_git_sha1:00000000
redis_git_dirty:0
arch_bits:64
multiplexing_api:epoll
gcc_version:4.4.6
process_id:8416
uptime_in_seconds:1471232
uptime_in_days:17
lru_clock:1618016
used_cpu_sys:387.21
used_cpu_user:414.13
used_cpu_sys_children:0.03
used_cpu_user_children:0.32
connected_clients:1
connected_slaves:0
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
used_memory:19997864
used_memory_human:19.07M
used_memory_rss:22544384
used_memory_peak:27022288
used_memory_peak_human:25.77M
mem_fragmentation_ratio:1.13
mem_allocator:jemalloc-2.2.5
loading:0
aof_enabled:0
changes_since_last_save:0
bgsave_in_progress:0
last_save_time:1379328354
bgrewriteaof_in_progress:0
total_connections_received:153
total_commands_processed:16073
expired_keys:0
evicted_keys:0
keyspace_hits:99
keyspace_misses:83
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:835
vm_enabled:0
role:master
db0:keys=2,expires=0
答案 0 :(得分:2)
我明白了:maxmemory
比我预想的要快得多。在进一步的测试中,maxmemory = 40mb
只有1048600个整数值可以放入一个集合中。那是平均每个整数44,62
个字节。效率不高。