在Java中向布局数据输出(和输入)的最有效方法是什么?我打算用一个字符串,每个字符都是't'或'f'然后我想,为什么不减少8倍的空间呢?
注意
我实际上不知道哪个答案是更好的方法,我刚刚选择了彼得,因为我理解它。感谢两位回答者!
答案 0 :(得分:6)
假设你有一个布尔[]
boolean[] ar = {true,false,false,true,false,true,true,true,false,true,false,false,false,true,true};
并且您希望将其写入磁盘,而不关心它是如何在内存中实现的。
public static void main(String... args) throws IOException {
boolean[] ar = {true, false, false, true, false, true, true, true, false, true, false, false, false, true, true};
FileOutputStream out = new FileOutputStream("test.dat");
writeBooleans(out, ar);
out.close();
FileInputStream in = new FileInputStream("test.dat");
boolean[] ar2 = new boolean[ar.length];
readBooleans(in, ar2);
in.close();
System.out.println(Arrays.toString(ar));
System.out.println(Arrays.toString(ar2));
System.out.println("The file size was "+new File("test.dat").length()+" bytes.");
}
private static void writeBooleans(OutputStream out, boolean[] ar) throws IOException {
for (int i = 0; i < ar.length; i += 8) {
int b = 0;
for (int j = Math.min(i + 7, ar.length-1); j >= i; j--) {
b = (b << 1) | (ar[j] ? 1 : 0);
}
out.write(b);
}
}
private static void readBooleans(InputStream in, boolean[] ar) throws IOException {
for (int i = 0; i < ar.length; i += 8) {
int b = in.read();
if (b < 0) throw new EOFException();
for (int j = i; j < i + 8 && j < ar.length; j++) {
ar[j] = (b & 1) != 0;
b >>>= 1;
}
}
}
打印
[true, false, false, true, false, true, true, true, false, true, false, false, false, true, true]
[true, false, false, true, false, true, true, true, false, true, false, false, false, true, true]
The file size was 2 bytes.
但如果我看一下文件实际有多大
$ ls -l test.dat
-rw-rw-r-- 1 peter peter 2 2012-02-19 14:04 test.dat
$ du -h test.dat
4.0K test.dat
它表示长度为2个字节,但使用的磁盘空间实际为4 KB。
注意:大约1分钟的时间值与80 MB的SSD大致相同(昂贵的磁盘,更多用于硬盘驱动器)因此,如果你不认为使用它可以节省至少80 MB,你可以浪费你的时间。 ;)
您可以使用BitSet,每个字符为16位,占用的空间可减少16倍。
答案 1 :(得分:5)
最新创作,仅适合您。我将离开BooleanInputStream
作为练习。请注意,第一位现在是文件中最右边的(MSB)位(在示例中删除Byte.SIZE - 1 -
以获取其他字节顺序,无论您喜欢什么)。只需使用例如DataOutputStream首先将文件的大小写入文件。 10K应该是一个整数。
请注意,存储10K元素的布尔数组是非常低效的内存,你当然应该使用BitSet
(最后,需要BitSet
的人)!
public final class BooleanOutputStream extends FilterOutputStream {
private int bitIndex;
private byte buffer;
public BooleanOutputStream(final OutputStream out) {
super(out);
}
public void writeBoolean(final boolean value) throws IOException {
buffer ^= (value ? 1 : 0) << (Byte.SIZE - 1 - bitIndex++);
if (bitIndex == Byte.SIZE) {
write(buffer & 0xFF);
buffer = 0;
bitIndex = 0;
}
}
/**
* This is an encoder and does therefore not close the underlying stream.
* Please close underlying stream separately.
*/
public void close() throws IOException {
if (bitIndex != 0) {
out.write(buffer);
buffer = 0;
bitIndex = 0;
}
}
}
public class BooleanInputStream extends FilterInputStream {
private int bitIndex;
private byte buffer;
public BooleanInputStream(final InputStream in) {
super(in);
}
public boolean readBoolean() throws IOException {
if (bitIndex == 0) {
int b = read();
if (b == -1) {
throw new EOFException();
}
buffer = (byte) b;
}
boolean value = (buffer & (1 << (Byte.SIZE - 1 - bitIndex++))) != 0;
if (bitIndex == Byte.SIZE) {
bitIndex = 0;
}
return value;
}
/**
* This is a decoder and therefore does not close the underlying stream.
* Please close underlying stream separately.
*/
public void close() throws IOException {
buffer = 0;
bitIndex = 0;
}
}