Position of the last newline from a section of a file with Java

Question

How can I efficiently determine the possition of the last newline from a specific part from a file?

e.g. I tried this

BufferedReader br = new BufferedReader(new FileReader(file));
long length = file.length();
String line = null;
int tailLength = 0;
while ((line = br.readLine()) != null) {
    System.out.println(line);
    tailLength = line.getBytes().length;
}
int returnValue = length - tailLength;

but this will only return the possition of the very last newline in the whole file, and not the last newline in a section of the file. This section would be indicated by an int start; and an int end;

Answer 1

I think the most efficient approach is to start from the end of the file and read it in chunks. then, search it backwards for the first line.

i.e.

import java.io.IOException;
import java.nio.MappedByteBuffer;
import java.nio.channels.FileChannel;
import java.nio.channels.FileLock;
import java.nio.file.Path;
import java.nio.file.StandardOpenOption;

public class FileUtils {

    static final int CHUNK_SIZE = 8 * 1024;

    public static long getLastLinePosition(Path path) throws IOException {
        try (FileChannel inChannel = FileChannel.open(path, StandardOpenOption.READ);
             @SuppressWarnings("unused")
             FileLock lock = inChannel.tryLock(0, Long.MAX_VALUE, true)) {
            long fileSize = inChannel.size();
            long mark = fileSize;
            long position;
            boolean ignoreCR = false;
            while (mark > 0) {
                position = Math.max(0, mark - CHUNK_SIZE);

                MappedByteBuffer mbb = inChannel.map(FileChannel.MapMode.READ_ONLY, position, Math.min(mark, CHUNK_SIZE));
                byte[] bytes = new byte[mbb.remaining()];
                mbb.get(bytes);

                for (int i = bytes.length - 1; i >= 0; i--, mark--) {
                    switch (bytes[i]) {
                        case '\n':
                            if (mark < fileSize) {
                                return mark;
                            }
                            ignoreCR = true;
                            break;
                        case '\r':
                            if (ignoreCR) {
                                ignoreCR = false;
                            } else if (mark < fileSize) {
                                return mark;
                            }
                            break;
                    }
                }

                mark = position;
            }
        }
        return 0;
    }

}

test file :

abc\r\n
1234\r\n
def\r\n

output : 11

learn more about java.nio.channels.FileChannel and java.nio.MappedByteBuffer :

• http://tutorials.jenkov.com/java-nio/file-channel.html
• https://examples.javacodegeeks.com/core-java/nio/filechannel/java-nio-channels-filechannel-example/
• https://examples.javacodegeeks.com/core-java/nio/mappedbytebuffer/java-mappedbytebuffer-example/
• http://tutorials.techmytalk.com/2014/11/05/java-nio-memory-mapped-files/
• http://javarevisited.blogspot.nl/2012/01/memorymapped-file-and-io-in-java.html

EDIT :

if you are using Java 6, apply these changes to the above code :

import java.io.IOException;
import java.io.RandomAccessFile;
import java.nio.channels.FileChannel;
import java.nio.channels.FileLock;

public class FileUtils {

    static final int CHUNK_SIZE = 8 * 1024;

    public static long getLastLinePosition(String name) throws IOException {
        FileChannel inChannel = null;
        FileLock lock = null;
        try {
            inChannel = new RandomAccessFile(name, "r").getChannel();
            lock = inChannel.tryLock(0, Long.MAX_VALUE, true);

            // ...

        } finally {
            if (lock != null) {
                lock.release();
            }
            if (inChannel != null) {
                inChannel.close();
            }
        }
        return 0;
    }

}

Tips on choosing ideal buffer size :

• https://stackoverflow.com/a/237495/3767784
• https://stackoverflow.com/a/4638989/3767784
• https://stackoverflow.com/a/19007819/3767784

Answer 2

Unfortunately you can't, I had to use RandomAccessFile which has getFilePointer() method which you can call after readLine(), but it is VERY SLOW and not UTF-8-aware.

I ended up implementing my own byte counting line reader.

Your naive solution will fail horribly when facing files with unicode, malformed or binary contents.