CODEWITHSUNDEEP
c++windowsmemory-management
Patrick
Patrick

Reputation: 23619

Information about PTE's (Page Table Entries) in Windows

In order to find more easily buffer overflows I am changing our custom memory allocator so that it allocates a full 4KB page instead of only the wanted number of bytes. Then I change the page protection and size so that if the caller writes before or after its allocated piece of memory, the application immediately crashes.

Problem is that although I have enough memory, the application never starts up completely because it runs out of memory. This has two causes:

The second problem is the biggest one, and I think it's related to the maximum number of PTE's (page table entries, which store information on how Virtual Memory is mapped to physical memory, and whether pages should be read-only or not) you can have in a process.

My questions (or a cry-for-tips):

Thanks,

Patrick

PS. note for those who will try to argument that you shouldn't write your own memory manager:

Upvotes: 2

Views: 4007

Answers (4)

MSalters
MSalters

Reputation: 179867

A shotgun approach is to allocate those isolated 4KB entries at random. This means that you will need to rerun the same tests, with the same input repeatedly. Sometimes it will catch the error, if you're lucky.

A slightly smarter approach is to use another algorithm than just random - e.g. make it dependent on the call stack whether an allocation is isolated. Do you trust std::string users, for instance, and suspect raw malloc use?

Upvotes: 1

Alex Budovski
Alex Budovski

Reputation: 18446

In order to find more easily buffer overflows I am changing our custom memory allocator so that it allocates a full 4KB page instead of only the wanted number of bytes.

This has already been done. Application Verifier with PageHeap.

Info on PTEs and the Memory architecture can be found in Windows Internals, 5th Ed. and the Intel Manuals.

Is this different (higher) for 64-bit systems/applications or not?

Of course. 64bit Windows has a much larger address space, so clearly more PTEs are needed to map it.

Where can I find information about the maximum number of PTE's in a process?

This is not so important as the maximum amount of user address space available in a process. (The number of PTEs is this number divided by the page size.)

This is 2GB on 32 bit Windows and much bigger on x64 Windows. (The actual number varies, but it's "big enough").

Problem is that although I have enough memory, the application never starts up completely because it runs out of memory.

Are you a) leaking memory? b) using horribly inefficient algorithms?

Upvotes: 1

Nikolai Fetissov
Nikolai Fetissov

Reputation: 84169

Take a look at the implementation of OpenBSD malloc. Much of the same ideas (and more) implemented by very skilled folk.

Upvotes: 1

JB.
JB.

Reputation: 861

There is what i thought was a great series of blog posts by Mark Russinovich on technet called "Pushing the limits of Windows..."

http://blogs.technet.com/markrussinovich/archive/2008/07/21/3092070.aspx

It has a few articles on virtual memory, paged nonpaged memory, physical memory and others.

He mentions little utilities he uses to take measurements about a systems resources.

Hopefully you will find your answers there.

Upvotes: 3

Related Questions