CODEWITHSUNDEEP
java
Craig Locke
Craig Locke

Reputation: 799

Maximum number of threads in a JVM?

What are the maximum number of threads which can be maintained by the Java virtual machine?

I did not explain this in my original question, but I am trying to benchmark the JVM and would like to try and see how many threads it can concurrently maintain.

Creating threads in a loop until an exception is thrown is an option, however, I would like to know if there is a better way to do this.

Upvotes: 33

Views: 78397

Answers (7)

Basil Bourque
Basil Bourque

Reputation: 338181

Millions

Well, millions of simultaneous threads may be practical if using virtual threads found in Project Loom technology built into Java 21+.

See JEP 444: Virtual Threads.

More generally known in the industry as fibers, virtual threads under Project Loom run on top of the "real" platform/kernel threads that we already have in Java. Many virtual threads are mapped to each platform/kernel thread.

The virtual threads provide very cheap blocking. When the task on your background thread does file i/o, network calls, database access, logging, and so on, your code blocks, waiting for a response. Project Loom technology detects this blocking, "parks" (sets aside) that virtual thread, and assigns another virtual thread to continue its work on the platform/kernel thread. This parking and switching is very fast. As a result, threaded Java apps will generally see substantial gains in performance.

As a result, a JVM on mainstream computing hardware will be able to support millions of threads.

Caveats:

  • While virtual threads make blocking cheap, those cheap threads may be doing expensive work such as using much memory, many network ports, or database connections. So you may need to do some throttling of your tasks in such a case.
  • Virtual threads are appropriate for code that involves blocking, which is common in business-oriented apps. However, if the threaded work is CPU-bound such as processing video, then you should use a limited number of "real" platform/kernel threads rather than virtual threads.

Using virtual threads is a easy as switching your implementation of ExecutorService:

ExecutorService executorService = Executors.newVirtualThreadPerTaskExecutor() ;

For more info, see this 2021-01-15 article. And see several very good video presentations and interviews by Ron Pressler and other team members. Study more recent materials as Loom has evolved.

Upvotes: 2

Rahul Sharma
Rahul Sharma

Reputation: 91

Maximum thread limit mainly depends on hardware, OS and Java stack size.

The following factor plays a very important role to identify max thread limit:-

  1. Process virtual address limit (2^32 for 32-bit architecture and 2^64 for 64-bit architecture)
  2. Java stack size (can be determine by command java -XX:+PrintFlagsFinal -version | grep -iE 'ThreadStackSize'
  3. Max PID limit (can be determine by command "cat /proc/sys/kernel/pid_max")
  4. Max process limit ulimit -u

So max thread limit will be MINIMUM of ((process virtual address space/java stack size), Max PID limit, Max process limit)

e.g. if Max process limit is 2048 and it is minimum of all above mention three-factor then java process will not be able to create a thread more than that.

To verify it one can create simple java application in which he/she can create a thread in a loop and see how much it can go.

Example:

public class ThreadCountTest {
  private static final Object lock = new Object();
  private static int counter = 0;
    
  public static void main(String[] _args) {
    while (true) {
      new Thread(new Runnable() {
        public void run() {
          synchronized(lock) {
            counter++;
            System.err.println("New thread #" + counter);
          }
          while (true) {
            try {
              Thread.sleep(3000);
            } catch (Exception e) {
              e.printStackTrace();
            }
          }
        }
      }).start();
    }
  }
}

Upvotes: 1

ray
ray

Reputation: 31

The real question should be not how many threads you can create but how many threads will run efficiently. Too many threads and you will cause thrashing, too few and less computation time.

First, question, how long to live is your thread. Short live threads are hardly worth the effort. Large computations on the other hand make perfect sense.

Second, how much memory will each thread consume. Take the amount of memory each thread requires and divided it by the amount of memory available. You should not create more threads than this.

Thirdly, how many CPUs do you have available. You should not create more threads than CPUs. In fact, you should consider at least one less than the number of threads. On a windows laptop with 4 CPUs, you should never have more than 3 Threads if efficient processing is required.

Finally, what does your thread do. If it reads and writes to a hard drive, then you can have more threads than the number of CPUs since it will have to wait for the device to respond. Consider the following method when deciding the number of threads:

public static int recommendedThreadCount()
{
    int mRtnValue = 0;
    Runtime runtime = Runtime.getRuntime();
    long maxMemory = runtime.maxMemory();
    long mTotalMemory = runtime.totalMemory();
    long freeMemory = runtime.freeMemory();
    int mAvailableProcessors = runtime.availableProcessors();

    long mTotalFreeMemory = freeMemory + (maxMemory - mTotalMemory);
    mRtnValue = (int)(mTotalFreeMemory/4200000000l);

    int mNoOfThreads = mAvailableProcessors-1;
    if(mNoOfThreads < mRtnValue) mRtnValue = mNoOfThreads;

    return mRtnValue;
}

Upvotes: 3

flob
flob

Reputation: 3908

There will be some limits imposed by your operating system and hardware configuration.

To raise the number of concurrent threads you should lower the default stacksize java -Xss 64k.

  • A Oracle 32 bit JVM will default to 320kb stack size per thread.
    • For a 32 bit JVM with 2gb of addressable memory this will give you a maximum of 6.5k threads.
  • A Oracle 64 bit JVM will default to 1M stack size per thread.
    • For each gigabyte of memory you would get 1024 threads using the defaults.
  • For Linux only:
    • ulimit -a will give you the configured limits, for user processes and memory
    • You will only get 32k unique PIDs in linux cat /proc/sys/kernel/pid_max - a maximum of 32k processes.
    • You will get only 255k threads cat /proc/sys/kernel/threads-max

Upvotes: 42

Always Asking
Always Asking

Reputation: 243

Maximum number of threads can also be limited by the JVM implementation and cab be different from a Java virtual machine to another Java virtual machine. For example, in Jikes RVM an array is used to keep information about threads (See line 54 in the Jikes RVM Scheduler source code). In this case, the maximum number of threads cannot exceed the maximum size of an array in Java, which is about 2^32. But you are more likely to hit other OS limits or hardware limits before reaching 2^32 threads.

Upvotes: 0

Jay
Jay

Reputation: 27464

Writing a loop that creates new threads until it blows up is the definitive way to find out. You might well see performance degrade terribly before it actually dies.

I don't know if there's any configuration parameter or other built-in limit in the JVM off the top of my head. I've never run into a limit in practice. Of course sooner or later you will run out of memory, maybe some other resource.

I suspect that there is not a limit on number of threads per se, but rather on resources associated with a thread. That is, you might see that you can have 10,000 threads if all of them are running just one small class with a few bytes of data each, but the number drops rapidly when they each have an array of 10 million strings.

Upvotes: 17

Maurice Perry
Maurice Perry

Reputation: 32831

The limit, if there is one, will be imposed by the operating system, not the jvm

Upvotes: 8

Related Questions