I'm getting too many open files error

"IOException: Too many open files" indicates a problem where a process has so many open file handles that it's hitting the maximum imposed by the operating system. This is normally caused by someone opening a file but forgetting to close it, commonly referred to as a "file descriptor leak."

Is that a Hudson bug?

Many users confuse "too many open files" error reported by from their builds as a problem in Hudson. So make sure the exception you are seeing is coming from Hudson, and not from tools like Ant or Maven that you run inside Hudson. You can check this by looking at the stack trace.

Diagnosis

For us to fix this problem, we need to know where the leak is occurring. And to this, we need to know what files the process currently opens.

• On Linux systems, check ls -la /proc/PID/fd which gives you the list.
• On other Unix systems, check "lsof -p PID
• On Windows, use Process Explorer to obtain the list.

Once you obtained this information, force a GC by visiting http://yourserver/hudson/gc, and obtain the list again. If the list shrinks substantially, it suggests that open file handles were pending garbage collection.

Please open a ticket in the issue tracker with all the information (or if you think one of the existing "too many open files" issue shows the same kind of leak, attach your info there.)

Workaround

While we work on the problem, you can often work around the problem as follows:

• Increase the maximum number of files that can be opened simultaneously. How you do this depends on a platform. (for example on Linux it's in /etc/security/limits.conf.)
• Sometimes forcing a GC regularly would keep things working.