CODEWITHSUNDEEP
httpluatimeoutluasocket
linsek
linsek

Reputation: 3480

Lua HTTP Request Timeout Hang

I have inherited some Lua code that communicates with a server via HTTP Request/Response. This has been running in the field for several years but I recently noticed some hangs in the timeout of the HTTP requests from the system. Each individual message has the capability to define its own timeout, but if none is set a default timeout of 30 seconds is used. I noticed on a system a couple of weeks ago that there was a hang on a timeout for about 15 minutes before it recovered and processing continued. But I am currently looking at a system that has been hung for well over 3 hours on a 30 second timeout. Here is the setup for the requests:

local socket = require "socket"
local http = require "socket.http"
local ltn12 = require "ltn12"
local ssl = require "ssl"
local try = socket.try
local protect = socket.protect
...
function serverapi.http_request(request, timeout)
    ... (local variable setup and logging)
    socket.TIMEOUT = timeout
    socket.http.TIMEOUT = timeout

    result, status_code, content = socket.http.request {
        url = request.url,
        method = request.method,
        headers = request.header,
        source = ltn12.source.string(request_body),
        sink = ltn12.sink.table(response_body),
    }

    ... (receive response and process)

I should note that the hangs are erratic in terms of the messages types they hang on. So it is not consistently with one message. And, as I said, this has been deployed and running in the field for several years.

Anyone have any ideas here...? Even if it's just a way to help debug what's going on. I don't even know how to get any kind of logging in what's going on after the request is sent and it's waiting for timeout.

Thanks

Upvotes: 1

Views: 2162

Answers (2)

Naman Lashkari
Naman Lashkari

Reputation: 1

I am still facing timeout issues for my system, I am trying to bring down the timeout to 30 sec but no luck for now but in the process have found some interesting articles and approaches. Hopes one works for you. my approach might seem a bit more kong biased and this is because my search was more kong specific.

=======

Approach 1

DNS Resolution can be taking time, switching to IP based can reduce the time taken

=======

Approach 2

We used HTTP and HTTPS timeout and it didn't work for us, refer to article no 2

=======

Approach 3

We are currently using the kong framework and am modifying the default timeout and keepalive parameters but it doesn't seem to work as well.

=======

Approach 4

changing underlying nginx configuration

Upvotes: 0

Keith Mashinter
Keith Mashinter

Reputation: 209

I've had similar issues, and the socket library is old, last updated in 2007? I fix a bug in socket/http.lua, but it still occasionally hangs so that wasn't it. I tried luacurl and it also hangs, so it may be a problem at the compiled code level. I'm on Windows. nodejs has more momentum these days so I'm not sure how much I want to pursue Lua unless support improves.

while string.find(line, "^%s") do
    value = value .. line
    line, err = sock:receive() -- was line = sock:receive()
    if err then return nil, err end
end

Upvotes: 0

Related Questions