Script hangs

[Vanaja1505]

Hi,

After some 40 to 50 requests processed, both the server and client scripts are hanging with no response.

Is there any buffer problem?

[nlohmann]

Strange: I'm running a server myself and it is online for months and served hundreds of requests...

I see if I can reproduce your problem. Can you give me more information about how your requests looked like? Rather long text snippets?

[nlohmann]

Update: I did a very naive benchmark:

for x in $(seq 1 1000)
do
  curl --data 'text=This software offers the functionality of the Stanford CoreNLP as HTTP-XML-Server. This avoids the time-consuming initialization every time CoreNLP is started. It is very similar to projects like this Python wrapper.' http://localhost:8080
done

During these 1000 calls, the memory consumption never exceeded some 800 MB, That said, I need more information to reproduce the problem.

[Vanaja1505]

I created a client and server scripts in Java with the base of your java code(simply saying using socket programming).

Inputs I used to process are text crawled from web pages.

As per the below snapshot taken using JConsole, the memory usage of server code is ~500MB while starting. It grows up to 3100MB within 5 minutes(processed 1000 inputs). Then the memory is somewhat released and reduces up to 2000MB.

In image: Provider is the server and Requester is the client.

Do you have idea about the increase and decrease in memory usage?

If you want I'll share my java code also..

[nlohmann]

I realized the performance heavily degrades if the texts are getting longer. In the configuration I put on Github, the algorithm tries to find connections between the subjects over the sentences. This is not an explanation for leaking memory, but maybe something you may try to switch off.

Apart from that, I am no expert in Java. That said - I'm not sure how I would hunt down memory leaks. For C/C++, there is a Valgrind which would detect leaks automatically.

[Vanaja1505]

You mean instead of passing the complete text as input, if I input sentences the performance will be better.