Performance and memory usage comparisons
We first "warm up" the participant by sending 1000 requests with 12 concurrent users to it. This gives the participant the chance to load whatever resources are necessary. This is done with the Apache benchmarking tool: ab -n 1000 -c 12 ... Next, we send 20.000 requests in total, using 12 concurrent users. ab -n 20000 -c 12 ... Then, we measure the current system memory usage with the 'free' tool. Then, we shutdown the participant (that is, the web server, and (if applicable) the application server). Finally, we measure the current system memory usage with the 'free' tool. Other interesting information is also noted. We define the final memory usage of the participant as the difference between the free system memory before and after shutting down the participant.