OLLAMA_NUM_PARALLEL=1   (illustration only)
users  median  slowest   total  requests/s
    1    1.0s     1.0s    1.0s        1.00
    2    1.5s     2.0s    2.0s        1.00
    4    2.5s     4.0s    4.0s        1.00
    8    4.5s     8.0s    8.0s        1.00

OLLAMA_NUM_PARALLEL=4   (illustration only)
users  median  slowest   total  requests/s
    1    1.0s     1.0s    1.0s        1.00
    4    1.6s     1.7s    1.7s        2.35
    8    2.4s     3.4s    3.4s        2.35
