setting        mem    1st tok  tok/s  ex  hit@4  smoke
q4  8B         6.7GB  0.9s     38     8   9/10   3/3
q8  8B         9.8GB  1.1s     27     8   9/10   3/3
q4  3B         3.5GB  0.5s     71     6   8/10   2/3
