I was wondering if anyone has any performance or benchmark information available, not necessarily for specific hardware but for example how many 1 paragraph requests can a server of a certain size (assuming no GPU) handle in a reasonable amount of time (5-6 seconds or less)?
I guess the kind of information I am looking for is what kind of performance can you expect from systems similar to the following if anyone happens to know?
2x Xeon e5-2660v3 with 256GB DDR4?
These servers can be had for around 500-600 USD on Ebay that is why I went with this example. But this is a pretty specific ask but honestly I would be happy to see any kind of data for running on a physical box and not in a container/pod.