Add evaluation metrics on the test dataset

[ashishkamra]

It will be nice for the runtime performance benchamrking tool to also track some evaluation metrics on the test dataset. This can help shed light on cases like if the improved performance is coming at the cost of degradation in evaluation metrics. Reporting evaluation metrics along with runtime performance metrics (throughput/latency) will provide a more comprehensive picture.