[Test] Seeking advice for writing effective performance tests
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 How do I write accurate, empirical and reproducible performance tests? I realize this is a very broad question, but my knowledge on this subject is lacking, so I'd appreciate a comprehensive answer (e.g. I'm not looking to benchmark a particular program/library, just looking for a strategy for designing good performance tests). I have read up on the subject, but I'm interested in what you guys (e.g. Boost users/developers) do. - -- Bryce Lelbach aka wash http://groups.google.com/group/ariel_devel -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAky4yvsACgkQO/fqqIuE2t4WFQCcDXQWdg2Dr4WXialrZWMnSnii 2PAAoK8BbHS42t6utnzjSWxlMWYKXh+O =qJFv -----END PGP SIGNATURE-----
At Fri, 15 Oct 2010 17:43:23 -0400, Bryce Lelbach wrote:
How do I write accurate, empirical and reproducible performance tests? I realize this is a very broad question, but my knowledge on this subject is lacking, so I'd appreciate a comprehensive answer (e.g. I'm not looking to benchmark a particular program/library, just looking for a strategy for designing good performance tests). I have read up on the subject, but I'm interested in what you guys (e.g. Boost users/developers) do.
You might want to read through http://github.com/boost-lib/parameter/blob/master/test/efficiency.cpp, (which is in the Boost distro as libs/parameter/test/efficiency.cpp) -- Dave Abrahams BoostPro Computing http://www.boostpro.com
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On Sat, 16 Oct 2010 01:24:19 -0400
David Abrahams
At Fri, 15 Oct 2010 17:43:23 -0400, Bryce Lelbach wrote:
How do I write accurate, empirical and reproducible performance tests? I realize this is a very broad question, but my knowledge on this subject is lacking, so I'd appreciate a comprehensive answer (e.g. I'm not looking to benchmark a particular program/library, just looking for a strategy for designing good performance tests). I have read up on the subject, but I'm interested in what you guys (e.g. Boost users/developers) do.
You might want to read through http://github.com/boost-lib/parameter/blob/master/test/efficiency.cpp, (which is in the Boost distro as libs/parameter/test/efficiency.cpp)
Dave, thanks for this information! I was aware of the performance tests in libs/spirit/, which is similiar in design to the parameter test. The parameter test provides a lot more explaination, though. I found it incredibly helpful - -- Bryce Lelbach aka wash http://groups.google.com/group/ariel_devel -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAky7Y6UACgkQO/fqqIuE2t65wgCg4qwv12+E80gPG3J/LQqm9Hcv fdUAn1JpfnMrpgcgaYTfqLg2ku8G+Ii+ =ql1k -----END PGP SIGNATURE-----
At Sun, 17 Oct 2010 16:59:17 -0400, Bryce Lelbach wrote:
You might want to read through http://github.com/boost-lib/parameter/blob/master/test/efficiency.cpp, (which is in the Boost distro as libs/parameter/test/efficiency.cpp)
Dave, thanks for this information! I was aware of the performance tests in libs/spirit/, which is similiar in design to the parameter test. The parameter test provides a lot more explaination, though. I found it incredibly helpful
That's why it's there; I'm very glad it helped. -- Dave Abrahams BoostPro Computing http://www.boostpro.com
participants (2)
-
Bryce Lelbach -
David Abrahams