John Torjo wrote:
In the "looping construct" thread, a while ago David Abrahams said that we should do a test, to compare all looping solutions.
I've made such a test. It tests against: - keeping internal functions in crange<> - virtual functions - BOOST_FOREACH comparing to using raw iterators.
The tests are pretty heavy. I've tested on a Win2000 box/512 Mb of RAM/1.8Ghz Intel processor (laptop), VC7.1 with all optimizations on.
Here are my test results (I had to add some typename's to make it compile on gcc): -------------------------------------------------------------------- 1) Pentium M, 1.6 GHz, 1GByte RAM (Laptop), Intel V8.0 -O3, W2K: Test 1 of 1 (for 128000 elements) Test set_to_idx, vector<int> took RAW : 1.071 secs func calls : 2.694 secs (251.541%) vtable calls: 3.095 secs (288.982%) foreach calls: 1.882 secs (175.724%) Test set_to_idx, list<int> took RAW : 6.61 secs func calls : 9.965 secs (150.756%) vtable calls: 7.33 secs (110.893%) foreach calls: 6.61 secs (100%) Test set_to_idx, deque<int> took RAW : 1.722 secs func calls : 3.465 secs (201.22%) vtable calls: 3.114 secs (180.836%) foreach calls: 1.723 secs (100.058%) Test set_to_idx, vector<seq> took RAW : 3.035 secs func calls : 3.035 secs (100%) vtable calls: 3.035 secs (100%) foreach calls: 3.035 secs (100%) Test set_to_idx, list<seq> took RAW : 2.574 secs func calls : 2.594 secs (100.777%) vtable calls: 2.603 secs (101.127%) foreach calls: 2.574 secs (100%) Test set_to_idx, deque<seq> took RAW : 2.613 secs func calls : 2.634 secs (100.804%) vtable calls: 2.613 secs (100%) foreach calls: 2.613 secs (100%) Test multiply_by_2, vector<int> took RAW : 1.122 secs func calls : 2.784 secs (248.128%) vtable calls: 2.573 secs (229.323%) foreach calls: 1.132 secs (100.891%) Test multiply_by_2, list<int> took RAW : 6.609 secs func calls : 6.69 secs (101.226%) vtable calls: 6.629 secs (100.303%) foreach calls: 6.609 secs (100%) Test multiply_by_2, deque<int> took RAW : 1.993 secs func calls : 3.715 secs (186.402%) vtable calls: 3.836 secs (192.474%) foreach calls: 2.063 secs (103.512%) Test multiply_by_max20, vector<int> took RAW : 6.93 secs func calls : 10.736 secs (154.921%) vtable calls: 9.804 secs (141.472%) foreach calls: 6.93 secs (100%) Test multiply_by_max20, list<int> took RAW : 10.225 secs func calls : 10.755 secs (105.183%) vtable calls: 11.416 secs (111.648%) foreach calls: 10.225 secs (100%) Test multiply_by_max20, deque<int> took RAW : 5.888 secs func calls : 9.214 secs (156.488%) vtable calls: 8.432 secs (143.207%) foreach calls: 6.209 secs (105.452%) Test add_10, vector<int> took RAW : 0.601 secs func calls : 1.522 secs (253.245%) vtable calls: 1.292 secs (214.975%) foreach calls: 0.611 secs (101.664%) Test add_10, list<int> took RAW : 3.525 secs func calls : 3.595 secs (101.986%) vtable calls: 3.525 secs (100%) foreach calls: 3.525 secs (100%) Test add_10, deque<int> took RAW : 1.092 secs func calls : 2.103 secs (192.582%) vtable calls: 1.962 secs (179.67%) foreach calls: 1.092 secs (100%) Test add_one_char, vector<seq> took RAW : 1.041 secs func calls : 1.412 secs (135.639%) vtable calls: 1.462 secs (140.442%) foreach calls: 1.291 secs (124.015%) Test add_one_char, list<seq> took RAW : 1.372 secs func calls : 1.372 secs (100%) vtable calls: 1.402 secs (102.187%) foreach calls: 1.562 secs (113.848%) Test add_one_char, deque<seq> took RAW : 1.261 secs func calls : 1.472 secs (116.733%) vtable calls: 1.522 secs (120.698%) foreach calls: 1.462 secs (115.94%) Test set_to_len, vector<seq> took RAW : 2.323 secs func calls : 2.353 secs (101.291%) vtable calls: 2.324 secs (100.043%) foreach calls: 2.353 secs (101.291%) Test set_to_len, list<seq> took RAW : 1.592 secs func calls : 1.602 secs (100.628%) vtable calls: 1.593 secs (100.063%) foreach calls: 1.592 secs (100%) Test set_to_len, deque<seq> took RAW : 1.892 secs func calls : 1.913 secs (101.11%) vtable calls: 1.893 secs (100.053%) foreach calls: 1.892 secs (100%) Test set_to_az, vector<seq> took RAW : 6.97 secs func calls : 6.97 secs (100%) vtable calls: 6.97 secs (100%) foreach calls: 6.97 secs (100%) Test set_to_az, list<seq> took RAW : 6.149 secs func calls : 6.209 secs (100.976%) vtable calls: 6.229 secs (101.301%) foreach calls: 6.149 secs (100%) Test set_to_az, deque<seq> took RAW : 6.149 secs func calls : 6.199 secs (100.813%) vtable calls: 6.209 secs (100.976%) foreach calls: 6.149 secs (100%) Test noop, vector<int> took RAW : 0.742 secs func calls : 3.074 secs (414.286%) vtable calls: 2.754 secs (371.159%) foreach calls: 0.742 secs (100%) Test noop, list<int> took RAW : 3.826 secs func calls : 4.817 secs (125.902%) vtable calls: 5.098 secs (133.246%) foreach calls: 3.846 secs (100.523%) Test noop, deque<int> took RAW : 1.753 secs func calls : 3.856 secs (219.966%) vtable calls: 3.865 secs (220.479%) foreach calls: 1.753 secs (100%) Test noop, vector<seq> took RAW : 0.29 secs func calls : 1.202 secs (414.483%) vtable calls: 1.152 secs (397.241%) foreach calls: 0.29 secs (100%) Test noop, list<seq> took RAW : 3.005 secs func calls : 3.515 secs (116.972%) vtable calls: 3.946 secs (131.314%) foreach calls: 3.345 secs (111.314%) Test noop, deque<seq> took RAW : 0.671 secs func calls : 1.462 secs (217.884%) vtable calls: 1.402 secs (208.942%) foreach calls: 0.671 secs (100%) -------------------------------------------------------------------- 2) Dual P4, 2.8GHz, 1GHz RAM, Intel V8.0 -O3, Linux Heavy Load! Test 1 of 1 (for 128000 elements) Test set_to_idx, vector<int> took RAW : 0.72 secs func calls : 2.68 secs (372.222%) vtable calls: 3.13 secs (434.722%) foreach calls: 0.72 secs (100%) Test set_to_idx, list<int> took RAW : 2.89 secs func calls : 3.61 secs (124.913%) vtable calls: 3.75 secs (129.758%) foreach calls: 2.89 secs (100%) Test set_to_idx, deque<int> took RAW : 1.11 secs func calls : 3.77 secs (339.64%) vtable calls: 4.22 secs (380.18%) foreach calls: 1.34 secs (120.721%) Test set_to_idx, vector<seq> took RAW : 5.82 secs func calls : 5.82 secs (100%) vtable calls: 5.82 secs (100%) foreach calls: 5.82 secs (100%) Test set_to_idx, list<seq> took RAW : 6.02 secs func calls : 6.02 secs (100%) vtable calls: 6.02 secs (100%) foreach calls: 6.02 secs (100%) Test set_to_idx, deque<seq> took RAW : 6.39 secs func calls : 6.39 secs (100%) vtable calls: 6.39 secs (100%) foreach calls: 6.39 secs (100%) Test multiply_by_2, vector<int> took RAW : 1.12 secs func calls : 3.59 secs (320.536%) vtable calls: 3.62 secs (323.214%) foreach calls: 1.12 secs (100%) Test multiply_by_2, list<int> took RAW : 2.68 secs func calls : 4.17 secs (155.597%) vtable calls: 4.15 secs (154.851%) foreach calls: 2.74 secs (102.239%) Test multiply_by_2, deque<int> took RAW : 1.93 secs func calls : 4.28 secs (221.762%) vtable calls: 5.09 secs (263.731%) foreach calls: 2.32 secs (120.207%) Test multiply_by_max20, vector<int> took RAW : 19.06 secs func calls : 24.11 secs (126.495%) vtable calls: 24.81 secs (130.168%) foreach calls: 19.22 secs (100.839%) Test multiply_by_max20, list<int> took RAW : 14.7 secs func calls : 18.65 secs (126.871%) vtable calls: 18.84 secs (128.163%) foreach calls: 14.7 secs (100%) Test multiply_by_max20, deque<int> took RAW : 15.2 secs func calls : 19.29 secs (126.908%) vtable calls: 19.51 secs (128.355%) foreach calls: 15.77 secs (103.75%) Test add_10, vector<int> took RAW : 0.56 secs func calls : 1.75 secs (312.5%) vtable calls: 1.87 secs (333.929%) foreach calls: 0.56 secs (100%) Test add_10, list<int> took RAW : 1.39 secs func calls : 2 secs (143.885%) vtable calls: 2 secs (143.885%) foreach calls: 1.39 secs (100%) Test add_10, deque<int> took RAW : 0.97 secs func calls : 2.19 secs (225.773%) vtable calls: 2.44 secs (251.546%) foreach calls: 1.06 secs (109.278%) Test add_one_char, vector<seq> took RAW : 0.57 secs func calls : 0.72 secs (126.316%) vtable calls: 0.75 secs (131.579%) foreach calls: 0.72 secs (126.316%) Test add_one_char, list<seq> took RAW : 0.69 secs func calls : 0.69 secs (100%) vtable calls: 0.69 secs (100%) foreach calls: 0.69 secs (100%) Test add_one_char, deque<seq> took RAW : 0.6 secs func calls : 0.78 secs (130%) vtable calls: 0.73 secs (121.667%) foreach calls: 0.76 secs (126.667%) Test set_to_len, vector<seq> took RAW : 4.16 secs func calls : 4.36 secs (104.808%) vtable calls: 4.37 secs (105.048%) foreach calls: 4.18 secs (100.481%) Test set_to_len, list<seq> took RAW : 4.07 secs func calls : 4.42 secs (108.6%) vtable calls: 4.51 secs (110.811%) foreach calls: 4.3 secs (105.651%) Test set_to_len, deque<seq> took RAW : 4.72 secs func calls : 4.72 secs (100%) vtable calls: 4.89 secs (103.602%) foreach calls: 4.76 secs (100.847%) Test set_to_az, vector<seq> took RAW : 5.7 secs func calls : 5.72 secs (100.351%) vtable calls: 5.7 secs (100%) foreach calls: 5.7 secs (100%) Test set_to_az, list<seq> took RAW : 5.75 secs func calls : 5.75 secs (100%) vtable calls: 5.75 secs (100%) foreach calls: 5.75 secs (100%) Test set_to_az, deque<seq> took RAW : 5.83 secs func calls : 6.1 secs (104.631%) vtable calls: 5.83 secs (100%) foreach calls: 5.83 secs (100%) Test noop, vector<int> took RAW : 0.84 secs func calls : 3.86 secs (459.524%) vtable calls: 4.14 secs (492.857%) foreach calls: 0.87 secs (103.571%) Test noop, list<int> took RAW : 1.48 secs func calls : 4.25 secs (287.162%) vtable calls: 4.47 secs (302.027%) foreach calls: 1.71 secs (115.541%) Test noop, deque<int> took RAW : 2.08 secs func calls : 5 secs (240.385%) vtable calls: 5.33 secs (256.25%) foreach calls: 2.18 secs (104.808%) Test noop, vector<seq> took RAW : 0.33 secs func calls : 1.51 secs (457.576%) vtable calls: 1.62 secs (490.909%) foreach calls: 0.37 secs (112.121%) Test noop, list<seq> took RAW : 2.02 secs func calls : 2.75 secs (136.139%) vtable calls: 2.35 secs (116.337%) foreach calls: 2.02 secs (100%) Test noop, deque<seq> took RAW : 0.9 secs func calls : 2.04 secs (226.667%) vtable calls: 2.37 secs (263.333%) foreach calls: 1 secs (111.111%) -------------------------------------------------------------------- 3) Dual P4, 2.8GHz, 1GHz RAM, gcc 3.2.2 -O3, Linux Heavy Load! Test 1 of 1 (for 128000 elements) Test set_to_idx, vector<int> took RAW : 0.58 secs func calls : 3.59 secs (618.966%) vtable calls: 3.69 secs (636.207%) foreach calls: 0.77 secs (132.759%) Test set_to_idx, list<int> took RAW : 2.75 secs func calls : 3.83 secs (139.273%) vtable calls: 3.97 secs (144.364%) foreach calls: 2.82 secs (102.545%) Test set_to_idx, deque<int> took RAW : 1.02 secs func calls : 3.87 secs (379.412%) vtable calls: 3.7 secs (362.745%) foreach calls: 1.02 secs (100%) Test set_to_idx, vector<seq> took RAW : 8.56 secs func calls : 9.35 secs (109.229%) vtable calls: 8.56 secs (100%) foreach calls: 8.56 secs (100%) Test set_to_idx, list<seq> took RAW : 8.23 secs func calls : 8.23 secs (100%) vtable calls: 8.74 secs (106.197%) foreach calls: 8.63 secs (104.86%) Test set_to_idx, deque<seq> took RAW : 9.34 secs func calls : 9.34 secs (100%) vtable calls: 9.34 secs (100%) foreach calls: 9.34 secs (100%) Test multiply_by_2, vector<int> took RAW : 1.76 secs func calls : 4.56 secs (259.091%) vtable calls: 4.79 secs (272.159%) foreach calls: 1.87 secs (106.25%) Test multiply_by_2, list<int> took RAW : 3.53 secs func calls : 4.96 secs (140.51%) vtable calls: 5.08 secs (143.909%) foreach calls: 3.73 secs (105.666%) Test multiply_by_2, deque<int> took RAW : 2.52 secs func calls : 5.3 secs (210.317%) vtable calls: 5.51 secs (218.651%) foreach calls: 2.52 secs (100%) Test multiply_by_max20, vector<int> took RAW : 25.63 secs func calls : 29.64 secs (115.646%) vtable calls: 29.97 secs (116.933%) foreach calls: 25.63 secs (100%) Test multiply_by_max20, list<int> took RAW : 19.96 secs func calls : 23.97 secs (120.09%) vtable calls: 23.34 secs (116.934%) foreach calls: 19.96 secs (100%) Test multiply_by_max20, deque<int> took RAW : 18.89 secs func calls : 23.05 secs (122.022%) vtable calls: 23.61 secs (124.987%) foreach calls: 19.96 secs (105.664%) Test add_10, vector<int> took RAW : 0.75 secs func calls : 2.04 secs (272%) vtable calls: 2.39 secs (318.667%) foreach calls: 0.78 secs (104%) Test add_10, list<int> took RAW : 1.89 secs func calls : 2.66 secs (140.741%) vtable calls: 2.79 secs (147.619%) foreach calls: 1.89 secs (100%) Test add_10, deque<int> took RAW : 1.1 secs func calls : 2.4 secs (218.182%) vtable calls: 2.63 secs (239.091%) foreach calls: 1.1 secs (100%) Test add_one_char, vector<seq> took RAW : 3.16 secs func calls : 3.67 secs (116.139%) vtable calls: 3.67 secs (116.139%) foreach calls: 3.53 secs (111.709%) Test add_one_char, list<seq> took RAW : 3.75 secs func calls : 3.79 secs (101.067%) vtable calls: 3.95 secs (105.333%) foreach calls: 3.87 secs (103.2%) Test add_one_char, deque<seq> took RAW : 3.84 secs func calls : 4.49 secs (116.927%) vtable calls: 4.58 secs (119.271%) foreach calls: 3.94 secs (102.604%) Test set_to_len, vector<seq> took RAW : 8.4 secs func calls : 9.04 secs (107.619%) vtable calls: 9.34 secs (111.19%) foreach calls: 8.98 secs (106.905%) Test set_to_len, list<seq> took RAW : 9.07 secs func calls : 9.47 secs (104.41%) vtable calls: 9.12 secs (100.551%) foreach calls: 9.07 secs (100%) Test set_to_len, deque<seq> took RAW : 9.1 secs func calls : 9.2 secs (101.099%) vtable calls: 9.26 secs (101.758%) foreach calls: 9.25 secs (101.648%) Test set_to_az, vector<seq> took RAW : 12.75 secs func calls : 12.75 secs (100%) vtable calls: 12.75 secs (100%) foreach calls: 12.75 secs (100%) Test set_to_az, list<seq> took RAW : 11.66 secs func calls : 11.82 secs (101.372%) vtable calls: 11.71 secs (100.429%) foreach calls: 11.67 secs (100.086%) Test set_to_az, deque<seq> took RAW : 11.81 secs func calls : 12.47 secs (105.588%) vtable calls: 13.12 secs (111.092%) foreach calls: 12.89 secs (109.145%) Test noop, vector<int> took RAW : 1.29 secs func calls : 4.78 secs (370.543%) vtable calls: 4.93 secs (382.171%) foreach calls: 1.38 secs (106.977%) Test noop, list<int> took RAW : 1.86 secs func calls : 4.92 secs (264.516%) vtable calls: 5.17 secs (277.957%) foreach calls: 1.95 secs (104.839%) Test noop, deque<int> took RAW : 1.51 secs func calls : 5.14 secs (340.397%) vtable calls: 5.25 secs (347.682%) foreach calls: 1.56 secs (103.311%) Test noop, vector<seq> took RAW : 0.48 secs func calls : 1.93 secs (402.083%) vtable calls: 2.03 secs (422.917%) foreach calls: 0.54 secs (112.5%) Test noop, list<seq> took RAW : 0.72 secs func calls : 2.04 secs (283.333%) vtable calls: 2 secs (277.778%) foreach calls: 0.75 secs (104.167%) Test noop, deque<seq> took RAW : 0.64 secs func calls : 1.96 secs (306.25%) vtable calls: 2.14 secs (334.375%) foreach calls: 0.68 secs (106.25%) Regards Hartmut