Additional Results for Ace (Version 1.0)
Note that more recent versions of Ace may produce better results Grid:
The following benchmarks were used to illustrate the performance of an adaptation of the the model counter Cachet to probabilistic inference.
Result generated on a 2.4GHz Xeon processor with 4GB of RAM using Ace 1.0 (note that better performance might be achieved using a more recent version of Ace) and c2d version 2.20 with the following options: (1) edit compile and evaluate to allocate 2500 megabytes of memory; (2) compile with “compile -iip -dtClauseMinfilll foo.net”; (3) evaluate with “evaluate foo.net”.
Network | Ace Compile Time(s) | Ace Online Time(ms) | Ace Median Compile Time(s) | Ace Average Compile Time(s) |
50-10-01.dne | 1.98 | 135 | 1.5975 | 1.8451 |
50-10-02.dne | 3.439 | 235 | ||
50-10-03.dne | 2.628 | 273 | ||
50-10-04.dne | 1.41 | 92 | ||
50-10-05.dne | 1.121 | 48 | ||
50-10-06.dne | 1.461 | 98 | ||
50-10-07.dne | 1.535 | 123 | ||
50-10-08.dne | 1.66 | 108 | ||
50-10-09.dne | 1.522 | 94 | ||
50-10-10.dne | 1.695 | 133 | ||
50-12-01.dne | 2.662 | 197 | 6.383 | 6.0812 |
50-12-02.dne | 3.024 | 191 | ||
50-12-03.dne | 6.762 | 218 | ||
50-12-04.dne | 5.289 | 186 | ||
50-12-05.dne | 7.934 | 262 | ||
50-12-06.dne | 3.541 | 282 | ||
50-12-07.dne | 6.92 | 288 | ||
50-12-08.dne | 10.153 | 262 | ||
50-12-09.dne | 6.004 | 216 | ||
50-12-10.dne | 8.523 | 250 | ||
50-14-01.dne | 58.305 | 639 | 37.1145 | 39.581 |
50-14-02.dne | 27.705 | 475 | ||
50-14-03.dne | 37.82 | 687 | ||
50-14-04.dne | 16.105 | 354 | ||
50-14-05.dne | 62.126 | 801 | ||
50-14-06.dne | 36.409 | 484 | ||
50-14-07.dne | 62.161 | 782 | ||
50-14-08.dne | 11.633 | 306 | ||
50-14-09.dne | 59.967 | 849 | ||
50-14-10.dne | 23.579 | 448 | ||
50-16-01.dne | 497.332 | 3814 | 329.2745 | 538.7215 |
50-16-02.dne | 319.416 | 3276 | ||
50-16-03.dne | 106.524 | 747 | ||
50-16-04.dne | 339.133 | 2201 | ||
50-16-05.dne | 807.169 | 4639 | ||
50-16-06.dne | 89.745 | 1221 | ||
50-16-07.dne | 87.499 | 1014 | ||
50-16-08.dne | 248.028 | 2377 | ||
50-16-09.dne | 2508.582 | 10717 | ||
50-16-10.dne | 383.787 | 3201 | ||
50-18-01.dne | 684.528 | 3983 | 722.73 | 1153.250714 |
50-18-02.dne | 978.377 | 7031 | ||
50-18-03.dne | 177.917 | 1130 | ||
50-18-04.dne | Out of memory | n/a | ||
50-18-05.dne | File size too big | n/a | ||
50-18-06.dne | 2068.656 | 15195 | ||
50-18-07.dne | 539.411 | 4303 | ||
50-18-08.dne | 722.73 | 4377 | ||
50-18-09.dne | 2901.136 | 15078 | ||
50-18-10.dne | File size too big | n/a | ||
75-10-01.dne | 0.886 | 12 | 0.881 | 0.898 |
75-10-02.dne | 1.059 | 47 | ||
75-10-03.dne | 0.85 | 32 | ||
75-10-04.dne | 0.799 | 23 | ||
75-10-05.dne | 0.876 | 21 | ||
75-10-06.dne | 0.811 | 15 | ||
75-10-07.dne | 0.942 | 23 | ||
75-10-08.dne | 0.975 | 36 | ||
75-10-09.dne | 0.974 | 29 | ||
75-10-10.dne | 0.808 | 13 | ||
75-12-01.dne | 1.364 | 64 | 1.4885 | 1.4222 |
75-12-02.dne | 1.095 | 28 | ||
75-12-03.dne | 1.641 | 149 | ||
75-12-04.dne | 1.086 | 46 | ||
75-12-05.dne | 1.63 | 71 | ||
75-12-06.dne | 1.599 | 97 | ||
75-12-07.dne | 1.585 | 94 | ||
75-12-08.dne | 1.641 | 96 | ||
75-12-09.dne | 1.392 | 58 | ||
75-12-10.dne | 1.189 | 36 | ||
75-14-01.dne | 1.902 | 88 | 2.9865 | 3.5674 |
75-14-02.dne | 1.907 | 65 | ||
75-14-03.dne | 2.573 | 132 | ||
75-14-04.dne | 2.783 | 132 | ||
75-14-05.dne | 3.97 | 184 | ||
75-14-06.dne | 5.194 | 228 | ||
75-14-07.dne | 3.19 | 148 | ||
75-14-08.dne | 3.843 | 185 | ||
75-14-09.dne | 7.826 | 198 | ||
75-14-10.dne | 2.486 | 199 | ||
75-16-01.dne | 4.292 | 248 | 10.687 | 16.3266 |
75-16-02.dne | 15.044 | 243 | ||
75-16-03.dne | 20.361 | 353 | ||
75-16-04.dne | 22.168 | 391 | ||
75-16-05.dne | 2.952 | 182 | ||
75-16-06.dne | 3.397 | 233 | ||
75-16-07.dne | 22.522 | 346 | ||
75-16-08.dne | 6.33 | 256 | ||
75-16-09.dne | 61.443 | 872 | ||
75-16-10.dne | 4.757 | 224 | ||
75-18-01.dne | 9.962 | 214 | 10.6365 | 36.1906 |
75-18-02.dne | 8.55 | 253 | ||
75-18-03.dne | 245.916 | 2202 | ||
75-18-04.dne | 7.919 | 201 | ||
75-18-05.dne | 4.866 | 189 | ||
75-18-06.dne | 11.311 | 262 | ||
75-18-07.dne | 17.728 | 274 | ||
75-18-08.dne | 34.461 | 480 | ||
75-18-09.dne | 8.534 | 259 | ||
75-18-10.dne | 12.659 | 233 | ||
75-20-01.dne | 313.486 | 1626 | 143.12 | 155.0433 |
75-20-02.dne | 238.627 | 1894 | ||
75-20-03.dne | 227.714 | 829 | ||
75-20-04.dne | 36.642 | 389 | ||
75-20-05.dne | 17.172 | 278 | ||
75-20-06.dne | 44.512 | 340 | ||
75-20-07.dne | 345.153 | 1898 | ||
75-20-08.dne | 86.365 | 694 | ||
75-20-09.dne | 40.887 | 513 | ||
75-20-10.dne | 199.875 | 653 | ||
75-22-01.dne | 427.883 | 2394 | 498.349 | 809.4255 |
75-22-02.dne | 1838.316 | 11376 | ||
75-22-03.dne | 1427.561 | 6230 | ||
75-22-04.dne | Out of memory | n/a | ||
75-22-05.dne | Out of memory | n/a | ||
75-22-06.dne | 1637.686 | 5820 | ||
75-22-07.dne | 568.815 | 3545 | ||
75-22-08.dne | 104.106 | 647 | ||
75-22-09.dne | 322.232 | 1571 | ||
75-22-10.dne | 148.805 | 1148 | ||
75-24-01.dne | 1253.765 | 5805 | 1253.765 | 1485.722 |
75-24-02.dne | 1515.167 | 6182 | ||
75-24-03.dne | Out of memory | n/a | ||
75-24-04.dne | 350.6 | 1371 | ||
75-24-05.dne | 4065.514 | 32 | ||
75-24-06.dne | 2305.231 | 10618 | ||
75-24-07.dne | 180.002 | 638 | ||
75-24-08.dne | 200.972 | 1336 | ||
75-24-09.dne | 1075.565 | 4756 | ||
75-24-10.dne | 2424.682 | 9387 | ||
90-10-01.dne | 0.848 | 11 | 0.8 | 0.7873 |
90-10-02.dne | 0.742 | 8 | ||
90-10-03.dne | 0.797 | 9 | ||
90-10-04.dne | 0.815 | 7 | ||
90-10-05.dne | 0.824 | 8 | ||
90-10-06.dne | 0.756 | 8 | ||
90-10-07.dne | 0.735 | 8 | ||
90-10-08.dne | 0.803 | 8 | ||
90-10-09.dne | 0.74 | 9 | ||
90-10-10.dne | 0.813 | 8 | ||
90-12-01.dne | 1.032 | 13 | 0.9265 | 0.9472 |
90-12-02.dne | 0.86 | 11 | ||
90-12-03.dne | 0.905 | 14 | ||
90-12-04.dne | 0.882 | 17 | ||
90-12-05.dne | 0.871 | 9 | ||
90-12-06.dne | 0.97 | 27 | ||
90-12-07.dne | 1.033 | 20 | ||
90-12-08.dne | 1.068 | 20 | ||
90-12-09.dne | 0.903 | 13 | ||
90-12-10.dne | 0.948 | 26 | ||
90-14-01.dne | 1.153 | 21 | 1.118 | 1.1392 |
90-14-02.dne | 1.097 | 20 | ||
90-14-03.dne | 0.953 | 12 | ||
90-14-04.dne | 1.192 | 22 | ||
90-14-05.dne | 1.499 | 88 | ||
90-14-06.dne | 1.005 | 16 | ||
90-14-07.dne | 1.124 | 16 | ||
90-14-08.dne | 1.112 | 16 | ||
90-14-09.dne | 1.091 | 18 | ||
90-14-10.dne | 1.166 | 27 | ||
90-16-01.dne | 1.973 | 65 | 1.262 | 1.356 |
90-16-02.dne | 1.157 | 14 | ||
90-16-03.dne | 1.258 | 34 | ||
90-16-04.dne | 1.399 | 45 | ||
90-16-05.dne | 1.247 | 27 | ||
90-16-06.dne | 1.326 | 49 | ||
90-16-07.dne | 1.266 | 27 | ||
90-16-08.dne | 1.194 | 29 | ||
90-16-09.dne | 1.604 | 43 | ||
90-16-10.dne | 1.136 | 18 | ||
90-18-01.dne | 4.672 | 137 | 1.6705 | 2.03 |
90-18-02.dne | 1.674 | 37 | ||
90-18-03.dne | 1.667 | 27 | ||
90-18-04.dne | 1.574 | 32 | ||
90-18-05.dne | 2.387 | 62 | ||
90-18-06.dne | 1.943 | 51 | ||
90-18-07.dne | 1.559 | 36 | ||
90-18-08.dne | 1.633 | 34 | ||
90-18-09.dne | 1.441 | 38 | ||
90-18-10.dne | 1.75 | 49 | ||
90-20-01.dne | 1.912 | 34 | 2.3745 | 2.7119 |
90-20-02.dne | 2.385 | 65 | ||
90-20-03.dne | 2.227 | 61 | ||
90-20-04.dne | 1.857 | 39 | ||
90-20-05.dne | 3.503 | 117 | ||
90-20-06.dne | 1.699 | 51 | ||
90-20-07.dne | 4.931 | 149 | ||
90-20-08.dne | 2.736 | 60 | ||
90-20-09.dne | 2.364 | 49 | ||
90-20-10.dne | 3.505 | 143 | ||
90-22-01.dne | 7.722 | 187 | 3.658 | 3.8033 |
90-22-02.dne | 4.885 | 140 | ||
90-22-03.dne | 3.027 | 84 | ||
90-22-04.dne | 3.314 | 88 | ||
90-22-05.dne | 4.002 | 140 | ||
90-22-06.dne | 1.956 | 42 | ||
90-22-07.dne | 2.723 | 70 | ||
90-22-08.dne | 2.091 | 46 | ||
90-22-09.dne | 4.145 | 152 | ||
90-22-10.dne | 4.168 | 118 | ||
90-24-01.dne | 5.043 | 170 | 4.5515 | 5.1782 |
90-24-02.dne | 2.552 | 59 | ||
90-24-03.dne | 4.173 | 140 | ||
90-24-04.dne | 4.012 | 110 | ||
90-24-05.dne | 6.022 | 93 | ||
90-24-06.dne | 4.813 | 142 | ||
90-24-07.dne | 3.612 | 108 | ||
90-24-08.dne | 4.29 | 117 | ||
90-24-09.dne | 5.081 | 131 | ||
90-24-10.dne | 12.184 | 288 | ||
90-26-01.dne | 10.672 | 182 | 47.8675 | 56.0283 |
90-26-02.dne | 91.13 | 596 | ||
90-26-03.dne | 142.154 | 533 | ||
90-26-04.dne | 12.934 | 197 | ||
90-26-05.dne | 8.621 | 165 | ||
90-26-06.dne | 66.838 | 361 | ||
90-26-07.dne | 12.966 | 240 | ||
90-26-08.dne | 28.897 | 318 | ||
90-26-09.dne | 82.26 | 303 | ||
90-26-10.dne | 103.811 | 300 | ||
90-30-01.dne | 219.384 | 903 | 49.45 | 79.2023 |
90-30-02.dne | 32.12 | 285 | ||
90-30-03.dne | 15.316 | 262 | ||
90-30-04.dne | 17.151 | 213 | ||
90-30-05.dne | 121.313 | 443 | ||
90-30-06.dne | 16.538 | 216 | ||
90-30-07.dne | 21.406 | 207 | ||
90-30-08.dne | 178.515 | 419 | ||
90-30-09.dne | 103.5 | 480 | ||
90-30-10.dne | 66.78 | 417 | ||
90-34-01.dne | 6454.413 | 6433 | 190.9715 | 1102.0429 |
90-34-02.dne | 39.327 | 231 | ||
90-34-03.dne | 154.46 | 594 | ||
90-34-04.dne | 35.44 | 292 | ||
90-34-05.dne | 16.407 | 276 | ||
90-34-06.dne | 16.995 | 214 | ||
90-34-07.dne | 1943.598 | 3065 | ||
90-34-08.dne | 1176.101 | 2204 | ||
90-34-09.dne | 227.483 | 1048 | ||
90-34-10.dne | 956.205 | 989 | ||
90-38-01.dne | 2821.545 | 2138 | 2450.761 | 3174.670375 |
90-38-02.dne | 3287.742 | 4268 | ||
90-38-03.dne | 8301.217 | 6288 | ||
90-38-04.dne | 1954.432 | 2266 | ||
90-38-05.dne | 5183.046 | 5111 | ||
90-38-06.dne | 2079.977 | 1794 | ||
90-38-07.dne | Out of memory | n/a | ||
90-38-08.dne | 1709.458 | 1941 | ||
90-38-09.dne | 59.946 | 304 | ||
90-38-10.dne | Out of memory | n/a |
DQMR:
The following benchmarks were used to illustrate the performance of an adaptation of the the model counter Cachet to probabilistic inference.
Result generated on a 2.4GHz Xeon processor with 4GB of RAM using Ace 1.0 (note that better performance might be achieved using a more recent version of Ace) and c2d version 2.20 with the following options: (1) edit compile and evaluate to allocate 2500 megabytes of memory; (2) compile with “compile -iip -dtClauseMinfilll foo.net”; (3) evaluate with “evaluate foo.net”.
Network | Ace Compile Time(s) | Ace Online Time(ms) | Ace Median Compile Time(s) | Ace Average Compile Time(s) |
or-50-05-1.dne | 2.08 | 132 | 3.2585 | 13.4264 |
or-50-05-10.dne | 1.181 | 33 | ||
or-50-05-2.dne | 66.624 | 433 | ||
or-50-05-3.dne | 0.97 | 16 | ||
or-50-05-4.dne | 16.301 | 245 | ||
or-50-05-5.dne | 27.507 | 262 | ||
or-50-05-6.dne | 0.997 | 18 | ||
or-50-05-7.dne | 12.087 | 255 | ||
or-50-05-8.dne | 3.204 | 186 | ||
or-50-05-9.dne | 3.313 | 185 | ||
or-50-10-1.dne | 6.922 | 236 | 2.3145 | 13.7998 |
or-50-10-10.dne | 1.155 | 56 | ||
or-50-10-2.dne | 0.986 | 22 | ||
or-50-10-3.dne | 1.373 | 75 | ||
or-50-10-4.dne | 3.478 | 202 | ||
or-50-10-5.dne | 3.322 | 142 | ||
or-50-10-6.dne | 1.902 | 127 | ||
or-50-10-7.dne | 115.091 | 511 | ||
or-50-10-8.dne | 1.042 | 22 | ||
or-50-10-9.dne | 2.727 | 171 | ||
or-50-20-1.dne | 52.871 | 454 | 5.5665 | 33.3894 |
or-50-20-10.dne | 2.958 | 227 | ||
or-50-20-2.dne | 173.285 | 910 | ||
or-50-20-3.dne | 26.632 | 318 | ||
or-50-20-4.dne | 1.256 | 49 | ||
or-50-20-5.dne | 6.953 | 218 | ||
or-50-20-6.dne | 4.18 | 203 | ||
or-50-20-7.dne | 2.322 | 131 | ||
or-50-20-8.dne | 1.156 | 42 | ||
or-50-20-9.dne | 62.281 | 408 | ||
or-60-05-1.dne | 1.128 | 40 | 2.265 | 21.2536 |
or-60-05-10.dne | 1.485 | 79 | ||
or-60-05-2.dne | 1.812 | 129 | ||
or-60-05-3.dne | 150.362 | 1062 | ||
or-60-05-4.dne | 1.108 | 21 | ||
or-60-05-5.dne | 2.718 | 181 | ||
or-60-05-6.dne | 6.793 | 272 | ||
or-60-05-7.dne | 1.279 | 67 | ||
or-60-05-8.dne | 42.787 | 473 | ||
or-60-05-9.dne | 3.064 | 203 | ||
or-60-10-1.dne | 106.95 | 732 | 10.957 | 66.8847 |
or-60-10-10.dne | 82.258 | 1081 | ||
or-60-10-2.dne | 16.204 | 286 | ||
or-60-10-3.dne | 297.99 | 2584 | ||
or-60-10-4.dne | 5.71 | 204 | ||
or-60-10-5.dne | 2.158 | 133 | ||
or-60-10-6.dne | 152.328 | 1061 | ||
or-60-10-7.dne | 2.497 | 177 | ||
or-60-10-8.dne | 1.194 | 47 | ||
or-60-10-9.dne | 1.558 | 118 | ||
or-60-20-1.dne | 357.056 | 2521 | 222.1515 | 364.8567 |
or-60-20-10.dne | 34.221 | 541 | ||
or-60-20-2.dne | 221.054 | 1413 | ||
or-60-20-3.dne | 1.932 | 126 | ||
or-60-20-4.dne | 395.671 | 1921 | ||
or-60-20-5.dne | 576.021 | 3147 | ||
or-60-20-6.dne | 1809.041 | 4563 | ||
or-60-20-7.dne | 223.249 | 997 | ||
or-60-20-8.dne | 22.789 | 382 | ||
or-60-20-9.dne | 7.533 | 301 | ||
or-70-05-1.dne | 10.164 | 240 | 10.4375 | 124.1708 |
or-70-05-10.dne | 11.262 | 261 | ||
or-70-05-2.dne | 10.711 | 297 | ||
or-70-05-3.dne | 1.01 | 12 | ||
or-70-05-4.dne | 165.89 | 1241 | ||
or-70-05-5.dne | 3.563 | 227 | ||
or-70-05-6.dne | 922.665 | 3581 | ||
or-70-05-7.dne | 108.35 | 547 | ||
or-70-05-8.dne | 6.801 | 304 | ||
or-70-05-9.dne | 1.292 | 43 | ||
or-70-10-1.dne | 2.884 | 173 | 131.8835 | 268.9098 |
or-70-10-10.dne | 354.221 | 1836 | ||
or-70-10-2.dne | 547.123 | 3107 | ||
or-70-10-3.dne | 3.484 | 192 | ||
or-70-10-4.dne | 1075.912 | 7021 | ||
or-70-10-5.dne | 234.54 | 2542 | ||
or-70-10-6.dne | 29.227 | 327 | ||
or-70-10-7.dne | 435.808 | 1585 | ||
or-70-10-8.dne | 3.472 | 233 | ||
or-70-10-9.dne | 2.427 | 219 | ||
or-70-20-1.dne | 9.462 | 256 | 170.31 | 1221.260333 |
or-70-20-10.dne | 112.987 | 844 | ||
or-70-20-2.dne | 88.148 | 745 | ||
or-70-20-3.dne | Out of memory | n/a | ||
or-70-20-4.dne | 2916.704 | 11272 | ||
or-70-20-5.dne | 1312.5 | 7342 | ||
or-70-20-6.dne | 246.671 | 1806 | ||
or-70-20-7.dne | 170.31 | 1122 | ||
or-70-20-8.dne | 6133.133 | 17717 | ||
or-70-20-9.dne | 1.428 | 92 |