Additional Results for Ace (Version 1.0)

Note that more recent versions of Ace may produce better results Grid:

The following benchmarks were used to illustrate the performance of an adaptation of the the model counter Cachet to probabilistic inference.

Result generated on a 2.4GHz Xeon processor with 4GB of RAM using Ace 1.0 (note that better performance might be achieved using a more recent version of Ace) and c2d version 2.20 with the following options: (1) edit compile and evaluate to allocate 2500 megabytes of memory; (2) compile with “compile -iip -dtClauseMinfilll foo.net”; (3) evaluate with “evaluate foo.net”.

NetworkAce Compile
Time(s)
Ace Online
Time(ms)
Ace Median
Compile
Time(s)
Ace Average
Compile
Time(s)
50-10-01.dne1.981351.59751.8451
50-10-02.dne3.439235
50-10-03.dne2.628273
50-10-04.dne1.4192
50-10-05.dne1.12148
50-10-06.dne1.46198
50-10-07.dne1.535123
50-10-08.dne1.66108
50-10-09.dne1.52294
50-10-10.dne1.695133
50-12-01.dne2.6621976.3836.0812
50-12-02.dne3.024191
50-12-03.dne6.762218
50-12-04.dne5.289186
50-12-05.dne7.934262
50-12-06.dne3.541282
50-12-07.dne6.92288
50-12-08.dne10.153262
50-12-09.dne6.004216
50-12-10.dne8.523250
50-14-01.dne58.30563937.114539.581
50-14-02.dne27.705475
50-14-03.dne37.82687
50-14-04.dne16.105354
50-14-05.dne62.126801
50-14-06.dne36.409484
50-14-07.dne62.161782
50-14-08.dne11.633306
50-14-09.dne59.967849
50-14-10.dne23.579448
50-16-01.dne497.3323814329.2745538.7215
50-16-02.dne319.4163276
50-16-03.dne106.524747
50-16-04.dne339.1332201
50-16-05.dne807.1694639
50-16-06.dne89.7451221
50-16-07.dne87.4991014
50-16-08.dne248.0282377
50-16-09.dne2508.58210717
50-16-10.dne383.7873201
50-18-01.dne684.5283983722.731153.250714
50-18-02.dne978.3777031
50-18-03.dne177.9171130
50-18-04.dneOut of memoryn/a
50-18-05.dneFile size too bign/a
50-18-06.dne2068.65615195
50-18-07.dne539.4114303
50-18-08.dne722.734377
50-18-09.dne2901.13615078
50-18-10.dneFile size too bign/a
75-10-01.dne0.886120.8810.898
75-10-02.dne1.05947
75-10-03.dne0.8532
75-10-04.dne0.79923
75-10-05.dne0.87621
75-10-06.dne0.81115
75-10-07.dne0.94223
75-10-08.dne0.97536
75-10-09.dne0.97429
75-10-10.dne0.80813
75-12-01.dne1.364641.48851.4222
75-12-02.dne1.09528
75-12-03.dne1.641149
75-12-04.dne1.08646
75-12-05.dne1.6371
75-12-06.dne1.59997
75-12-07.dne1.58594
75-12-08.dne1.64196
75-12-09.dne1.39258
75-12-10.dne1.18936
75-14-01.dne1.902882.98653.5674
75-14-02.dne1.90765
75-14-03.dne2.573132
75-14-04.dne2.783132
75-14-05.dne3.97184
75-14-06.dne5.194228
75-14-07.dne3.19148
75-14-08.dne3.843185
75-14-09.dne7.826198
75-14-10.dne2.486199
75-16-01.dne4.29224810.68716.3266
75-16-02.dne15.044243
75-16-03.dne20.361353
75-16-04.dne22.168391
75-16-05.dne2.952182
75-16-06.dne3.397233
75-16-07.dne22.522346
75-16-08.dne6.33256
75-16-09.dne61.443872
75-16-10.dne4.757224
75-18-01.dne9.96221410.636536.1906
75-18-02.dne8.55253
75-18-03.dne245.9162202
75-18-04.dne7.919201
75-18-05.dne4.866189
75-18-06.dne11.311262
75-18-07.dne17.728274
75-18-08.dne34.461480
75-18-09.dne8.534259
75-18-10.dne12.659233
75-20-01.dne313.4861626143.12155.0433
75-20-02.dne238.6271894
75-20-03.dne227.714829
75-20-04.dne36.642389
75-20-05.dne17.172278
75-20-06.dne44.512340
75-20-07.dne345.1531898
75-20-08.dne86.365694
75-20-09.dne40.887513
75-20-10.dne199.875653
75-22-01.dne427.8832394498.349809.4255
75-22-02.dne1838.31611376
75-22-03.dne1427.5616230
75-22-04.dneOut of memoryn/a
75-22-05.dneOut of memoryn/a
75-22-06.dne1637.6865820
75-22-07.dne568.8153545
75-22-08.dne104.106647
75-22-09.dne322.2321571
75-22-10.dne148.8051148
75-24-01.dne1253.76558051253.7651485.722
75-24-02.dne1515.1676182
75-24-03.dneOut of memoryn/a
75-24-04.dne350.61371
75-24-05.dne4065.51432
75-24-06.dne2305.23110618
75-24-07.dne180.002638
75-24-08.dne200.9721336
75-24-09.dne1075.5654756
75-24-10.dne2424.6829387
90-10-01.dne0.848110.80.7873
90-10-02.dne0.7428
90-10-03.dne0.7979
90-10-04.dne0.8157
90-10-05.dne0.8248
90-10-06.dne0.7568
90-10-07.dne0.7358
90-10-08.dne0.8038
90-10-09.dne0.749
90-10-10.dne0.8138
90-12-01.dne1.032130.92650.9472
90-12-02.dne0.8611
90-12-03.dne0.90514
90-12-04.dne0.88217
90-12-05.dne0.8719
90-12-06.dne0.9727
90-12-07.dne1.03320
90-12-08.dne1.06820
90-12-09.dne0.90313
90-12-10.dne0.94826
90-14-01.dne1.153211.1181.1392
90-14-02.dne1.09720
90-14-03.dne0.95312
90-14-04.dne1.19222
90-14-05.dne1.49988
90-14-06.dne1.00516
90-14-07.dne1.12416
90-14-08.dne1.11216
90-14-09.dne1.09118
90-14-10.dne1.16627
90-16-01.dne1.973651.2621.356
90-16-02.dne1.15714
90-16-03.dne1.25834
90-16-04.dne1.39945
90-16-05.dne1.24727
90-16-06.dne1.32649
90-16-07.dne1.26627
90-16-08.dne1.19429
90-16-09.dne1.60443
90-16-10.dne1.13618
90-18-01.dne4.6721371.67052.03
90-18-02.dne1.67437
90-18-03.dne1.66727
90-18-04.dne1.57432
90-18-05.dne2.38762
90-18-06.dne1.94351
90-18-07.dne1.55936
90-18-08.dne1.63334
90-18-09.dne1.44138
90-18-10.dne1.7549
90-20-01.dne1.912342.37452.7119
90-20-02.dne2.38565
90-20-03.dne2.22761
90-20-04.dne1.85739
90-20-05.dne3.503117
90-20-06.dne1.69951
90-20-07.dne4.931149
90-20-08.dne2.73660
90-20-09.dne2.36449
90-20-10.dne3.505143
90-22-01.dne7.7221873.6583.8033
90-22-02.dne4.885140
90-22-03.dne3.02784
90-22-04.dne3.31488
90-22-05.dne4.002140
90-22-06.dne1.95642
90-22-07.dne2.72370
90-22-08.dne2.09146
90-22-09.dne4.145152
90-22-10.dne4.168118
90-24-01.dne5.0431704.55155.1782
90-24-02.dne2.55259
90-24-03.dne4.173140
90-24-04.dne4.012110
90-24-05.dne6.02293
90-24-06.dne4.813142
90-24-07.dne3.612108
90-24-08.dne4.29117
90-24-09.dne5.081131
90-24-10.dne12.184288
90-26-01.dne10.67218247.867556.0283
90-26-02.dne91.13596
90-26-03.dne142.154533
90-26-04.dne12.934197
90-26-05.dne8.621165
90-26-06.dne66.838361
90-26-07.dne12.966240
90-26-08.dne28.897318
90-26-09.dne82.26303
90-26-10.dne103.811300
90-30-01.dne219.38490349.4579.2023
90-30-02.dne32.12285
90-30-03.dne15.316262
90-30-04.dne17.151213
90-30-05.dne121.313443
90-30-06.dne16.538216
90-30-07.dne21.406207
90-30-08.dne178.515419
90-30-09.dne103.5480
90-30-10.dne66.78417
90-34-01.dne6454.4136433190.97151102.0429
90-34-02.dne39.327231
90-34-03.dne154.46594
90-34-04.dne35.44292
90-34-05.dne16.407276
90-34-06.dne16.995214
90-34-07.dne1943.5983065
90-34-08.dne1176.1012204
90-34-09.dne227.4831048
90-34-10.dne956.205989
90-38-01.dne2821.54521382450.7613174.670375
90-38-02.dne3287.7424268
90-38-03.dne8301.2176288
90-38-04.dne1954.4322266
90-38-05.dne5183.0465111
90-38-06.dne2079.9771794
90-38-07.dneOut of memoryn/a
90-38-08.dne1709.4581941
90-38-09.dne59.946304
90-38-10.dneOut of memoryn/a

DQMR:

The following benchmarks were used to illustrate the performance of an adaptation of the the model counter Cachet to probabilistic inference.

Result generated on a 2.4GHz Xeon processor with 4GB of RAM using Ace 1.0 (note that better performance might be achieved using a more recent version of Ace) and c2d version 2.20 with the following options: (1) edit compile and evaluate to allocate 2500 megabytes of memory; (2) compile with “compile -iip -dtClauseMinfilll foo.net”; (3) evaluate with “evaluate foo.net”.

NetworkAce Compile
Time(s)
Ace Online
Time(ms)
Ace Median
Compile
Time(s)
Ace Average
Compile
Time(s)
or-50-05-1.dne2.081323.258513.4264
or-50-05-10.dne1.18133
or-50-05-2.dne66.624433
or-50-05-3.dne0.9716
or-50-05-4.dne16.301245
or-50-05-5.dne27.507262
or-50-05-6.dne0.99718
or-50-05-7.dne12.087255
or-50-05-8.dne3.204186
or-50-05-9.dne3.313185
or-50-10-1.dne6.9222362.314513.7998
or-50-10-10.dne1.15556
or-50-10-2.dne0.98622
or-50-10-3.dne1.37375
or-50-10-4.dne3.478202
or-50-10-5.dne3.322142
or-50-10-6.dne1.902127
or-50-10-7.dne115.091511
or-50-10-8.dne1.04222
or-50-10-9.dne2.727171
or-50-20-1.dne52.8714545.566533.3894
or-50-20-10.dne2.958227
or-50-20-2.dne173.285910
or-50-20-3.dne26.632318
or-50-20-4.dne1.25649
or-50-20-5.dne6.953218
or-50-20-6.dne4.18203
or-50-20-7.dne2.322131
or-50-20-8.dne1.15642
or-50-20-9.dne62.281408
or-60-05-1.dne1.128402.26521.2536
or-60-05-10.dne1.48579
or-60-05-2.dne1.812129
or-60-05-3.dne150.3621062
or-60-05-4.dne1.10821
or-60-05-5.dne2.718181
or-60-05-6.dne6.793272
or-60-05-7.dne1.27967
or-60-05-8.dne42.787473
or-60-05-9.dne3.064203
or-60-10-1.dne106.9573210.95766.8847
or-60-10-10.dne82.2581081
or-60-10-2.dne16.204286
or-60-10-3.dne297.992584
or-60-10-4.dne5.71204
or-60-10-5.dne2.158133
or-60-10-6.dne152.3281061
or-60-10-7.dne2.497177
or-60-10-8.dne1.19447
or-60-10-9.dne1.558118
or-60-20-1.dne357.0562521222.1515364.8567
or-60-20-10.dne34.221541
or-60-20-2.dne221.0541413
or-60-20-3.dne1.932126
or-60-20-4.dne395.6711921
or-60-20-5.dne576.0213147
or-60-20-6.dne1809.0414563
or-60-20-7.dne223.249997
or-60-20-8.dne22.789382
or-60-20-9.dne7.533301
or-70-05-1.dne10.16424010.4375124.1708
or-70-05-10.dne11.262261
or-70-05-2.dne10.711297
or-70-05-3.dne1.0112
or-70-05-4.dne165.891241
or-70-05-5.dne3.563227
or-70-05-6.dne922.6653581
or-70-05-7.dne108.35547
or-70-05-8.dne6.801304
or-70-05-9.dne1.29243
or-70-10-1.dne2.884173131.8835268.9098
or-70-10-10.dne354.2211836
or-70-10-2.dne547.1233107
or-70-10-3.dne3.484192
or-70-10-4.dne1075.9127021
or-70-10-5.dne234.542542
or-70-10-6.dne29.227327
or-70-10-7.dne435.8081585
or-70-10-8.dne3.472233
or-70-10-9.dne2.427219
or-70-20-1.dne9.462256170.311221.260333
or-70-20-10.dne112.987844
or-70-20-2.dne88.148745
or-70-20-3.dneOut of memoryn/a
or-70-20-4.dne2916.70411272
or-70-20-5.dne1312.57342
or-70-20-6.dne246.6711806
or-70-20-7.dne170.311122
or-70-20-8.dne6133.13317717
or-70-20-9.dne1.42892