16
$\begingroup$

Recently I came across with the lack of information about Mathematica performance in different machines, even though there's a benchmark process already implemented, the WolframMark. Data available includes only 15 old machines and I couldn't find more online.

As a lot of people consider Mathematica's performance when buying a computer I think it'll be very useful to create a database that includes benchmark results from different processors and operational systems.

It's very simple to ask people to run the benchmark in their computers, my suggestion is to ask them to restart the Kernel (two clicks procedure), run

Needs["Benchmarking`"]
Benchmark[]

and send the output with some key-specs like processor's model, number of cores, frequency and RAM.

If we create such database we can provide useful information about what one should consider when buying a machine and it can be hosted in a website or sent to Wolfram.

I think it's pretty easy to gather data since we can ask our friends and even send institutional/corporate emails. In conclusion, are there people interested in contributing for this project?

OBS: I think WolframMark seems reliable enough to compare machines. After 100 benchmark results my 3th-gen-i3 score was 1.166(9) and one colleague's 5th-gen-i7 got 1.38(4).

Improve this question
$\endgroup$
12
  • 2
    $\begingroup$ Perhaps it might be relevant, but maybe other applications should be closed while performing the benchmark? $\endgroup$
    – DrMrstheMonarch
    Commented Aug 23, 2019 at 16:42
  • 2
    $\begingroup$ I wonder if other applications have a significant effect, considering Mathematica prefers to use only one thread each time (only alternating between them), though I agree it's a relevant factor to consider! $\endgroup$
    – user45926
    Commented Aug 23, 2019 at 16:43
  • $\begingroup$ I think you (or an answer) should provide the code that gathers the benchmark and system information and posts it automatically to a public place easy to retrieve. Then we can all have fun doing stats with the data. $\endgroup$
    – rhermans
    Commented Aug 23, 2019 at 16:57
  • $\begingroup$ What kind of answer do you expect here? I think asking for an opinion poll is off-topic. Probably asking for code to gather the data would be a better question? $\endgroup$
    – rhermans
    Commented Aug 23, 2019 at 17:00
  • 1
    $\begingroup$ One issue is that performance likely depends on the version of MMA used, so that needs to be specified. Another issue is that it would be nice to have both single-core and multi-core benchmarks (in the latter case, the number of cores available to the MMA license would need to be specified). WolframMark may be single-core only. Karl Unterkofler used to run a MMA benchmarking site, which was very useful because he collected detailed system info, had separate benchmark lists for each recent version of MMA, and had separate single-core and multi-core benchmarks. $\endgroup$
    – theorist
    Commented Aug 24, 2019 at 4:36

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.