Timeline for How to evalute the quality of a solver (beyond solution quality and time efficiency)?
Current License: CC BY-SA 4.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Aug 7, 2020 at 6:41 | comment | added | Richard | I agree with @prubin: this falls into the category of solution quality. It is key that a solver is reliable and provides a high quality solution. This is why I find mathematical solvers so appealing, since the optimality gap gives an unambiguous metric for the quality. | |
| Aug 6, 2020 at 18:04 | comment | added | prubin♦ | I'd say it's more related to solution quality. With a heuristic, you don't expect an optimal solution each time, but you also don't want to judge it on the best of a series of runs. I would be inclined to judge it on median performance and also perhaps on the quartiles of performance, or the 10th and 90th percentiles, or some other measure of spread. | |
| Aug 5, 2020 at 17:32 | comment | added | Joffrey L. | Okay so, here is a problem: If I run the solver 20 times with a heuristic approach, the best results are far from the median. Is this problem related to the robustness ? | |
| Aug 5, 2020 at 12:39 | history | answered | Richard | CC BY-SA 4.0 |