Regression and Classification Results

Classification Results

Best median \(F_1\) results achieved in all the learners variants tested. Results are displayed by data set an sampling strategy. The highlighted cells signals the best results by data set while the symbol \(\dagger\) signals the best results inside each sampling strategy.

Learn Strat DS1 DS2 DS3 DS4 DS5 DS6 DS7 DS8 DS9 DS10 DS11 DS12 DS13 DS14 DS15 DS16
SVM None 0.984 0.763 0.859 0.855 1.000 0.976 0.960 0.631 0.586 0.566 0.211 0.182 0.558 0.974 0.667 0.750
U._._ 0.984 \(\dagger\) 0.765 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 0.678 0.603 \(\dagger\) 0.623 \(\dagger\) 0.485 \(\dagger\) 0.511 0.500 0.930 0.333 0.513
U.F._ 0.984 \(\dagger\) 0.764 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 0.660 0.600 0.593 0.481 0.524 0.545 \(\dagger\) 0.952 \(\dagger\) 0.364 0.533 \(\dagger\)
U.S._ 0.984 \(\dagger\) 0.766 \(\dagger\) 0.862 \(\dagger\) 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.969 \(\dagger\) 0.693 \(\dagger\) 0.592 0.611 0.473 0.528 \(\dagger\) 0.500 0.950 0.400 \(\dagger\) 0.471
S._._ 0.984 0.767 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 \(\dagger\) 0.689 0.594 0.617 \(\dagger\) 0.466 0.521 0.545 0.963 0.500 \(\dagger\) 0.667 \(\dagger\)
S.S.S 0.985 \(\dagger\) 0.771 \(\dagger\) 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 \(\dagger\) 0.684 0.598 0.614 0.466 0.535 \(\dagger\) 0.600 \(\dagger\) 0.963 0.500 \(\dagger\) 0.667 \(\dagger\)
S.F.S 0.985 \(\dagger\) 0.771 \(\dagger\) 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 \(\dagger\) 0.684 0.598 0.609 0.466 0.535 \(\dagger\) 0.600 \(\dagger\) 0.952 0.500 \(\dagger\) 0.667 \(\dagger\)
S.S.F 0.985 \(\dagger\) 0.771 \(\dagger\) 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 \(\dagger\) 0.693 \(\dagger\) 0.613 \(\dagger\) 0.600 0.471 \(\dagger\) 0.514 0.586 0.974 \(\dagger\) 0.500 \(\dagger\) 0.615
S.F.F 0.985 \(\dagger\) 0.771 \(\dagger\) 0.859 0.855 \(\dagger\) 1.000 \(\dagger\) 0.976 \(\dagger\) 0.960 \(\dagger\) 0.693 \(\dagger\) 0.613 \(\dagger\) 0.605 0.471 \(\dagger\) 0.514 0.586 0.952 0.450 0.615
NNET None 0.888 0.755 0.833 0.829 1.000 0.810 0.978 0.526 0.536 0.590 0.467 0.456 0.400 0.914 1.000 0.800
U._._ 0.886 \(\dagger\) 0.751 0.843 0.837 \(\dagger\) 1.000 \(\dagger\) 0.745 0.941 0.574 0.603 \(\dagger\) 0.569 0.490 0.506 0.400 \(\dagger\) 0.907 0.333 0.471
U.F._ 0.885 0.760 0.826 0.824 1.000 \(\dagger\) 0.746 0.939 0.553 0.582 0.542 0.500 0.522 \(\dagger\) 0.400 \(\dagger\) 0.923 \(\dagger\) 0.422 \(\dagger\) 0.533 \(\dagger\)
U.S._ 0.877 0.762 \(\dagger\) 0.854 \(\dagger\) 0.827 1.000 \(\dagger\) 0.802 \(\dagger\) 0.959 \(\dagger\) 0.601 \(\dagger\) 0.594 0.592 \(\dagger\) 0.513 \(\dagger\) 0.488 0.400 \(\dagger\) 0.889 0.422 \(\dagger\) 0.466
S._._ 0.888 \(\dagger\) 0.761 \(\dagger\) 0.836 \(\dagger\) 0.846 \(\dagger\) 1.000 \(\dagger\) 0.762 0.665 \(\dagger\) 0.654 \(\dagger\) 0.603 0.597 0.500 0.541 \(\dagger\) 0.400 \(\dagger\) 0.902 0.500 0.667
S.S.S 0.878 0.753 0.825 0.838 1.000 \(\dagger\) 0.883 \(\dagger\) 0.958 0.625 0.591 0.605 0.519 \(\dagger\) 0.505 0.400 \(\dagger\) 0.909 \(\dagger\) 0.500 0.667
S.F.S 0.878 0.753 0.813 0.821 1.000 \(\dagger\) 0.883 \(\dagger\) 0.958 0.625 0.591 0.637 0.519 \(\dagger\) 0.505 0.400 \(\dagger\) 0.909 \(\dagger\) 0.500 0.690
S.S.F 0.878 0.753 0.825 0.836 1.000 \(\dagger\) 0.684 0.941 0.574 0.611 \(\dagger\) 0.657 0.513 0.500 0.400 \(\dagger\) 0.907 0.571 \(\dagger\) 0.641
S.F.F 0.878 0.753 0.813 0.840 1.000 \(\dagger\) 0.684 0.941 0.574 0.611 \(\dagger\) 0.658 \(\dagger\) 0.513 0.500 0.400 \(\dagger\) 0.902 0.500 0.697 \(\dagger\)
RF None 0.985 0.771 0.859 0.855 1.000 0.976 0.960 0.693 0.613 0.605 0.471 0.514 0.586 0.952 0.450 0.615
U._._ 0.959 0.703 \(\dagger\) 0.859 0.862 0.992 \(\dagger\) 0.955 0.960 \(\dagger\) 0.687 \(\dagger\) 0.601 \(\dagger\) 0.619 0.449 0.467 \(\dagger\) 0.400 0.889 0.400 \(\dagger\) 0.544
U.F._ 0.958 0.698 0.862 \(\dagger\) 0.871 \(\dagger\) 0.992 \(\dagger\) 0.953 0.960 \(\dagger\) 0.661 0.581 0.609 0.421 0.410 0.500 \(\dagger\) 0.930 \(\dagger\) 0.400 \(\dagger\) 0.539
U.S._ 0.960 \(\dagger\) 0.698 0.857 0.866 0.992 \(\dagger\) 0.956 \(\dagger\) 0.960 \(\dagger\) 0.672 0.592 0.603 0.476 \(\dagger\) 0.457 0.400 0.897 0.400 \(\dagger\) 0.615 \(\dagger\)
S._._ 0.960 \(\dagger\) 0.694 0.859 \(\dagger\) 0.871 \(\dagger\) 0.992 \(\dagger\) 0.956 0.960 \(\dagger\) 0.677 0.594 0.621 \(\dagger\) 0.390 0.421 0.545 0.930 0.536 0.633
S.S.S 0.960 \(\dagger\) 0.695 \(\dagger\) 0.857 0.864 0.992 \(\dagger\) 0.966 \(\dagger\) 0.959 0.672 0.591 0.604 0.411 0.437 \(\dagger\) 0.444 0.941 0.667 \(\dagger\) 0.523
S.F.S 0.960 \(\dagger\) 0.695 \(\dagger\) 0.853 0.860 0.992 \(\dagger\) 0.966 \(\dagger\) 0.959 0.672 0.591 0.592 0.411 0.437 \(\dagger\) 0.444 0.930 0.667 \(\dagger\) 0.500
S.S.F 0.960 \(\dagger\) 0.695 \(\dagger\) 0.857 0.864 0.992 \(\dagger\) 0.953 0.960 \(\dagger\) 0.690 \(\dagger\) 0.611 \(\dagger\) 0.594 0.421 \(\dagger\) 0.424 0.571 \(\dagger\) 0.952 \(\dagger\) 0.571 0.667 \(\dagger\)
S.F.F 0.960 \(\dagger\) 0.695 \(\dagger\) 0.853 0.862 0.992 \(\dagger\) 0.953 0.960 \(\dagger\) 0.690 \(\dagger\) 0.611 \(\dagger\) 0.585 0.421 \(\dagger\) 0.424 0.571 \(\dagger\) 0.930 0.536 0.667 \(\dagger\)
RPART None 0.859 0.615 0.840 0.836 0.964 0.907 0.928 0.592 0.528 0.505 0.343 0.437 0.400 0.886 0.667 0.571
U._._ 0.858 0.677 \(\dagger\) 0.833 0.853 \(\dagger\) 0.961 0.911 0.904 0.667 0.589 \(\dagger\) 0.579 0.463 \(\dagger\) 0.521 \(\dagger\) 0.500 \(\dagger\) 0.835 0.400 \(\dagger\) 0.455
U.F._ 0.860 \(\dagger\) 0.634 0.840 \(\dagger\) 0.832 0.961 0.909 0.915 0.662 0.574 0.541 0.444 0.511 0.500 \(\dagger\) 0.860 \(\dagger\) 0.382 0.488 \(\dagger\)
U.S._ 0.860 \(\dagger\) 0.661 0.826 0.838 0.971 \(\dagger\) 0.917 \(\dagger\) 0.920 \(\dagger\) 0.682 \(\dagger\) 0.584 0.595 \(\dagger\) 0.462 0.511 0.485 0.841 0.400 0.466
S._._ 0.858 \(\dagger\) 0.646 0.845 \(\dagger\) 0.843 0.960 \(\dagger\) 0.909 0.935 0.661 0.585 0.564 0.421 0.485 0.517 \(\dagger\) 0.864 \(\dagger\) 0.667 \(\dagger\) 0.594
S.S.S 0.856 0.656 \(\dagger\) 0.845 \(\dagger\) 0.839 0.957 0.911 \(\dagger\) 0.930 0.688 \(\dagger\) 0.596 \(\dagger\) 0.579 \(\dagger\) 0.417 0.507 \(\dagger\) 0.431 0.847 0.500 0.586
S.F.S 0.856 0.656 \(\dagger\) 0.839 0.835 0.957 0.911 \(\dagger\) 0.930 0.688 \(\dagger\) 0.596 \(\dagger\) 0.571 0.417 0.507 \(\dagger\) 0.431 0.850 0.583 0.586
S.S.F 0.856 0.656 \(\dagger\) 0.845 \(\dagger\) 0.845 \(\dagger\) 0.957 0.907 0.939 \(\dagger\) 0.656 0.596 \(\dagger\) 0.567 0.425 \(\dagger\) 0.469 0.429 0.857 0.500 0.608 \(\dagger\)
S.F.F 0.856 0.656 \(\dagger\) 0.839 0.836 0.957 0.907 0.939 \(\dagger\) 0.656 0.596 \(\dagger\) 0.573 0.425 \(\dagger\) 0.469 0.429 0.840 0.500 0.608 \(\dagger\)

Regression Results

Best median \(F_1^\phi\) results achieved in all the learners variants tested. Results are displayed by data set an sampling strategy. The highlighted cells signals the best results by data set while the symbol \(\dagger\) signals the best results inside each sampling strategy.

Learn Strat DS1 DS2 DS3 DS4 DS5 DS6 DS7 DS8 DS9 DS10 DS11 DS12 DS13 DS14 DS15 DS16 DS17 DS18
SVM None 0.720 0.514 0.711 0.825 0.512 0.493 0.000 0.333 0.905 0.228 0.923 0.956 0.198 0.980 0.952 0.918 0.922 0.184
U._._ 0.727 0.591 \(\dagger\) 0.740 \(\dagger\) 0.818 \(\dagger\) 0.559 0.598 0.750 0.420 \(\dagger\) 0.890 0.602 \(\dagger\) 0.899 0.943 0.190 0.971 0.953 0.896 0.918 \(\dagger\) 0.247
U.F._ 0.721 0.589 0.738 0.818 \(\dagger\) 0.570 \(\dagger\) 0.604 0.755 \(\dagger\) 0.404 0.896 0.571 0.901 \(\dagger\) 0.947 \(\dagger\) 0.200 0.977 \(\dagger\) 0.953 0.917 \(\dagger\) 0.918 \(\dagger\) 0.264 \(\dagger\)
U.S._ 0.737 \(\dagger\) 0.557 0.740 \(\dagger\) 0.809 0.537 0.607 \(\dagger\) 0.750 0.380 0.897 \(\dagger\) 0.586 0.901 \(\dagger\) 0.941 0.204 \(\dagger\) 0.975 0.954 \(\dagger\) 0.894 0.917 0.234
S._._ 0.750 0.556 0.739 \(\dagger\) 0.817 0.553 0.596 0.732 0.425 \(\dagger\) 0.907 0.598 0.905 0.949 0.206 0.975 \(\dagger\) 0.954 0.930 0.906 0.267
S.S.S 0.733 0.528 0.738 0.811 0.517 0.631 \(\dagger\) 0.749 0.375 0.913 \(\dagger\) 0.616 0.907 0.950 0.202 0.975 \(\dagger\) 0.955 \(\dagger\) 0.922 0.912 \(\dagger\) 0.265
S.F.S 0.729 0.526 0.736 0.811 0.560 0.598 0.754 \(\dagger\) 0.377 0.911 0.585 0.910 \(\dagger\) 0.953 \(\dagger\) 0.203 0.974 0.954 0.933 \(\dagger\) 0.912 \(\dagger\) 0.283 \(\dagger\)
S.S.F 0.755 \(\dagger\) 0.564 \(\dagger\) 0.738 0.824 0.557 0.624 0.745 0.414 0.910 0.625 0.905 0.939 0.223 0.974 0.953 0.929 0.904 0.277
S.F.F 0.723 0.563 0.739 \(\dagger\) 0.829 \(\dagger\) 0.573 \(\dagger\) 0.626 0.724 0.393 0.911 0.638 \(\dagger\) 0.907 0.942 0.234 \(\dagger\) 0.975 \(\dagger\) 0.954 0.932 0.905 0.258
NNET None 0.813 0.446 0.723 0.000 0.462 0.523 0.696 0.383 0.787 0.000 0.000 0.720 0.099 0.000 0.957 0.000 0.000 0.000
U._._ 0.733 0.561 0.738 \(\dagger\) 0.573 0.550 0.607 \(\dagger\) 0.684 0.416 0.743 0.577 0.621 0.779 0.333 0.753 \(\dagger\) 0.953 \(\dagger\) 0.775 0.702 0.168
U.F._ 0.781 \(\dagger\) 0.564 \(\dagger\) 0.733 0.569 0.546 0.591 0.708 \(\dagger\) 0.419 0.784 \(\dagger\) 0.573 0.625 0.794 0.234 0.742 0.953 \(\dagger\) 0.778 0.713 0.152
U.S._ 0.734 0.559 0.736 0.582 \(\dagger\) 0.545 0.599 0.706 0.424 \(\dagger\) 0.736 0.599 \(\dagger\) 0.628 \(\dagger\) 0.810 \(\dagger\) 0.345 \(\dagger\) 0.730 0.953 \(\dagger\) 0.795 \(\dagger\) 0.740 \(\dagger\) 0.217 \(\dagger\)
S._._ 0.763 0.542 0.739 \(\dagger\) 0.624 0.536 0.598 0.705 0.431 0.763 0.619 0.614 0.000 0.319 0.654 0.953 0.386 0.744 0.092
S.S.S 0.803 \(\dagger\) 0.552 0.735 0.592 0.546 0.623 \(\dagger\) 0.711 0.450 \(\dagger\) 0.771 0.626 0.594 0.000 0.415 \(\dagger\) 0.685 0.952 0.789 \(\dagger\) 0.683 0.181 \(\dagger\)
S.F.S 0.780 0.551 0.736 0.604 0.550 0.607 0.703 0.404 0.763 0.636 \(\dagger\) 0.616 0.000 0.297 0.685 0.954 \(\dagger\) 0.779 0.727 0.155
S.S.F 0.788 0.554 0.737 0.619 0.537 0.600 0.732 0.415 0.783 \(\dagger\) 0.609 0.618 \(\dagger\) 0.000 0.324 0.724 0.951 0.781 0.750 0.112
S.F.F 0.785 0.555 \(\dagger\) 0.737 0.635 \(\dagger\) 0.552 \(\dagger\) 0.606 0.741 \(\dagger\) 0.401 0.757 0.615 0.584 0.000 0.328 0.744 \(\dagger\) 0.952 0.000 0.777 \(\dagger\) 0.150
RF None 0.803 0.535 0.721 0.808 0.508 0.565 0.720 0.327 0.904 0.000 0.921 0.967 0.529 0.973 0.947 0.956 0.937 0.196
U._._ 0.756 \(\dagger\) 0.553 \(\dagger\) 0.731 \(\dagger\) 0.786 0.549 0.580 0.741 0.392 0.907 \(\dagger\) 0.652 \(\dagger\) 0.898 0.954 \(\dagger\) 0.487 0.950 0.943 \(\dagger\) 0.908 0.907 0.193
U.F._ 0.732 0.549 0.725 0.803 \(\dagger\) 0.561 \(\dagger\) 0.582 \(\dagger\) 0.740 0.384 0.903 0.628 0.902 \(\dagger\) 0.953 0.506 \(\dagger\) 0.957 \(\dagger\) 0.942 0.906 0.921 \(\dagger\) 0.249 \(\dagger\)
U.S._ 0.727 0.553 \(\dagger\) 0.728 0.798 0.553 0.578 0.783 \(\dagger\) 0.410 \(\dagger\) 0.896 0.650 0.890 0.953 0.485 0.948 0.941 0.911 \(\dagger\) 0.910 0.190
S._._ 0.795 0.531 0.729 \(\dagger\) 0.815 \(\dagger\) 0.594 \(\dagger\) 0.605 \(\dagger\) 0.754 0.452 \(\dagger\) 0.907 0.657 0.921 0.968 0.511 0.971 0.946 0.950 0.943 0.232
S.S.S 0.802 0.520 0.726 0.812 0.572 0.570 0.763 \(\dagger\) 0.448 0.916 \(\dagger\) 0.655 0.918 0.965 0.525 0.970 0.949 \(\dagger\) 0.943 0.943 0.168
S.F.S 0.759 0.555 \(\dagger\) 0.729 \(\dagger\) 0.808 0.566 0.598 0.723 0.391 0.915 0.635 0.924 \(\dagger\) 0.972 \(\dagger\) 0.527 \(\dagger\) 0.973 0.949 \(\dagger\) 0.938 0.946 \(\dagger\) 0.193
S.S.F 0.805 \(\dagger\) 0.535 0.725 0.811 0.590 0.605 \(\dagger\) 0.758 0.447 0.904 0.680 \(\dagger\) 0.912 0.968 0.497 0.970 0.946 0.945 0.934 0.228
S.F.F 0.772 0.545 0.726 0.798 0.562 0.601 0.754 0.431 0.904 0.650 0.915 0.969 0.501 0.974 \(\dagger\) 0.946 0.953 \(\dagger\) 0.940 0.235 \(\dagger\)
MARS None 0.743 0.517 0.718 0.827 0.565 0.523 0.706 0.313 0.914 0.000 0.892 0.936 0.188 0.979 0.956 0.895 0.918 0.221
U._._ 0.666 0.549 \(\dagger\) 0.738 \(\dagger\) 0.825 \(\dagger\) 0.564 \(\dagger\) 0.576 0.749 \(\dagger\) 0.405 0.897 \(\dagger\) 0.583 0.890 0.915 0.232 0.998 0.953 0.897 0.905 \(\dagger\) 0.262 \(\dagger\)
U.F._ 0.655 0.539 0.738 \(\dagger\) 0.792 0.540 0.522 0.721 0.391 0.893 0.606 \(\dagger\) 0.892 \(\dagger\) 0.916 \(\dagger\) 0.236 \(\dagger\) 0.998 0.955 \(\dagger\) 0.900 \(\dagger\) 0.902 0.223
U.S._ 0.669 \(\dagger\) 0.539 0.733 0.804 0.532 0.584 \(\dagger\) 0.733 0.409 \(\dagger\) 0.892 0.596 0.884 0.913 0.236 \(\dagger\) 0.999 \(\dagger\) 0.954 0.885 0.901 0.246
S._._ 0.745 \(\dagger\) 0.550 \(\dagger\) 0.737 \(\dagger\) 0.806 0.563 0.608 0.743 0.412 \(\dagger\) 0.901 0.589 0.891 0.910 0.239 0.982 \(\dagger\) 0.953 0.917 0.919 \(\dagger\) 0.266 \(\dagger\)
S.S.S 0.729 0.537 0.735 0.819 \(\dagger\) 0.550 0.602 0.737 0.406 0.898 0.641 \(\dagger\) 0.894 0.916 0.254 0.981 0.953 0.912 0.916 0.249
S.F.S 0.703 0.543 0.734 0.813 0.551 0.618 \(\dagger\) 0.724 0.393 0.893 0.621 0.898 \(\dagger\) 0.923 \(\dagger\) 0.261 0.980 0.951 0.921 \(\dagger\) 0.916 0.232
S.S.F 0.729 0.533 0.734 0.810 0.583 \(\dagger\) 0.612 0.752 \(\dagger\) 0.391 0.906 \(\dagger\) 0.606 0.866 0.904 0.169 0.976 0.953 0.913 0.914 0.232
S.F.F 0.682 0.542 0.735 0.819 \(\dagger\) 0.558 0.612 0.737 0.387 0.894 0.639 0.886 0.905 0.172 0.977 0.955 \(\dagger\) 0.912 0.916 0.242