Reputation: 47
I have built three classifiers based on 107 instances,11 features and two classes each stage . Weka used as machine learning tool.
First classifier predicts class 0 and class 1-2-3. ( all 107 instances are used for training and testing in cross-validation method)
Second classier predicts class 1 and class 2-3.( The instances with class 0 removed for training and testing)
Third classifier predicts Class 2 and Class 3. ( The instances with class 1 removed for training and testing)
Randoforest is applied to each classifier. Does anybody know how can I combine these three classifiers?
Upvotes: -1
Views: 1130
Reputation: 66775
It seems a bit werid pack of classifiers, but the most obvious solution would be to build a "meta classifier" on top, which will decide what is the real class. Consider training a classifier on data of form:
Inputs:
ourput_of_classifier1(x)
(in unary format)ourput_of_classifier2(x)
(in unary format)ourput_of_classifier3(x)
(in unary format)Output:
x
so you transform your original data into representation consisting predicted labels, and train new classifier on such data.
The simplest possibility would be to train a Naive Bayes to build conditional probabilities in form of P(final_class=Y | classifier1(x)=y1, classifier2(x)=y2, classifier3(x)=y3)
Upvotes: 1