0 votes
1 view
in Machine Learning by (13.4k points)

I am trying to use AdaBoostClassifier with a base learner other than a decision tree. I have tried SVM and KNeighborsClassifier but I get errors. Can someone point out the classifiers that can be used with AdaBoostClassifier?

1 Answer

0 votes
by (32.8k points)

There is a way to find out all the base learners supported by AdaBoostClassifier. A compatible base learner's fit method needs to support sample_weight, which can be obtained by running following code:

import inspect

from sklearn.utils.testing import all_estimators

for name, clf in all_estimators(type_filter='classifier'):

    if 'sample_weight' in inspect.getargspec(clf().fit)[0]:

       print name


AdaBoostClassifier, BernoulliNB, DecisionTreeClassifier, ExtraTreeClassifier, ExtraTreesClassifier, MultinomialNB, NuSVC, Perceptron, RandomForestClassifier, RidgeClassifierCV, SGDClassifier, SVC.

If the classifier doesn't uses predict_proba, you will have to simply set AdaBoostClassifier parameter algorithm = 'SAMME'.

Hope this answer helps you!

Welcome to Intellipaat Community. Get your technical queries answered by top developers !