【第十五周】Scikit-Learn作业

Assigment:

   In the second ML assignment you have to compare the performance of three different classification algorithms, namely Naive Bayes, SVM, and Random Forest. For this assignment you need to generate a random binary classification problem, and then train and test (using 10-fold cross validation) the three algorithms. For some algorithms inner cross validation (5-fold) for choosing the parameters is needed. Then, show the classification performace (per-fold and averaged) in the report, and briefly discussing the results.

  Steps:

1. Create a classification dataset (n samples >=1000, n features >= 10)

2. Split the dataset using 10-fold cross validation

3. Train the algorithms

  I GaussianNB

  I SVC (possible C values [1e-02, 1e-01, 1e00, 1e01, 1e02], RBF kernel)

  I RandomForestClassifier (possible n estimators values [10, 100, 1000])

4. Evaluate the cross-validated performance

  I Accuracy

  I F1-score

  I AUC ROC

  value error occurs...

5. Write a short report summarizing the methodology and the results

Scikit-learn allows to:

Load and generate datasets

Split them to perform cross-validation

Easily apply learning algorithms

Evaluate the platforms of such algorithms