Breast Cancer Classification Program

I took another example for Classification problem which is Breast Cancer Diagnostic Data Set. As I have already done 3 examples of Classification program, my objective for this was to go deeper into each line of code. I got to know how to slice an array using NumPy, and also understanding Correlation Matrix. So I'll not again going to explain every step as it follows same steps as done for previous Classification Programs.

I did observe different algorithms from a different perspective and I'm sharing these observations in this post. In previous posts, I was looking at accuracy score of different algorithms and then choose the "best" one (having highest accuracy score) to do the validation and check the final statistics.

In this example, I tried to check validation output for each algorithm and compare the difference. I've provided the details below which is self-explanatory. However a couple of things I would like to highlight are Confusion Matrix and Classification Report. Basically from these one can make out why "Accuracy Score" is less or high.

The complete source code is available in Github.

KNeighborsClassifier


------KNN------
Accuracy Score  0.9385964912280702
Confusion Matrix
 [[70  2]
 [ 5 37]]
Classification Report
               precision    recall  f1-score   support

           B       0.93      0.97      0.95        72
           M       0.95      0.88      0.91        42

    accuracy                           0.94       114
   macro avg       0.94      0.93      0.93       114
weighted avg       0.94      0.94      0.94       114

LogisticRegression

------LR------
Accuracy Score  0.9473684210526315
Confusion Matrix
 [[70  2]
 [ 4 38]]
Classification Report
               precision    recall  f1-score   support

           B       0.95      0.97      0.96        72
           M       0.95      0.90      0.93        42

    accuracy                           0.95       114
   macro avg       0.95      0.94      0.94       114
weighted avg       0.95      0.95      0.95       114

LinearDiscriminantAnalysis

------LDA------
Accuracy Score  0.9473684210526315
Confusion Matrix
 [[72  0]
 [ 6 36]]
Classification Report
               precision    recall  f1-score   support

           B       0.92      1.00      0.96        72
           M       1.00      0.86      0.92        42

    accuracy                           0.95       114
   macro avg       0.96      0.93      0.94       114
weighted avg       0.95      0.95      0.95       114

DecisionTreeClassifier

------DTC------
Accuracy Score  0.956140350877193
Confusion Matrix
 [[70  2]
 [ 3 39]]
Classification Report
               precision    recall  f1-score   support

           B       0.96      0.97      0.97        72
           M       0.95      0.93      0.94        42

    accuracy                           0.96       114
   macro avg       0.96      0.95      0.95       114
weighted avg       0.96      0.96      0.96       114

GaussianNB

------NB------
Accuracy Score  0.9473684210526315
Confusion Matrix
 [[70  2]
 [ 4 38]]
Classification Report
               precision    recall  f1-score   support

           B       0.95      0.97      0.96        72
           M       0.95      0.90      0.93        42

    accuracy                           0.95       114
   macro avg       0.95      0.94      0.94       114
weighted avg       0.95      0.95      0.95       114

SVC

------SVC------
Accuracy Score  0.9035087719298246
Confusion Matrix
 [[72  0]
 [11 31]]
Classification Report
               precision    recall  f1-score   support

           B       0.87      1.00      0.93        72
           M       1.00      0.74      0.85        42

    accuracy                           0.90       114
   macro avg       0.93      0.87      0.89       114
weighted avg       0.92      0.90      0.90       114

Comments

Post a Comment

Popular posts from this blog

Ordinal Encoder, OneHotEncoder and LabelBinarizer in Python

Usually in the data set we work on, we will have both numerical data as well as categorical data (non-numeric). There are algorithms which do not work on categorical data. These algorithms are designed that way to enhance efficiency. So in such cases how do we train the model with categorical data? This is where we need to apply a technique called Encoding. Encoding transforms categorical data into numeric. There are various Encoders available in sci-kit learn library. In this post, I'll share my learning on three Encoders. Ordinal Encoder This performs ordinal (integer) encoding of categorical data. Let's look at an example. I have an array of categorical data. This is a 2 dimensional array. multiArray = np.array([[ 'Karnataka' ,  'KA' ], [ 'Maharastra' ,  'MH' ], [ 'Gujarat' ,  'GJ' ]]) Then I use OrdinalEncoder to transform this data. ordinalEncoder = OrdinalEncoder() ordinalEncoderArray = ordinalEncoder.fit_transform(mult
Read more

Natural Language Toolkit (NLTK)

To work on Natural Language Processing (NLP), we need a library. One popular Python library is Natural Language Toolkit or NLTK. As mentioned in the NLTK website , NLTK is a leading platform for building Python programs to work with human language data. It provides easy-to-use interfaces to over 50 corpora and lexical resources such as WordNet, along with a suite of text processing libraries for classification, tokenization, stemming, tagging, parsing, and semantic reasoning. Some of the terms like stemming, semantic reasoning are new to me. I'll explore them in future. For now I wanted to test this library so I took the example provided in that website. First I imported nltk library import  nltk Then, formed a sample sentence sentence =  "I'm learning Natural Language Processing. Natural Language Processing is also called as NLP" Then, tokenize the text into words tokens = nltk.word_tokenize(sentence) When I ran this code, I got this error. LookupError: ********
Read more

Failed to create Anaconda menus

Image
After my first attempt at executing a  ML program in Weka  platform, I wanted to switch to Python. I did take up an online course on Python a few months back. So Python was my go-to language/library in my ML journey. As explained in  this article , I had to install Anaconda to set up the environment in my laptop. I downloaded the  Anaconda 3 2019.10 Windows 64 bit version , and when I installed (on Windows 7), it threw an error “ Failed to create menus ” as shown below. After clicking Retry a couple of times, ignored this error and went ahead with the installation. After the installation, I  could not find Anaconda program  in  Windows Start Menu . So the above error might have caused a problem in the installation itself. I tried multiple times by uninstalling and installing again but without any success. Then I came across this post in  Stack Overflow , where it was suggested to use an older version of Anaconda. So I downloaded   Anaconda 2 2019.3 Windows 64 bit version , and the inst
Read more