decisiontree1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "56c44ef0-0194-4e9a-84c9-b94a6a669f46",
   "metadata": {},
   "source": [
    "### Describe the decision tree classifier algorithm and how it works to make predictions.\n",
    "\n",
    "A decision tree classifier is a popular machine learning algorithm used for both classification and regression tasks. It's a simple yet powerful model that mimics the way humans make decisions by recursively splitting the data into subsets based on the most significant features. Let's break down how the decision tree classifier algorithm works to make predictions:\n",
    "\n",
    "1. **Data Splitting:** The algorithm starts with the entire dataset, which contains a set of features (attributes) and corresponding labels (classifications). The goal is to divide this dataset into smaller and more homogeneous subsets at each step.\n",
    "\n",
    "2. **Feature Selection:** At each step or node of the tree, the algorithm selects the best feature to split the data based on some criteria. Common criteria include Gini impurity, entropy, or information gain. The chosen feature should result in the most significant reduction in impurity or uncertainty.\n",
    "\n",
    "3. **Splitting:** Once the feature is selected, the data is split into subsets based on the possible values of that feature. For categorical features, each category represents a branch, while for numerical features, there are multiple ways to split the data, and the best threshold is determined.\n",
    "\n",
    "4. **Recursion:** The splitting process is performed recursively for each subset, creating child nodes for each branch. This process continues until one of the stopping conditions is met, such as a maximum tree depth, a minimum number of samples in a leaf node, or no further reduction in impurity.\n",
    "\n",
    "5. **Leaf Nodes:** When the algorithm stops splitting and reaches a leaf node, it assigns a class label to that leaf node based on the majority class of the samples within it. In the case of regression tasks, the leaf node may contain the mean or median value of the target variable for the samples in that node.\n",
    "\n",
    "6. **Predictions:** To make predictions for a new, unseen data point, it starts at the root node and traverses the tree by following the decision rules based on the feature values of the data point. It moves down the tree, from node to node, until it reaches a leaf node. The class label assigned to that leaf node is the prediction for the input data point.\n",
    "\n",
    "Advantages of Decision Tree Classifier:\n",
    "- Easy to understand and interpret, making it a valuable tool for explaining machine learning decisions to non-experts.\n",
    "- Requires minimal data preprocessing, such as scaling or encoding categorical variables.\n",
    "- Can handle both numerical and categorical features.\n",
    "- Can capture non-linear relationships in the data.\n",
    "\n",
    "Disadvantages of Decision Tree Classifier:\n",
    "- Prone to overfitting, especially when the tree is deep and not pruned.\n",
    "- Sensitive to small variations in the training data, which can lead to different tree structures.\n",
    "- May not generalize well to unseen data, especially if the training data is imbalanced.\n",
    "- Single decision trees are often less accurate compared to ensemble methods like Random Forests or Gradient Boosting.\n",
    "\n",
    "To improve decision tree performance, techniques like pruning, setting maximum depth, and using ensemble methods can be employed. Pruning involves removing branches that do not contribute significantly to the overall model performance, which helps prevent overfitting."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c06e31b6-4090-49c2-a492-5f8c70c3cc40",
   "metadata": {},
   "source": [
    "### Provide a step-by-step explanation of the mathematical intuition behind decision tree classification.\n",
    "\n",
    "The mathematical intuition behind decision tree classification involves two key components: impurity measures and the selection of the best feature to split the data. I'll provide a step-by-step explanation of these concepts:\n",
    "\n",
    "**1. Impurity Measures:**\n",
    "\n",
    "Decision trees aim to split the data into subsets in a way that maximizes the purity of the resulting subsets. Purity is a measure of how homogenous or impure a set of data points is with respect to their class labels. Common impurity measures used in decision trees include:\n",
    "\n",
    "   a. **Gini Impurity (Gini Index):** This measure quantifies the probability of misclassifying a randomly chosen data point's class label. For a node with classes C1, C2, ..., Ck and probabilities p1, p2, ..., pk, the Gini Impurity (GI) is calculated as:\n",
    "\n",
    "   GI = 1 - (p1^2 + p2^2 + ... + pk^2)\n",
    "\n",
    "   The lower the Gini Impurity, the purer the node.\n",
    "\n",
    "   b. **Entropy:** Entropy measures the degree of disorder or uncertainty in a node. For a node with classes C1, C2, ..., Ck and probabilities p1, p2, ..., pk, entropy (H) is calculated as:\n",
    "\n",
    "   H = - (p1 * log2(p1) + p2 * log2(p2) + ... + pk * log2(pk))\n",
    "\n",
    "   A lower entropy indicates a purer node.\n",
    "\n",
    "   c. **Misclassification Error:** This measure calculates the fraction of data points in a node that do not belong to the majority class. For a node with classes C1, C2, ..., Ck and probabilities p1, p2, ..., pk, the Misclassification Error (ME) is calculated as:\n",
    "\n",
    "   ME = 1 - max(p1, p2, ..., pk)\n",
    "\n",
    "   The lower the Misclassification Error, the purer the node.\n",
    "\n",
    "**2. Selection of Best Feature:**\n",
    "\n",
    "Once we have a measure of impurity for a node, the decision tree algorithm selects the best feature to split the data based on the impurity reduction it can achieve. Here's how it works:\n",
    "\n",
    "   a. Calculate the impurity of the current node using one of the impurity measures (Gini Impurity, Entropy, or Misclassification Error).\n",
    "\n",
    "   b. For each feature in the dataset and for each possible split point (for numerical features), calculate the impurity of the resulting child nodes after the split.\n",
    "\n",
    "   c. Calculate the impurity reduction (often called \"Information Gain\" or \"Gini Gain\") achieved by splitting on each feature. It is typically calculated as:\n",
    "\n",
    "   Impurity Reduction = Impurity Before Split - Weighted Average Impurity After Split\n",
    "\n",
    "   where the weighted average is taken over the child nodes.\n",
    "\n",
    "   d. Choose the feature that maximizes the impurity reduction (i.e., minimizes impurity) as the best feature to split on.\n",
    "\n",
    "   e. Repeat the above steps recursively for each child node, creating a tree structure until a stopping criterion is met."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cd2f8ee2-1c75-40ec-a0b4-dea007c92929",
   "metadata": {},
   "source": [
    "###  Explain how a decision tree classifier can be used to solve a binary classification problem.\n",
    "\n",
    "A decision tree classifier can be used to solve a binary classification problem by dividing the dataset into two distinct classes, typically labeled as \"positive\" and \"negative\" or \"1\" and \"0.\" Here's a step-by-step explanation of how a decision tree classifier accomplishes this task:\n",
    "\n",
    "**1. Data Preparation:**\n",
    "   - Gather and preprocess your dataset, ensuring it contains the necessary features (attributes) and corresponding binary class labels.\n",
    "   - The binary class labels represent the two classes we\n",
    "   want to classify, such as \"spam\" or \"not spam,\" \"fraudulent\" or \"legitimate,\" \"diseased\" or \"healthy,\" etc.\n",
    "\n",
    "**2. Building the Decision Tree:**\n",
    "   - The decision tree classifier starts with the entire dataset, which includes instances from both classes.\n",
    "   - At each node of the tree, it selects the feature that provides the best split to maximize purity or minimize impurity. This means finding the feature and split point (for numerical features) that best separates the positive and negative instances.\n",
    "   - The algorithm recursively creates child nodes based on the selected feature and split point.\n",
    "\n",
    "**3. Splitting and Node Creation:**\n",
    "   - The algorithm splits the data into two subsets based on the chosen feature and its values:\n",
    "     - Left Child Node: Contains instances where the chosen feature satisfies the specified condition (e.g., feature >= threshold).\n",
    "     - Right Child Node: Contains instances where the chosen feature does not satisfy the specified condition.\n",
    "\n",
    "**4. Impurity Measures:**\n",
    "   - The algorithm uses impurity measures (e.g., Gini Impurity, Entropy) to assess the homogeneity of the data in each node.\n",
    "   - The goal is to create nodes with the purest possible data subsets, meaning that one node predominantly contains instances from one class (e.g., positive), and the other node predominantly contains instances from the other class (e.g., negative).\n",
    "\n",
    "**5. Recursive Process:**\n",
    "   - Steps 2 to 4 are repeated recursively for each child node.\n",
    "   - The algorithm continues building the tree until it reaches a stopping condition, which could be a maximum tree depth, a minimum number of samples in a leaf node, or no further reduction in impurity.\n",
    "\n",
    "**6. Classification:**\n",
    "   - To classify a new, unseen data point, you start at the root node and traverse the tree based on the feature values of the data point.\n",
    "   - Follow the decision rules (feature conditions) down the tree until we reach a leaf node.\n",
    "   - The class label associated with the leaf node is the prediction for the input data point.\n",
    "   - Typically, one class label represents the positive class (e.g., \"1\"), and the other represents the negative class (e.g., \"0\").\n",
    "\n",
    "**7. Prediction:**\n",
    "   - Based on the leaf node reached during traversal, the decision tree classifier assigns the binary class label to the input data point."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ad0fce0d-fc0d-4ba7-a58c-2ee4a98ebbb3",
   "metadata": {},
   "source": [
    "###  Discuss the geometric intuition behind decision tree classification and how it can be used to make predictions.\n",
    "\n",
    "The geometric intuition behind decision tree classification is closely related to the idea of partitioning the feature space into regions, where each region corresponds to a specific class label. Decision trees create a hierarchical structure of decision rules that effectively divide the feature space into smaller and smaller regions until they are as pure as possible in terms of class labels. Here's how this geometric intuition works and how it can be used to make predictions:\n",
    "\n",
    "**1. Geometric Partitioning:**\n",
    "   - Think of the feature space as a multi-dimensional space, where each axis represents a feature. For simplicity, let's consider a two-dimensional space with two features (X1 and X2).\n",
    "   - At the top of the decision tree (the root node), we have the entire feature space. The algorithm selects a feature and a threshold value that best splits the data into two regions.\n",
    "   - This split can be visualized as a line in a 2D space (or a hyperplane in higher dimensions). One side of the line represents one class (e.g., \"positive\"), and the other side represents the other class (e.g., \"negative\").\n",
    "   - Each decision node in the tree corresponds to such a splitting decision, effectively dividing the feature space into two regions based on the chosen feature and threshold.\n",
    "\n",
    "**2. Recursive Splitting:**\n",
    "   - The decision tree algorithm continues this process recursively. It selects the best feature and threshold at each node to further divide each region into smaller, more homogenous subsets.\n",
    "   - This recursive splitting results in a tree-like structure, where each internal node represents a decision boundary (line or hyperplane), and each leaf node represents a region in the feature space.\n",
    "\n",
    "**3. Making Predictions:**\n",
    "   - To make predictions for a new data point, we start at the root node (the top of the tree) and traverse down the tree.\n",
    "   - At each decision node, we evaluate the feature condition. If the data point satisfies the condition (e.g., data point falls to the left of the line in a 2D space), follow the left branch; otherwise follow the right branch.\n",
    "   - Continue this process until we reach a leaf node, which corresponds to a specific region in the feature space.\n",
    "   - The class label associated with that leaf node is the prediction for the input data point. In binary classification, one leaf node represents the positive class, and the other represents the negative class.\n",
    "\n",
    "**4. Geometric Interpretation of Predictions:**\n",
    "   - When we visualize the decision tree's geometric structure in the feature space, we can see that each leaf node corresponds to a distinct region where one class dominates.\n",
    "   - Predictions are made by determining which region the input data point falls into based on the feature conditions encountered during traversal."
   ]
  },
  {
   "attachments": {
    "b78557ac-731b-46db-aef9-edbf75432e4b.png": {
     "image/png": "iVBORw0KGgoAAAANSUhEUgAAAvcAAAB+CAYAAACgXz6CAAAAAXNSR0IArs4c6QAAAARnQU1BAACx\njwv8YQUAAAAJcEhZcwAAEnQAABJ0Ad5mH3gAADvBSURBVHhe7d0NdFTVvTf+77xlJi+Gl0iCvAQD\ngWBjikXUSwgVKSgXKDwNf6Ar6Z/7GCvLeRQvL7psaMuKaE19rkJWKU9cgPG53iar1gVdcMGrEhE1\nQisUm3JRCMRIQDRBBCJJZjLJnGfvc/YkM5MJ5BWS8ftZa8PMPmfOnDPZe5/fPrPPHhMATSQiIiIi\nIhrgzOp/IiIiIiIa4BjcExERERGFCQb3RERERERhgsE9EREREVGYYHBPRERERBQmGNwTEREREYUJ\nBvdERERERGGCwT0RERERUZhgcE9EREREFCYY3BMRERERhQkG90REREREYYLBPRERERFRmGBwT0RE\nREQUJhjcExERERGFCQb3RERERERhgsE9EREREVGYYHBPRERERBQmGNwTEREREYUJBvdERERERGGC\nwT0RERERUZhgcE9EREREFCYY3BMRERERhQmTSJrxkGgAM0/C+9+fi9G4gHePbUGOR+UPNLZ0lKfe\ni1j1VFe7A0nnTqgnXedc7EDeDKt65sftwcn9HmzY7cUOr8rrY759OVlyBRkfqswe6otthpuHhz2O\ntSOj9bI0SZSlOpU/0KwdkYuH49UTXU/ruwVlmyMx3t2Ekl82YVWjyhaMcgWUPe/ComqVOeCo47vg\nQt66ZhSqXCIKb7xyT2EhOSZFBPZSHG6PEUFMj8WhaGwuqsamY6HKCTt2G8Y/EIWCRy2YpbL6hWkR\nqNkcg7Jp6jn10EjMGKLqxOBxeFhe0ump6ExU3ZGL3b1R1foDewTmze+ND6avmbB9fQxq1lvhVDlE\nRMEY3FNYWBIzDmg4gVOXgGGxE5Gu8gcczwFM+ns+kvS0Be/22iXWZpQ9fwUJj7al7A2NOHlJg32i\nDc5EtVofK3zdpb93b15h74tthhXbGNweBZw5fwLuiBSkO1T+APTcOV/dEOlk97/NCmXQVBs2Rqon\nYaMFGbK+86o90XcKg3sa+EwiYLkZcF/+G35fdwEYMg4LWLKvqbSyBVl/bhKPrEgwvvagMLTwptsR\niy9wpOYYTnkdSI0ZqZZQq2oPqm0RmDV7IFy9JyK6Oo65p4Evci6Op0zCqZP5mN8yE8cn3oPaz/4N\nP6xrViu0mRNzP9beMgmjo+UY9GbRIajEu1+9haca6/VxyAuHLkdBYpy+bmgnsPXvO/CcfKjGx5+R\n71uvLzTIIQvjb243Fjg9Mh1Pj7gHyTfJS6fqvb98A06Xy1ihHTk0aDnuc/XGmPvQY4cTp9hw6EF7\nwHj1tFEWFOZEYHyCRTwTzYP4HMv+2IRV5RoCXm43ofDBCMybaIXdJpoSbwsuV3hQUtKMPNHH8tm4\nIgZZE9UTnfwWIXhf1Nhg9SyUy/vrMeF1o7nq3DZNKF4XjVmD3Sh6woPcoPsKCldHI3NUU8CyxDgz\nNv6LHRlJ4thlB7HOg6NvNCHng6BjHzCiUTDmcSy0vIeVn32EqaOexNKov+K5in3YqtZoZR6JwuEP\n4L6hCbDL6uG5hDPn38eL549hp/6xp2D3HZlIlQ87UFe9BZO+Mf74+vh4h3zfA9ip50gdlGnTYDyd\nkImlceK9beK5eu/nxHu/2dEZqoN61jWq3B1vRMHFCKyc3NxaHjqqNzkzbPjFAhsG2UUB8XpFmW9C\nyb+LMh/0LVveYjuyplkxSNYNTzNO/lcTjk6IQuawoPHvwfXI04La8iZs/PcWFKly6buvpGNiHx4V\ndVQ+TLSi4ikHBun5iji+hE0t6onBV/dr36pH2q6gD3mCDdX/asfloGWdPXYiurF4fZMGvMdiU2D3\nnsCBBvHEVYljTcDomHGBN6UKS4fmoDD5ThXYS+JkOigFc1KWoyS6b8cqTBaBSFHKvSqwl9R7T8hE\ngYyhb4BZ4ywo+UmEeNSMmjNGXmKSFdufEsGOHthLItiItSFjuQMlAWPgTdieKwKVNJsRkEhmCwZN\ndMCZZ0fxCCPrxtJQWCYKgz0Cs0SQFiDBioxxJrgPt7QF/bHi8xDHlCE+l9aWURx72k8jsX2mej7Q\nWCZi8hARdF86IQLsZuy68gUQlYypMoD2ZxaB+4RlmBOvAnvJNhijRyxAQVI6lqo/cZ8wiYA/yYll\nw1VgL/nee9j1+5Yhf28Tam12zL/K2HsZZOeLoF0PbiWz2SjzT9mQ63c2zXsoEk4RCOuBvWSzYvyC\nSGROMJ62Eq9vV49sFsRPiUTev/Tt6blalP3DIiiPn2rFSpXnky/23e5tQtnetsC+s8dORP2DrL1M\nTAM0jdSKJ+RqVaMmackqb83wVVrV9zO1tSa/9az3aB/dIdabuEQrcERrw/R8q5ZqT9V2j3Vqe4ck\naKN96+opTisaK9Yfm64tDMj3S7Z0rVxsc3d0UH50plZ1x3KtyObLs2qPDcnU3h81U3vMam3Nuy82\nUzse6vWtSe3DiJQQyzqfxElZq9kc02GqfsSsZejrmrTidTIvUjv0gEnLMBuvz5ps0yo2ifwNNi1f\n5SHRqlWI11b8i1lzDlZ5IqWNsmhlj1i0HHtbXkCaFiG279C2J4ZY5kv6OjFa2bQQy0Klq23TbNZK\nN4h9X2fVsvzyV2ZFitfYteKEtrzC1dEiL1qr+JlZy1L7n5Fk0Q69YBx7nlpvIKXk2CWiLD6uFTtU\nnqoH5UPjAtbT64zI/yghRVuq/sax5sHaY0OztPKxc7W1lrZ19aSX8auVXWhrR4SqPyHKtC1VKx61\nTNsdG6clqzoba07Qiq9V/9rVs+4kUV5lPVhh0Z+LoLy1nBv1xq9cTbBp1XLdFyK0oiRoiTLPbtLy\nf2bUr6PzTcZ6cRbtaLv1oOUusBuvX2/VnDJPphEWbc8Tdq3Mr74lRpq1PeuD1mtNJm17h8tCJbW+\nOr7glCX2qWZzlFY6xS8/UpR5Wd+Xm419l6mzx87ExNQvEvvbNLDZU4ybBa+cwimVtfXb04B5DO70\nuxifHpOCYajHgc//hJWuepzXc5txzH0M8z8rxOyLNVAXr/tAM35/cQd++MX7OB+RiqL4Bdib9L9Q\nmJgizvk3iqj/jR6cfKsBOS95USaz4sz4foL4v9yNRW9pKFNXtEuOeJC31yM+axvuusPIw1kvqhuB\nQXdHIe83MfrsNjUb7CiabULp6y0ocqv1bjSvF7sPtwAJNmT7rpqazZg/xQJUNqOwRuXBgrRxJqDK\nhf/1By9K1P6XVbUgf788drH8Ot103Hus+P9vGgc0ncJB38iv5lP47zog9qZb/W46H4P0oaKyfPMG\nHqk5gdfU373Oewm//6YEkz57A88FjujoXZ5jyD77Kh5scGDJ4JnYPXIZPhi/DOnBX71dB3m7Pai1\nh75675xkEfW1BYe3NSGnCsYwLbeG3D804agoL/FJ6nQ60QI5W2f1Tv/1gPxdTfjgnHzi51wL5r3g\nhvOICYvm21C2wo7SZxyYcrWRgb2oZG8zqr1mpP3QAtHB12XNtiLRLI5zv6jjKq/Tx05E/QJrJA1o\nC6OT9eE3o299XJ+aT6by8Skix4HU2DH6OtIws4z0z+JYR8Pb+9jkqPtRnroKa4fGoa6xHNvObMH8\niveu43zjwbPl1CPhCTcydnlRqtZAtEnvbFy+2H58eckFeTHADIdvNhERNOfkN6D0qAeX3SoaFMF/\n4hQ5LMeB7f0oEC54RwRsInifMsMMuVsZM6xIs3tx9P0Wo1MjJZr0gAxJkSiWHRW/VPjPcqzIALzp\n2DQOd8ogMWIS1qi6UXXHctwnK8yQVCxpHQ7mkCOXUHflLI6onOvKFIeC0Y/jo3E/QrrpAg5c2AXn\nyY3YWquWX081zdhd7kW8KCMZQcPlJgyX45VEOVoRWD5qNkeJ8iQWDTN1fXpK0dEsfioSpU+IjrMo\nk4f2NeEX6xtQclwt72uNLaIOi/o7zgqn7NiLOp4tx2zVeFBcoa+h65NjJ6I+w+CeBrBozInt+BKX\nfdA4PKwen/fKqH4UUvtgaH2sLXCy7/siBqtHiikF65PvhL2mBJPO7sPKb0/jtWYXTiF44PMNVq/J\nC4wYNMSkB8H+suLklUwvXH4/8lN9wYvsl9yYsLpB7zBkr6tHwVtNcJtF8Jzej5oWEbCVVYrOSZoV\nuZEiCJkqI1kPdh9Wy6VqTXQAAPfhBtzV2gEKTANtqs3YyHFI7vDPMBKTW+89ccHdJNaPGYXJKqfX\nOAar359QTIMxKKgOLhyyCAvjvsJrJ1/F/G/K8ZzrEg54m+V9pjdE7s4m1IrezvQpgR9exVfyBn0P\n9uSGLh+t000eb9HLUuLCCBQlif9lngiAcxeIbQbdi+JcFIFZiV7syRMd7ddbsOqYhh2ix++4jtUn\nd79H1Hsbpv9IvOlkEcDHis59WTNK1HKp08dORP1CPzoDE3WRZSJSZRwtf3WzdW54Iz33RT0QlYIZ\natzLgSsncF50BtJvXYICRzSG6blWpNpTsXvc4/ho6MjAIAQteqCLmGTMibC23pybLAL51gDI68Zl\n8d/oodPwmH6Vz4r7otLxdIJ+CayNNQ6jZU2zD8dCFbAkR4j3HZPe7qbfG0oE6/+Qw1Qm2bH9ARMy\nVOuQNdmGvNmiI+L24NDfjTw5o07ZCitWqs9XKr2o4ZL+oQlueaW/m9TMJ4mpFmT5ti/+z+rBUAXn\nbtnpiEDGT634/ggRvOz1oEAtM7TgqOgA2CfLYzdjlt9xJY4wI3+cOGb1fKBYdpMc9iV/wTWwbiT9\n4w19CNposTxZX/M0DnwjOr9D5+KlhBQsVX/3WPNgPDY0C+XjFuDpdv1QYyYquY37fEG4yYE5Fl+H\nQfSfWsQ2I1KwZNBgvb7FmuNE3bgfk+U93H5SHfIPKzoB9mijPpii9fddalTS60+/ei/KQmTg6bGw\nXLYJNsxbaUO+qOL+HeCVk83I8n2rdaEF24+0AJERmPdEDA7JK9wbYrDyASvsvpu3FeOKuOhMT1Ad\natGjkTetzgu+8daf3MYQCzJ8HQchI8HU/R+iqxBBuyz7U6wovVv8oeuaULxPLVM6fexE1C/IZrkH\nZ2GiGyc5dgn2jh2HY8FTUUoOY0pMt9/UfHK2nN8mBgXeOpfYRqHYRuCYnWU3O/H0qKCr8P5TYfqm\nGRyiP2nldrlgd9T7TdE3EtsnLsPk4G8N5ElaxA9nPtuIH9ap91bTa3Yc9Hf95/aNafQ69zP6crac\n0tUODAqMa4QWnCxpbL16PWtaBIqyIvRhPO14m7Djl01wqjFH7aetDBI8TV+kBYf+dyQSg/bh6lNh\nBmk39Z+aFlP++d2hp8aUUwgefdKB+HbHLlxxozDXg7zg1/RbI1E8YRnSm4OnopSs+K2cEnOoKMtH\nRVnWR1zJ2XIyQ3+zVfceflF1AK/5nynMqdh7+4J23wz4T4UZGzkXH6VMCiwjXhfczQ7YL7VNhZk+\nKAvFSW1D6FrJz9r1Nzx38m1sVe+tT6+pj5/qgOjod23a2LapMAPKS+t0koFTrG58JBJZaUHjdXRe\n1O5qRNpbbR9SZ6bCzHzAjsIFIb7B84rtNDSFLHMrRSSdOy14H64xFWaA9tPG+qbFlEJOjSl05diJ\n6MYKdRojGgDUzYK+KTCDuU7gbyI/NjYZ96ms174pQvaJ93Cq3jf/vZxr/gTePLEFWUGBvfTqhVfx\n+7NfyBEcili/4YpxRV9Xj5VnXsW7X6uehbcZ57/ahZVnTxvPW32BByt34dhl33uo960owqvn6zF6\n7CqUD71Od9BdQ3VVMxY934iTNb5AR5ywxQdQtsWFLL9hKaUfNmFefiPKjnvg9qiTupznvtKFwry2\nwL5bGluQs8l/HwSP2LbfkKCuU9NiCgHTX/qrbsa8vAaUVYq/j2+5nHP8cCNy1w2kwF5QN5obU2AG\na8a2ukrR+o/Bna33UJzA/BOFePWrGhF8qzw51/w5UZ6DA3vJewxZJ97GqdYyLXjqcVmUAZ+6xjew\n8lQ5zvvqT30l3q34Ew4EVbUDl0UHo7qyrZ753rfiAOoi7sTaSZlYqxZdN6Is7Dne/g++6iVRFl53\ni7LoW+aFu6YJpVsaMc8X3A6zoPSXDmRUuTFhZb0xbGWlCxlviSB6lLGKz463RKdxvweXfXXIV962\nNOFylB3OTRHYaCxpVfBHF4o+9HuN3IcrGtq3YJ3nmxZTdsz9p7/016ljJ6J+gVfuiYiIekuCFUfX\nORDf2IQ9m5uQVyXy5L0ei+zImWoFjjQg4eWB1FMkooGGwT0REVEvys1yYOW0tvsPWomAv2R9E1Zd\nv2myiOg7SA6gyzMeEhERUU+VHW1GjIjtJ4w2wWE1QR+y9lkTXvm9B7mX1EpERH2EV+6JiIiIiMIE\nb6glIiIiIgoTDO6JiIiIiMIEg3siIiIiojDB4J6IiIiIKEwwuCciIiIiChMM7omIiIiIwgSDeyIi\nIiKiMMHgnoiIiIgoTDC4JyIiIiIKEwzuiYiIiIjCBIN7IiIiIqIwweCeiIiIiChMMLgnIiIiIgoT\nJpE042E3RWeianyKeuLHcwlnzr+PF88fw86evUO3LBy6HAWJX2Pr33fgOZXXJg5FY5fjvtgTHSzv\nj1Kw+45MjK7egknfXFB5nTQtAjVZEeqJH08LasubsLGkBUVuldfX1L5c3l+PCa/3UsHoi21Sj6wd\nkYuH49WTDl3Au8e2ICfiOrQhs7fhk10P4bazJcj+52yUnDKyN66IQdZE43HHmlH2vAuLqtXT/o71\nvU/84NcHsG/9VGDvExhy/4sql7rOOJelqmftqXbB4ztPq+xWzXBfrsS7X72FpxrrUadyu2vN2xfx\nwmzg4LqZSH/mY5UrWVC2ORLj1bP2utMuhNjmBRfy1jWjUD3tF9iG9Inr2Yb03ZV722CMHrEABUnp\nWCq7EOHMlo7yO3JRPjROZQwQNgvip0QiP9cKZ3/6DifRiorNMahYHO4Fh66q19qQudj2u2zc5qjC\njtVtgf13Dut7j3z8TDaeffcSBs/+Fd55Mknl0vVnhX1QCuakLEdJtEPldU/Sk+/gV7MHw/WXzcgO\nCOwpJLYhPXK92xDZbel+is7Uqu7I1XZHB+Yn28ZoRYmrQi67Hmnh0OXivTO1tSGW9XqypWsiuNdE\ncB96ea+kFG13d99jWoRWszlGK5sWmJ+RYNa2PxUplkW3W3ZDU6JVExVVExU19HKmAZeM+rhcK7KF\nWN7HbUjShiNao6ZpF/etCbncPzkXO0R9cGjbE0MvHxCJ9b3v0uxt2iceUZi+3KM9FGo5UyeScS6r\nGpuuLQy53JfitKKxIdYzObSlNy3Qyr/fmW1cLT2k7flS/C09n2jbZodabtHKRLmsWW/VnO2W9U7a\nuKJvt9/txDak79J1akP6rO91ynMaOecO4Lx4PNo+wK5of0eU1Xix6P96UAsT4kfwKjn1L73ThszE\nsz/+ARyowhv53+2hFKzvvWDvz1H8FxcwfCYe+rXKo+tLc+G1b3fh1Vrxd4gdfpXhPdfw64cwczjg\n+ksxfr5X5dFVsQ3pBdepDbmOX6zIcXa5qGpNy1Fkc+DhoUtQnqrybr0Hc9TaUnpkOvaOf1Kt/yTK\nE+/H0za10M9kh996tz+OvUNHov1w3+D3F2lsOkSvPzTTYDwdv6xt325fhY9G3IPHLGq5Pm5fLUu9\nF3JYYGzi8sDtjwgaRyy3OTwHx2/3vW459g4Ziclqcavg9cbOFcdtVQv7XmKcGdtXR6JmUwxE7x01\nG+wom2FCmlreymxC3mI7KjZEGettikJFrg2Fo9RyxbnYYSz3S6LXH8SE7evV8qccGCRyBs2IDnzd\nitYPv5PbBPKXy32zozhBZfhZmSWOMXiZ3YTCR+yo9h17gQNlC8yYpRbTADP7UUxNFv9//jFe7uEJ\nvF2ZE+UxcYQFZetkOZJ5USib4r9uBDYaT1vJMf41661wquc+mZOsOJSv6pHYTrWsRyPUwj7G+t61\n+v6bdz+GS3QXfzD3WZVDA9Gzc2Wn34WP3/2NyumZtFGqLdDLkijL+XaUTjchUS3vjsBtiiTrpiif\nmSEiN7YhbEP89Vlwn2wbg6IR6RgmHp9xh7oB1IHbRzuxNnEcYn0Bu9kCu3o4OToTRSn3IjnaF9Ra\nETv0TixLWYKn/fY6NiIdL03wW88ajeTEZVgTH2087w6TCNyTnFg2YmTbvlkdGBY/E2vGZ2Jtdz41\n3zaHJ8DuOyRbHJLHLMMrN4v3UVnyc1l7y4OB68VOwrJx90PGKL0pI0FUyP9pEx0hDbXn5Dc5QqwF\nJblRyBgnKoXvOO02jF8che2LzQEN1cblDjhn2DDIrlY0mzFolB2ZT0WiVAU5N1rufg/csGH6j4L+\naGJf508Rx1jZjMKatrzt4tgz02zwHRJEp2r8A5H4P1mBx05979ptSCcsvg1yZOOlqgPYZ+T0nmE2\nlOZGYnyC7wQiCo2vAeuCWdMiUCDqUmKsr9CZYZf1KDcChe1uJuw+1vdequ/rPkGV+M+RPBWPGjnU\nHbH3osD/Ypie5EU/tbwjJgeW3rQAy+IdQN1XOKayu0Z2+uV4/Sp8ss7I6VCcA3lBQWHNZge2+xWQ\nxCQrtot6oLcFelkyieOzIe2nDhS1i3A7KTF4m4Ksmw9EofBJC3L8ijjbkN4TTm1I6xidbiU1XrbD\nFGpMnO81ty/Xdt+UoKWagpabU7W9cjzd93O04qhoTZzcNZis2tLYJdpx8brjCWPUulbt6ZHyfVZp\n7w9J0JLldvzWu9qY+7UjOtg3ke4bkqPv3/GR92gPW61Gvhrn99H4JVqhXeX5UifG3C+72am2OUlb\najbyhlnHaMVyTOEdy7QCi1rXPlPfVtX4udpa9d5t6/VszH2HKa9tzJ/otYq8aK3iZ2Yty27kZSRZ\ntEMvyHXtmuixqu2q8Yj/atGcIk8UYj1f9OC1PY/YtLw433pBSY2NEz3m0Mtl6ur4uatu06QVrxP7\nucGm5avPXaaMmfIzidJEg9KaJ3rl+udRvVocU6SRlzZMHE9etHHsHR0T0zVTZ8bcd5h6MK720bcv\natInRaGXBydnp8bcm7Tt62V9iNaqn7Jq+X7l35eM7URoG4Py242xjRR1a5PI2+TQ9kw2aSIOEO2f\neP0DEVq1rF8PmQNe36nE+t7H9X2N9o5erD7RtoVcznT1pMbch0z+bYQacx9yPZlWabujg87FnU7b\nxF9PuPiOtibkcplUmQ+ZAtuInBk27VBuhFaU1FY3Mibarlmurzbm3tcWyXZhnqqbMuU8YNPKHlBt\nhUxsQ9iGhEhBXZNe5LqAM+d2wVl1ADtVViAXjlUVYf63NTgmd8VfZAqSxZ6d+bwE2Q31+phbaM14\nrW4P3rwoOoXRI9VwmjG4Uw7F/Xofci7W4JR+SHK9P+HVWn2FbojGwtgEoOFvePHcX7G1udnIVuP8\n7j75JzjdKq/T4jAjdjBQ/1exzXK85jVyzzefRvaX5aKXOBL6RQRhTvStiEU9Dpx5A8+p99bXO/Ne\nj6f8akccR+3hRuSu903DZcZdE8UHX+NG3h+8KFFTXZVVtWDRH+UTG75/l2+cnRenZc99QiTy1sXg\nkP51VCT2ZFlQvduDvG5eaO19GgrLmkShicCsGSoLJjgzIoA6D3YfVlkib/pE0Suvc6OwoAWFjUbu\n0fNezNslXi+Ofcw1p0ykXnXNNuTaHH05mu2CG/nPNyO3Buj2LJmTLUgU597qnS7MO6LhqMwT7UPh\nWx58cE48HmNuN4Sn21jfWd/7k7r3sPLv+UgKSHIKTLW8I145FeYJvHm8EPPru3ou7gY5VeWjV5AQ\nkAKnwCza78Fd+U0ojbIgP8uGslwHSh6J0IeKdNeeyhYRG1gx5aFoFG2Q3xZEoXqdHVn2FmzYq9oK\niW1ILwuPNqTXgvtjJ4Mq6fEt+GHtMbwZHLi3qkdtU+iKudB+s/7/6LGrgr6yexwLh4gFrTfRiDO3\nOII611cInt3umAgMuschv2UCrpzG1g73vatuRrz8aiz6Hqyd5H88IqVM0r/J990waJfHBHE8qpK0\n8ohARz3srpMlQQ3UahfSXmlBkepsyMLqkDtzUUOJkdGqulbDZfG/PdJ4LitA9gsN2PGhB5cb1Qbk\nNFkT5VeBkSi728jqD8r2N+Oo24TEDCuyZMYEK6aL/lvtwWYU6GtIZiTIP0GsHSt9Y+d86SFjrAVv\nIOpbXW9Drs3Vl+f+8+IkoB52l3OEbIJF2fxJUJnbHI1ZI8SiODMm6Gt2Hes763tYCO4E/OPfMLFq\nB5wul1rhxktMsuDQ81H47f8ww3HBiz3/4UbOUy6cVMu7o/qIByu3iG2cFZ0ZvcqZYU+wIU0Oy1nX\ndt8O25DeFw5tSK8F971pp/tr8W89Dhz3q9AByffDU+LMLcpIrGN4u/HoqQ4jWO46F+paxH8xY/Bw\nr/1dvkatvOz+zRtYFPJ48lt/mMotjwnieIyy0cYWh9HqYd/R4JKdiiEmo0D7SYw36Vch3Kp3qnNr\ncIqu+oQnGvSKv+iX9cj/gxuXvRaMn2rpP2PUvV7R2xZ/VNEwZotWLm+6DXZvE8r2+keNXtTIP0F1\nI7L9GzO/xB/IGng2f/6l/v8tt67R/7++TIgPaIbEc3lxwk/hOXmSa8HRl0KXuYRHm7DKWLUPsL53\nr77fhlsGi/++/hKcGX2g+hhfyjBj8C3ir9lTJmx8MBKJ593I+o0Hi95qQf5ZDaUeebGuZ3aUNyMj\n34XEFaJMrr4CZ34DSitF2R5mxSw1TTrbkD4QBm1Ivwzu0XgCp7zRSB+Tid/aHfoNdT5zIsdgqdn3\nXftp/E1+uDfPRNGQBCTLYNxkxdLYJVh2zV/H7Eg9dtbVAFF3Ys2Ie/CwVb2XuomnfPwyFIX4rl+W\n79iYZLFvxnO5H3Osvh/YuID9dZeAoffjpZvHYI7/p25OwGOOwca+C2/Wf446iGMfPRdr1XsPs45B\n8WhjRp6+5cWh46KhSLAj72dmZKmWKSPJgu0/lU88+Mcho7AmyrvjV9hQ6Be8lF3SUOv7xkFU4m4P\nVVBXWwclW+D09frFZ5blXxC6qODPTagWDciUmTbMSjXDLXrgTv9GRzRSHxwXlTnRjo1Z4thbrzYI\nsWbkp5qQ0T9rC13N65/qNy4NTkrHTCPnuqhplPXEhrt8M1vYTchfHKFf/QlwpEUvl2k/i0DROATM\nLpEzyYyVfVrpWd+7Vd/Xf0+/Sdt16iA2Gzk04GzGwVPyyn8SvrfeyOk+3xVcM2ap+pE2TNSXJyN6\nFKzmzLChbLG5rU0Qde3wBU2PNXS+B2xD2IaEIEPKjroWnRNt/HS8/Ep9fr3KC+kaPzlduwNJ506o\nJ8DCITkoGBN8JjS4z5Xg7trT+hh0OVtO6cR7IepSALfLBbvjNLa2XuW/1k9eG8MC9GPQZ7YJ9bPX\ngusEtlaIbcrOcqsEFI/PQXrwBD3+x2Qeh93jlyDVvwD4NJ/GzuMlWKkXUAfWjnDiYTkTgD9xPG6H\nA+7qLa1X+TtN/dSy/Iot40OV15FYY+qt8e32U8Pl/Y2Y9bpXr4BydoDS1Q4MClV4vc04vNmFeceN\np3IKqrwZ7TtErdr9/LYZe/KjMCX48z/eiIRNojIJXd+mMcWVbOxkg1O63o1s3x3vPpFmlOWJY48J\n8ZWN14M9z7qRE/wa6pSFQ5ejQJzpjJ+VV5k+nW5DumMmik++g6zkKpTcPxbZ15gO0yhX4qQT4mfl\nr17mgn6KPsGCo7+KRHxA/WiBu9ECe0Ng2XQuECfGB0JNESJO5IcbkfGKUec6jfVd11f1/ZcfNOLZ\nDOCg+NzSn1GZ1AXqXCyH23x2tftp5HTT4jyMa63XTb8+gMb1U0Vl/xUip4eaDlPUjc2ifIQoW4FM\nKHoqCvMSg8uRCK28JriPNPjVYbVN/XFovnq7cUUksuSY7lAqG5G9oQWl6inbELYhwUJ9zP3CzotF\nyD7xHk596zeurv4LHKksxHQV2Et1TQfwSIVYz3djTXM9TlW/ihdrexAlaBeQU/U7vFhdKe+fMDS7\ncL52H148GRzYSzVwfvYnHPjmkviDqiyxvtt3M67krcT8ikK8+lUN3MHb/NQX2EsuPPflK8Z6vry6\ncrxa+Xa7+wr6RF0LsvIbUCa/+vMdi9jhk683YJGqpFJ1VTNm5TVgz2EPLhsDAsX6Xrhr3Nghghxf\nJe0eL5wvNODwWb998IrA6ErP+qHGFFeC/1RW/hq9yFjXgB1HxXoe9V7ifS8fd6Ewj4H9wLQPv/pP\nOadwEubmXsehOTUtWLXFheo6VYA9zTj5Rxf2nDae+ivc5YZTrnvJOAnpQYFoeI6KOjevqyflrmJ9\n71p9n70N2f/kAL7ah5cZ2A9sz7yMfV8Bjn/KxrbZKq9bNOQUNvrVIVV//9iAwg+bYZ8ShUN+8613\n1qpNjcj9gwsnRVvSVjebUb2/Ac6CtsBeYhvCNiQUuUdMTExMYZrmats+bdQ07TNt+49DLWdi6kxK\n0p49KMvRRe2dJ5NCLGcaaCnpyXfEX1PTGg8+qyWFWM7E1LvpurYhITOZmJiYwifN3qZ9ItvUk8Va\nVnKI5UxM10g/+PUBPRC8+PaakMuZBmZao/8WxkXtwK9/EHI5E1NvpevZhvR8zD0REREREfUL/XbM\nPRERERERdQ2DeyIiIiKiMMHgnoiIiIgoTDC4JyIiIiIKEwzuiYiIiIjCBIN7IiIiIqIwweCeiIiI\niChMMLgnIiIiIgoTDO6JiIiIiMIEg3siIiIiojDB4J6IiIiIKEwwuCciIiIiChMM7omIiIiIwgSD\neyIiIiKiMGESSTMedlN0JqrGp6gnfjyXcOb8+3jx/DHs7Nk7dMvCoctRkPg1tv59B55TeW3iUDR2\nOe6LPdHB8v4oBbvvyMTo6i2Y9M0FlddJ0yJQkxUBHG/Eok0tKFPZ8s+/fX00MuBC3rpmFKrcAUcd\n3+X99Zjw+g0obBSSUQfj1LMQancg6dyJ1jbELZ7PF89PqcWt9RTvYeVnB7BT5XbL7G34ZNdDuO1s\nCbL/ORslbW8C52IH8mZY1bMQRL1JEPWmK0Jt82TJFWR8qJ70C6r+xzWj7HkXFlWrbEnVqf63z13h\nO74mlDzahFUqt88lZ6H4v4qRNepTvLzge/j5XpVPgC0d5an3IlY97ZDeNnytztMX8O6xLcjxqGWS\najOOnczH/HqV101r3r6IF2YDB9fNRPozHxuZiVZUPOXAIONZx7rRNtw4rO99op/W9767cm8bjNEj\nFqAgKR1LZRcinMkG645clA+9SiDTH0y0YVWietyfyYZ1cwwqFod7wSF/9vh7sdamnvSqudj2u2zc\n5qjCjtWBgT1JVmQstIhOfv+3cUUMajZHYKN63i+dEh3I1SWost6G7N9tE6WPeiYO6cNSkKye9aak\nJ9/Br2YPhusvm5HtC+zDHut7r+rH9V1e6ux+is7Uqu7I1XZHB+Yn28ZoRYmrQi67Hmnh0OXivTO1\ntSGW9XqypWsiuNdEcB96ea+kFG13d99jWoRWsznGSCssmqjUaplJ275e5K23ak7/9W90SrRqIrjX\nRHAfejnTgEhGHexE/VdtiEzHR6Ro4iSulsVpRWNF/th0baH/+l1MSRuOaI2apl3ctybkcudih143\nyqa1X9YrSZXnPtt+t5Oq/3rb4NC2J/otU21Gf9tncbIX+xWhiZN9yOX9Ka3Zd1GUukbtyIakkMuZ\nZDLOa1Wi3rdfpuq/3jYs14psfss6iDu6lh7S9nwp/kSeT7Rts0Mt908WrUzWE3H+DL18ICTW975M\n/a2+99mV+1Oe08g5dwDnxePR9n5+Rfs7orbKA0y0wpmgMoj6kTNfV8IePw1rrjJCputm4tkf/wAO\nVOGN/BdVHgW45EF1nRUZc8wYCF/sDRQv5r8hSp0DP/jxs6IUUrddqcSZ+jikx4279nCervj1Q5g5\nHHD9pfi7NXSK9b1P9Lf6fh1vqJVjxnMhetsqLUeRzYGHhy5BearKu/UezFFrS+mR6dg7/km1/pMo\nT7wfT4f42n6yw2+92x/H3qEjEa+WtQl+f5HGpmOhWtqOaTCejl/Wtm+3r8JHI+7BYxa1XB8PrJap\nMYSxicsDtz8i6F4Euc3hOTh+u+91y7F3yEhMVotbBa83dq447p5HPJf/6sHhOhtmLbxGpbabUPiI\nHdWb5FdiIhU4ULbAjFlqcatYM7avjkSNvl40avIiUDTBgrIQQ2rSRon8dX7r5ttROt3ktx9yvJx6\nPzXWcdAMsZ587ksrWj98fUxzwDKRyqaphX7yl0eJZXYUh+jQrMwS+xO8rLPHTr2u7tKHOFCfgPtu\n7sWT+OxHMVV+n//5x3i5N07gZhPyFttRsUGWK1E+NkWiYoUVeT3Z4XbbjEJFrg2Fo9Ryf31RPlta\nsOcd0fGfZEP+NTr+mZOsOJSv9nNzFKrlfo5QC/3kTLcFfEZHs8zI+6mss0FfsXfm85TjgfX3i0HW\nRJkRgSz13EgObG9tSIz2p22ZSOutcKqlrRKsOCqXLQ/RFkZacEh+vkHLOnvsrfa+jI8/F/8nT8Wj\ns40s6gbvWfxHjej4D78Xz/dix//ZubLT78LH7/5G5XRXcJkzyqNergvUOWydFTl+67YbcqqGorY7\nh7G+C6zv3dFnwX2ybQyKRqRjmHh8xh3qBlAHbh/txNpEcSL3BexmC+zq4eToTBSl3IvkaF9ttiJ2\n6J1YlrIET/vtdWxEOl6a4LeeNRrJicuwJj7aeN4dJhG4JzmxbMTItn2zOjAsfibWjM/E2u58ar5t\nDk+A3XdItjgkj1mGV24W76Oy5Oey9pYHA9eLnYRl4+7v+ZhDrxfFH16jUptFwJ4bhcw0G+y+4xQd\ni/EPROL/iArbWvjFeqXropAxTgTc+nqisRoWgXkrHBivr9AmMcmK7U9FYnyC37rig00Tlb8oTV+l\nz+Tu98ANG6b/KOiPJvZ//hSxP5XNKKxpy+vUsVOXpI5XnVT/FNzxlbQvsO38F717El98G5LEf5eq\nDmCfkdOh8Vnq5OCf/DqU0sZHHXDOsGGQr4CINmvQRJHntCDTyOmyjcuDt2nGoFF2ZIo6UzrFyNL1\nYfms2efB0card/xniZNugdjXRNGpN5hhl/uZG4FCv5Nz1nw78n9qD/iM4qdFwTkt8LOU+uLz7JSa\nZpRVakCaFbmRKk/Jmm1ForkFh/d74bvnsLPHHmgfDlRdEv8n4bbFRg51T+23f8URV292/GWn3yH+\nr8In64yc3mNCWk6kUa5tKogX7Zkvtuk01vfe8x2s774977HgE/je1CzcN1RUnrr3sFW/m/0E5v89\nH0kynTwhnkdjWFQ9jlUWYX65yvfNiGFOxfPjUmD31uBAxe9wt1xW/m/4xWeVcFvHYemwMXItwYo1\nw+7FMLMLZ04XYbbcjloPDllx/fm9v0hba1V2CPcNXoj7xB/QfX4fnvvvfzNeU74Rv6g8hvMtVozW\nr6JfQM5nanvH3kOdyKmr3tK6fT3JmUCUZXFL1DbfwC/+YSy/+79LcEC8MHbUj7DeVw/s6VgaL/a9\nvhxb1Xvr6zU5ut44hFDyxtUr9UpRSTOGmeCubETeE1eQ8OgVzMprwOHzwKBpolOgRlhlzhXBuagk\nAevlNqD0rNdYwc+sMSZcPteEPS9cwV1iPbnuok1uXBa97sSJvisYGhatM5YlPO8Sy6DPfqM/9yW/\nWQkKX3e15av1Q6poxgcieLeLQD7fr7RnzLAize7F0ffbZg/q7LFT33n38nu9ehJ/9NZb9P+//LwX\nhuSIE1I8xAngwwasWq3K3up67KgQZT7Rgulqta6x4K40UfkrRJlb31Y/7lonyt0xcUKqUqsJfVo+\nRce/SHSEO+z4R4r689MI0SY34/DL9Zgl93PFFeTtaoLbHIHMxW0nwZyZNrG9wPVW/UHW96CrlZ39\nPD9sMpaJVHJcZsjZMNT6evKf+aMFGX7LjPVDy3+/SexuBDJm+++XGdlTxf7XeFBcobI6feztvfj5\nl/r/t9z6qP4/dZN2Gr//qjc7/j/ALTeL/y59iU+NjB7wK3MlokyJOj0oTsPJ1xuQ7SvX3ZiNjvWd\n9b0nOt7LnnJdwJlzu+Cs6mgKOxeOVYnA/tsaHJPD//1FpiBZ7NmZz0uQ3VCvj9uH1ozX6vbgzYui\njESPVMNpxuBOWcC/3oecizU4pd9GINf7E169SvB+ddFYGCtKe8Pf8OK5v2Jrc7ORrbnw2re7cPfJ\nP8HpVnmdFocZsYNFwP5Xsc1yvKbi3/PNp5H9ZTncGAn9IoIwJ/pWEdTU48CZN/Ccem99vTNGB6LH\nZKV+v6NKbcL0iSLQqHOjsKAFhY1G7tHzXswTBRuwYYz+NRkwPUl+pSECdv/16rzI3taE4I9eNiJ3\n5TehNEpUmiwbynIdKHkk4trTjPUKDYVlYt/tEZg1Q2WJ43RmRIjj9GD3YZXVhWOnrpHT1QV0emXy\n6/gGkCfxmppeO4k7urANOQ1c2wlEJf9p7tyifItO6aI/a0gTncPSR+yoWO9A5oSeNKNenD4nGq4J\nkchbF4ND8tuCgkjsybKgercHea1fevZ9+dQ7/u4OOv6TRUfcrKF6pwvzjmg4KvNEO1b4lgcfnBOP\nx5iNr8ITxWvtomMuTtD+65Uc9KDk76rh8+mTz7Pzqg+34LBoVOOnWrFS5SVOsWBKrDjOsmaUqLxO\nH/vVWIMvNlFXvXv5Qxxp6uVhe33Ci5N/dCFjvxelbpXVZazvve27Vt977VNtdwI/vgU/rD2GN4MD\n91b1qG0KHSQvtMsuNTB67KqAbwOq7ngcC4eIBbHDkaqvIc7c4gjqXF/5zY1tOCY6F93jQKyoU7hy\nGls73PeuuhnxsjWKvgdrJ/kfj0gpk/Qr8r6bju3ymCCOJ7hR8IjOknrYUyUiaDAqtTxQf2YkyN2I\ntWOlb4yfLz1kfG8QPyKoN94JiUkWHHo+Cr/9H2Y4Lnix5z/cyHnKhZNqeV8r298sjteExAwrsmTG\nBCumi45N7cFmFOhrSH1z7NR17156T53Eez75naur/fBryH/QgUP/245Zoqyc/MiDX+Q3Ik+Ur+7T\nkP1CA3Z86MHlRnUytFkQP1F+BRyJsruNrOtSPv2v5hnNUSvnCHmqEHXoJ0HvvTkas+Q41DgzJuhr\ndk3vf55d4UWxCELkEMH5avhT7g9Fp9/dhNL9xnOpV4692aUeULdplfj9l6rjL/5M/ZcXNT0+WbO+\n977vVn2XR9Hv7HR/Lf6tx4HjQR2G1uT74SlRKMT5MNYxvN149FRHUGntNBfq5MW6mDF4uNdiua9R\nKy+7f/MGFoU8nvzWH6Zyy2OCOB6j/raxxWG0ethjvkqdZsNdMSpPJxoluRvVjcgOvoKpku9Hoj6Q\nM+8gAvNWWuBUY9jSYs0o/nlE0M3MJmx8MBKJ593I+o0Hi95qQf5ZDaXi5cGH2GfE8e4WvXYk2JAt\namXedBvs3iaU7fXvvXX+2KmP+U7i8elI7+EFkM2tX5Ou0f/vicRpEciZYsLhzS7cVdIM5xEvdsgh\nlsF95K5ya3CWuDHhiQa9nC36ZT3y5dfaXgvGT7Woq2rXp3z6Ov7Tfxh4UIXnZMejBUdfCv3eCb4f\njan2otothw1EYM9kE/RbasRZJmuqDVl3BJ5u+uzz7IKSvc1il81IE8ebESfSOBPcoq3I9bvo2Olj\nD2FN67Cwzfr/1DOtHf8E39Dc7voYX8owY/AtuM3IuK4GxQYGF4nxpqBvslnf+8J3qb73y+AejSdw\nyhuN9DGZ+K3dod+U6zMncgyWmn3ftZ/G32QFuHkmioYkIFnWF5MVS2OXYFn76XI6qR4762qAqDux\nZsQ9eNiq3svkwNKbFqB8/DIUhfiuX15oj41JFvtmPJf7Maf1q5kL2F8nSvHQ+/HSzWMwx/9TNyfg\nMcdgY9+FN+s/Rx3EsY+ei7XqvYdZx6B4dCd+1a8L9ErtscAeEGFr+OC4CIIT7diYZUaW/40nInDP\nTzUhQ+37Dn3svgjQx0Ui7wWjZ1uaH4VZo4KLlO8KhFnvrUtpw8zY/mREhzfy6P0bYVByW8dBbzD8\nC0IXFfy5SVRqC6bMtGFWqhnug6JxUV91Gjp/7NT39JN4s0OOpuqZ1z+FHLY+OCm9x9OTzVNXdOKT\n2k5izhkRWDWtfXvQWYlxoi6ssKHQ71pE2SUNtb5v7kTgbwwvvU7lU3X87ZFBZ9wjLXr9SftZBIrG\niTqssqWcSWasbG2cxOv3iZ67aKOnPBSNUnnFa1MMNv7MLoKXwGCkW5+nR25D7MdU9RohTQRKmf6f\nR1c0tqD4oPhcx1mRt8CKeNHp3/NnvzO91OljDzYT6UmDxf9V+PR1I4d6yNfxb3dPXVdtxsFT8upq\nEr633si5PjS4ZN1OtaFIzYaVkWRByU+CGzrWdx3re7fJkLJn3b9O/wy0nIoyUw2nCcH3U/TKwiE5\nKBgT6k4Pcb47V4K7a0/rY9DlbDmlE+VNtcYyH7fLJRqA09jaepX/Gu8vtB6DPrON/NlrIz+A6wS2\nVohtBpSHBBSPz0F68AQ9/sdkHofd45cgNVShbD6NncdLsFIPah1YO8KJh+VNtf7E8bhFg+au3tJ6\nlb/TRI851E9Lt/5E/gUX8nw3/ESaUZYXifExIb628Hqw51k3cnyzy4hGZvvP7XrjBLMoRufF8pIW\nTPjXSMTvr1dXFkwoeioK8xKDtyeWeUWv+UgDMl4RvX+VazBjj+goTAn+/P1+6jvUz/sH8D8mRU6L\nKSunaDFQut6NbN9x+HTl2OmaFg5djoLEuGu3DR20Ib7Xy5vyV/putu+ymSg++Q6ykqtQcv9YZIeY\nDtNXlq750+tpNlQ/Ym//jZNXlGVzM/bkivKhbozpbPnck2RF6WoHBoU6Ucsbuja7MM93k1ivl0/1\nc+0IqiviRF/2G/E+4kD9PxPnAjvyHpD32gTT4D7cGFCP5dR4v/iJmhXD24Lag25s90bAOd3b9tPw\nXfg8fTJmRmD7ouBAyP/n9OXUeGLf9fzQ2v2d5TR56xzGN47lDbhrS3B71LVjbzW7GJ+9nYWkUyX4\n0fhsXGu2pu8mdV4OOv8b5HTT4jyMoPpvFq+ZKF4jisG1446r+PUBNK6fKnrTv0Lk9GtNh6nKld85\nqM01ylzQa/IeioRzclAwLYJOWe8CyibrO+t7D4Q6pfQLOy8WIfvEezj1rd/YpfovcKSyENNVYC/V\nNR3AIxVivXp1ube5HqeqX8WLtd2t8YJ2ATlVv8OL1ZXynktDswvna/fhxZPBgb1UA+dnf8KBby6J\ngqqyxPpu3824krcS8ysK8epXNXAHb/NTX2AvufDcl68Y6/ny6srxauXb7e4r6KnC3R6c9F0h9Gn0\nImNdA3Yc9Yj9lMG5ICrr5eMuFOa1NSZZ02w4+oQFFQWi4Vohv6qqR0JeE3LMwTfnaMgpbERZpWi8\n9M9GbFN8qEf/2IDCD5thnxKFQ0HTDcoVnS804PBZ32tkVgvcV9T+dJMxLabgP/2lv04eO10fOy+9\nh2Py3rEe2Ydf/efHolYlYW5uD4fmiHKR90c3LrtVofSVjU0uVF+xYl6+//zLnVNd1azPgLHnsMdv\nu164a9zYIU5grYG9dL3Kp351y6/tUgp3ueHcIo71ki9QUXX59QbM853sREBSvMKBVUOaMWG1Mcwo\nYUUj0kq8SBwV1NnpxudZtq8J+bua2l4j96FR69m9Fb5p8hA4HZ6/Th17kDW5c0Wpc+Hj//wVA/ve\n5D2BrV918QJXKM+8jH1fAY5/ysa26zgved4rLlGHRYHVi7Co65WizP+7qP/6Uj+s76zvPSSPkomp\nSylrgV3/uerq1RbNGWnkZSSYtT150SI/Siud3P41TEw3Js3Vtn3aqGnaZ9r2H4daztRryWzWSjfE\naDWbHNqeySYtTebZoa18IEKrlj97/0uLlhn8mnBMP94uSpumNX66TZsbajlTv0hJT76jXZR/p4PP\nakkhljNdI7G+G6kf1nf5fY98QNQ1ZjP2PBOJKYPbf2XoPt6InE0tKFXPiW642dvwya6HcNvZEmT/\nczZKevtrMGo1a2YEitt9lS54m1G2wYVFfnP3h6XkLBT/VzGyRn2Klxd8Dz/vjV9Gpj6z5u2LeGE2\ncHDdTKQ/87HKpc5ife+f9Z3BPXVfrBnF/2LD9AnqF/Tczag+2IT87V7s8H2LRkTfOXIM7qq5NsSL\nNkIfZiTvxynywHlWrUBEYYP1vf9hcE9EREREFCb67Q21RERERETUNQzuiYiIiIjCBIN7IiIiIqIw\nweCeiIiIiChMMLgnIiIiIgoTDO6JiIiIiMIEg3siIiIiojDB4J6IiIiIKEwwuCciIiIiChMM7omI\niIiIwgSDeyIiIiKiMMHgnoiIiIgoTDC4JyIiIiIKEwzuiYiIiIjCBIN7IiIiIqIwweCeiIiIiChM\nMLgnIiIiIgoTDO6JiIiIiMIEg3siIiIiojDB4J6IiIiIKEwwuCciIiIiChMM7omIiIiIwgSDeyIi\nIiKiMGH+XuoUxN08HDZbhMoiIiIiIqKByDTr/v9PU4+JiIiIiGgA47AcIiIiIqKwAPw/8OYL0HKz\n45EAAAAASUVORK5CYII=\n"
    }
   },
   "cell_type": "markdown",
   "id": "797bffd4-9401-4a30-bc95-3a8fc65a351f",
   "metadata": {},
   "source": [
    "### Define the confusion matrix and describe how it can be used to evaluate the performance of a classification model.\n",
    "\n",
    "Four main components of confusion matrix:\n",
    "\n",
    "1. **True Positives (TP):** These are cases where the model correctly predicted the positive class (e.g., \"1\") when the actual class was indeed positive.\n",
    "\n",
    "2. **True Negatives (TN):** These are cases where the model correctly predicted the negative class (e.g., \"0\") when the actual class was indeed negative.\n",
    "\n",
    "3. **False Positives (FP):** These are cases where the model incorrectly predicted the positive class when the actual class was negative. This is also known as a Type I error.\n",
    "\n",
    "4. **False Negatives (FN):** These are cases where the model incorrectly predicted the negative class when the actual class was positive. This is also known as a Type II error.\n",
    "\n",
    "Here's how the confusion matrix is typically organized:\n",
    "\n",
    "![cm.png](attachment:b78557ac-731b-46db-aef9-edbf75432e4b.png)\n",
    "\n",
    "Now, let's describe how the confusion matrix can be used to evaluate the performance of a classification model:\n",
    "\n",
    "1. **Accuracy:** Accuracy is a measure of how often the model's predictions are correct and is calculated as:\n",
    "\n",
    "   Accuracy = (TP + TN) / (TP + FP + FN + TN)\n",
    "\n",
    "   It represents the proportion of correctly classified instances out of the total instances.\n",
    "\n",
    "2. **Precision:** Precision measures the ability of the model to correctly identify positive instances. It is calculated as:\n",
    "\n",
    "   Precision = TP / (TP + FP)\n",
    "\n",
    "   High precision indicates that when the model predicts the positive class, it is usually correct.\n",
    "\n",
    "3. **Recall (Sensitivity or True Positive Rate):** Recall measures the ability of the model to capture all positive instances. It is calculated as:\n",
    "\n",
    "   Recall = TP / (TP + FN)\n",
    "\n",
    "   High recall indicates that the model can correctly identify most of the positive instances.\n",
    "\n",
    "4. **Specificity (True Negative Rate):** Specificity measures the ability of the model to correctly identify negative instances. It is calculated as:\n",
    "\n",
    "   Specificity = TN / (TN + FP)\n",
    "\n",
    "   High specificity indicates that the model can correctly identify most of the negative instances.\n",
    "\n",
    "5. **F1-Score:** The F1-Score is the harmonic mean of precision and recall and provides a balance between the two. It is calculated as:\n",
    "\n",
    "   F1-Score = 2 * (Precision * Recall) / (Precision + Recall)\n",
    "\n",
    "   It is useful when we want to consider both false positives and false negatives in the evaluation.\n",
    "\n",
    "6. **ROC Curve and AUC:** The Receiver Operating Characteristic (ROC) curve plots the true positive rate (TPR) against the false positive rate (FPR) at various threshold settings. The Area Under the ROC Curve (AUC) provides a single value that summarizes the model's ability to discriminate between positive and negative classes. AUC values closer to 1 indicate better performance."
   ]
  },
  {
   "attachments": {
    "b4c609fb-62de-4011-9205-4ae8dd9329f5.png": {
     "image/png": "iVBORw0KGgoAAAANSUhEUgAAAfAAAAB7CAYAAACLrNJJAAAAAXNSR0IArs4c6QAAAARnQU1BAACx\njwv8YQUAAAAJcEhZcwAAEnQAABJ0Ad5mH3gAACsbSURBVHhe7d19UFRnni/wL9DQDY0t8h4Q0NAE\nN50JKdnRmk4mBmd0vcaCKbkDW3jDraGuVph1U7pWagx/jDF/qLmuFctxihTsMlXUlVrdMjVSxnXM\nXIkmwxSZq5XOpDMijYgI4V1tae3m9f6ec54D3c3LiECknd+nqkOf04/dfZ7znPN7XjtBAMbowRhj\njLEAEiz/MsYYYyyAcABnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYYYywA\ncQBnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYY\nYywAcQBnjDHGAhAHcMYYYywAcQBnjDHGAhAHcMYYYywABdFjTH3K2OKyPe4tlCUbge6PkNXRCKfc\nH2jKkt7B9ni5oehDnb0CJUNy8zFZw63Yn7QW5iUGdYe7D239f8CRHjvO8FX9eIKzcPnFzUiZp3P0\nxIRaYbOsg0luKug6WknX0eMq/akB776mw71PXXjuP70LWAg+/3U4Mq49RMKvRuS+JywoCvsTtqIw\nJgH6UNoeHYbnfjPqOn+HXzx0Bey9xB+3wNkilYzXllHwFqLSsV1UNefKuBUtL72Ds/JtA1lhdAlO\nZK6bCN6CIQYpSbk4mlmEo2FyH5sVc2QmBW8hBi9EzkdBiUHVs++g5Vkr8uSeQLf0B6H4IFxuzJeX\nw9D160h8/rLcnovgTJzNLEVxogzeyj4d9EszsSnzLXyWkI7Vcneg4wDOFqfQNLwQAbT1NMITlgmr\nV5wKNAc6DmLll/LR9PgtoHHBFvyv5QmAy47qv3yANfK913xVjiO3WuEcGsC9MZ1MzGajIDIdeNAI\nx10gzrQKVrk/4AzVI0src19WoG4+m5z6MLy+ZT5q1AujOHo9LAY32m7VoPQrmQe2w8j/Sy3s9124\nNzQMw+L9+rPCAZwtSnlLXoAJ7bjaZYdj1ABLZLJ8hSFkKeLpynV0nsM+jxs9cnfP6F0c769BVnMt\n9tFNis1SEFUUYwHPvSs47uwDlqUjl++QfoZxq2WEWuE6HFykebM8LIoqt1fxb/2tOD8qd44N46rH\nji3Nx/Aq7a9/SoaYeAycLUJGHE17C3khl7Drxhf4wfK3URjRgAPXL6JSphgXnIzyxH9ATnQC9KLR\nOXSXWu2XvcaBM3H2pa2wiKfTcN6qQFY/3bCJMl5tEJ9bjzPKHkF0g+5AjttvDNF/nE1+9gH67PPT\nXVWiGz8jdm7jqyHZuPy9jUhx042o4w+ofdCFi8MTgdyHHAttc5TjSmQBiuNjKM+GKUjZcfI2VQD8\nvoPvuLpI14y6b8+h1O1WExAlj4LqcV63BpuWUf51fIRfDqTjvWezqdLVh6s3qpH/YCJ9wAjfjGuZ\nWXA0HcSWkfW4tmotum8cxqvOyZWhTZEbUfZMFlKMotDJfPIaX82L3oGjqZTX02pE5Zcf4YB4qp0j\n8bku5UXVNGXlUc6Rr2nK7yypY+DA5x8OIXVHOAyfuPC9WlHQpx4D/97yEJSXhCEjIYS2KB3l4+f/\nMYjdtjHcUlLIf6c8n9rk8fa/bmfCbux5xgBn50WcvNuI84N3cVUL5H606/1AB1CQ8jLM4nzSdez4\ntha/6KcGhEyneJTrXTmXL+DrW7fxQlIWTEOtOHPz/wLxhciLMcLTdwH7bl/Bydkd0rS4fskWn5BV\nWC0CA118Z+gGVTvQDkSY8QNtPEsjxrqeK8ameBm8hdAodRx4pRWFC9lNFkQ3xZV+42zaZ8ctcG/B\niA2nOu4ChjRYny3CoRd244sX34YtNRdVxhiYpzhu8/Kf0XcVwVtsifHALBT/XTGOevW0r6aAUeUz\nri7HDZ/biqPiHuwtzkrBW/xjHUxJBThqpuCtbMZgdeLqgBzv3WnKhH60EfUPaMPdDPsgkBKZ7jsR\njIj5B+V0vGrwFrTx1R2oMS7sWM+sztFCuTeCj78cQfxr07fCU1fqcPoXFJyV4C1QoTSF4pUdBtTM\nxzj3DI73X0Yb1WVMieuxfVUpTr/4DlpWleCT2Cxs13kVeI1hLfY8R3mqnU+6js2pxahJSJs497O6\n3mNgTaXgLd4uPA15mSVK8Bb0MRvxRoTydF5wAGeLjtmYjhS48PUDtVVcP9BIrcsYZC/xbdHsid8M\nC93Her79CHvlWFeWNg6MKKQrpbsRW7SxQDn+bKeWjjo2KP+NbH3Pii4R+sF22G9UYINNvs9XVain\n5pc+ki5amWxhDON4dzm2XTuH+t4ueEQDMZgCabQFORk78Ena5MqLPuwe6q8fU8fLbcdwpL2L/k0y\nNsVqAUoHaxjQ3duAI18flnlzGCU3GuEJToPZPy4NNqKa8nxNkx0e2vT01SKf0h/vVO6cM/Z4LE7J\n+MFSOsj+ZpxSWketqO+nY4m1YKd3XuroZp+aoAT4M9dkftJxbxHjq0435fNSZRLcmf4KmYdy/Nl5\nCbuUbe0hW9+zMstztIDePTuI7lA9tkw5Fh6Eg28YsDR4BLdqXcj/5wEk/NMAdv+7B/dGQ5CRHyoD\n/wheof3itYQaqi2Rphq5LR+zbX0rhq7g1cZyVN6yo80le08MCVSJ3Yyy53+Os/6VrDDa7js3fg/Z\n8M05OOjU65/5Ed4fr6PN7np3tlUgy1aO81TPRnAf6r6h9PZLSi9Zin6mnpnZ4QDOFhkd3liSTgHC\ngT9qPYLDDnxNF4ppyQqvSUXU+owWN9xzeLOrESdlF5lTGwe+cQ4HFnJFy5Ad225X42cPDCiIWo+z\nycX4LKMYVv/m2gKqd9voO1Rh1dfqBLYDzQ1oe0gvRK3DnijfGdTO22ew7YFL7WYfc+F4zxklsOgj\nl+O/KSmoUnDnI7zafhk9YRZUxefik5U/R3kqtUqV1/3ctWMf5XnPYK8SwB20fZXewzHo3QccQPSZ\n6qTJAQccclfl/Va6Q6Yh2+t+b43MRBxVLutvnsIut8xPOm67GF+9UY4Nd7rQpuxbCLM8RwupawRn\n/zw6dSs8JhgvUh0HNg/yfzeGz+W1WXN1CO9+MkR5HYrvv6TuWzBjd3GgvxavNlFFR5nAVoMznVRR\nDzbCkrYee7zrHaNUGe2wjd9DHIM25LeJyj4Ffe3cz+p678MVZx+c9B3aRL3E+TXO0F/nUB+61QTz\nhgM4W1yC0pEtKqhhWdjz0jvKsq+Wl3YgR1woyywoGO8mNIjJsHAO3PYdp/quBMXgaMpb+CL9R7AG\n9aGeWqClTR+gcr6v0EckJrBV3r9IN6xzSgCJC1+uviC1efx7GfqUVgYiY0DVJcXqiI2wWXajLDoG\nzoc2/Bu1IrZcv/TUrJmdSZ7RrPREpKx4S5a5d2DLyKQ9BlhMaUoaIS5Y3NFvw65VLr9ji+kcvUNR\nqVs/RSvcGKRUKO7d0ca6J9T0iRZ1MAzzvQxtJsoEtlbs6qzAgXaqYIYth8W7J32gE3a/hr5zsFPJ\n0/gw2VpeZNe7hgM4W1RM4ekwT1sqk7F6fNzRDQ/Vak3Ugpz3NZ2GKLkWWAqKguhd9Za3LB95MZ04\n2VSNLf02HHDfRf3oMPRT9SjOs9WG9bicaKEbidzxCCZ328WorYuBPjSLzaBMvGfOhr6rBlm3L2IX\ntT5PDrupNeo/8eBpZMQm0/Tdmvql6dgun/eMishNAcCvPMwHU6hvr0mOmE3tbbGdo65hnLVRK/zV\nUKTKXQrXmNIrs3RZkO9+UhQjCu0o3KKnaCHQtXoouQhV45NiHkFkIix+15IpLFGp0HUPqhXfJ3m9\nz4QDOFtUipeI7kDxK1jaWKF8fKW2LFPodbOSUo5RRm/GhwmZKJQl2RQchZ3RRbCl52L/pPuaOh4m\n3iNHu/CCDNgUMnGxO0foPcMyUbA0CnG0bQqOwf6EjVjt98MoFoO44VOg1xvVMeQgo/K5heIfLSgj\nihPWIiUxFyee3YxDVNnQJq2ZQ9NQtXy9Uvlw3FfC8jjT8jyciDAqx6R817g8pVfDM3Ab/yX26WKQ\nIvJQn4g87f3CLDibZp2YyPO0ClkFi4iV4hf/vMscPZQWW0QmXpN91Op8DCOsKwpw1CDzEzpY9JRX\n6dRCi072rfxhRAlmiDRjU5huPC/NFKzHK56jHtyjPynRL2On0sOkQ06Elcqd6If2sgjPkdIKDw/x\n7cLvG8VXXfQ3S4/T/xCEV+S1WbQ6FO9uoIvSM4Q/fanuGydn2adaQlCkvRn9LZq+XjUlk8GKn8Sl\nISfz57gcK+4L8tqm67xwSS52PkOVJJcDn3qvvgjORHFS1vg9xByWhdMpovelS+2lIk/uep+ZKAbz\nNKGdsblKxonnimEd9l/GJehwSCwni25E5Z8/wgGlJ07MQt86dWvIeQl7W+p9l2sEW/DJC7mTWvje\ny8hM4ZvxRWaW7w2JWl2eYQP0dyeW4ViXFuHEyomu1XFiHM19BQeaLqBSfvbkn1L1M9ufuAymfEot\ngjVq6laGh96viN5PGVqQS5T0bjf0Br+MGm5G9TenlLFskfenVxVT6155ZYJ4jfKr7cYHeNWp3s2U\n44H8zn5LoNTlU70TS6QCgNlUgE+eTVcmN/os4xIM6nIyj1cZEbPQD4mJbJO46T3K6T3kXV8qji3F\n/uV+rWnvZWTassllysY4j3LOXF7LyB79HGnnZfrAPvufih1fRva+G/lefeMf/HMEilbRF/BaRiZm\nof/+X8RENmXTywiaah7ilT/ITQ1VAv70v8OR6pf+cZaRbTJtxdEV1BCY9NlktAt116pQos6ZU8ty\nFF3fOrq+/dI7b1fjh73tSlf6I1/vchnZFZm32jI19X6mLmlN8SpLczXVITL2ZMiJROryMX/D+Dcn\ntSrFpCJt/Gy0EVsay1HdKWdiC2JtZkctdvkHb2HUjqLGC3Dc87rBDrlwb3Ritpvz4TnsctjQo93Y\nXM2ou34K9b73ZNTfo5vvrWY4tXTa516vhzMsG2VZW1EmX5p3o+3Y1voB9jZfQdt9ry/2kFoMrdUT\nwduL4/ZvvPJJrB22obpRC95CO37WXAv7eN6INI04f70K1T0upDy7G7boWTaHAoKcNKktH/PnbsQV\n2m8ymZEjd53sr8K2xktwaDOctbxqrECRX/AWqvuqcfw2BYLxYEnpHwyoLXOFC7vaqlHXK2sPo8Po\n6aSydLtV3R63OM/RbmqFix4Eb7dahpH//kM0dWnXFl2MlAGfV7hR5B+8hYcjKPmVd3oyNIJ7j9HV\nft75EX74TQ3Od1N51/J82A1n/xVU/2UieI9zN+DIda/zKdaB36rGz2TwFp7o9T4DboEz9jTzayEz\nxib4tpADD7fAGWOMsQDEAZwxxhgLQNyFzhhjjAUgboEzxhhjAYgDOGOMMRaAOIAzxhhjAYgDOGOM\nMRaAOIAzxhhjAYgDOGOMMRaAOIAzxhhjAYgDOGOMMRaAOIAzxhhjAYgDOGOMMRaAOIAzxhhjAYgD\nOGOMMRaAOIAzxhhjAWhu/zcy41a0ZGTKDS9Dd9HWcxlHeuw48wT+X2d50TtwNLUXlV9+hANy34QY\nVD27AzmmxmleX4wycfalrUi5VYGs/j65bxaCjNi57HVsj0+DyaCjHcPw3O+CvbsWb96/ix41FVtQ\nOhxa/jYKRz/Cyo5Guc+bAduXbcb2hHTEiXM0OgznXRt+++0F7BuSSTRBCTj0zOv4SXQC9OJ0utpR\n33EapS4XnGoKxhaBv1bmAatxPQ4lZSPFSAV52I2e/ss4/u0VVPP/I/ORLEwLPDQKKUm5OLrSikJR\nRXiahVphe+kd2KJj5I5FJogqLCvfwp7UdBm8BR30S5KxOr0Un6VmP/3n6AkzBRtQSDeq9dFyxyQG\nlCWVoiwtUw3eQrAOpuhsFP9dCcpD1V2KoGScMJegMF4Gb8GYDGvGDpw2GeUOxp6sv17mQY2oAlRl\nrFWDt6AzIC5+I/ab12M735MeybwEcHvTQaz8cuKxwV6Dun43ncV1eCNCJlo0+lByQ3zPQGl9z405\n8kd0oQDOzlrs/eqwPEeHsUWcoz4XPINu0JliC0H0UInK3Yu7cSgjG3HTXW16qujGG+gkNeCI/TCy\n6BxlfVWBkz10ZoITsCkuE3QKFcUxudRqATw95+h8quey5HoDekYNMK94Hft5UIw9SY9a5oMtKFuR\nDv1oF+qvH8Ma7zJvXIudMQkyIZvJglzujqFWlHTUK12zKfpF2jL9G2EJjaL/NuO3XXacHB1Wd2IY\ndnGO2o4hq/PJDHOwCZuMKyhAu1DfcRHHh4aVbnDnaB/2dtTi6iBtGGKQo6RMQ148nU8XBfoOG51P\nsW8YdQ8u4s2bzXQ1p1NljVvhbPGzmrJhpujTdrMG2x64lFihlvlTqHdR2y8+GzvVpGwG8zIGLlrg\nWyjTfejW4osX1kOvjNvGKmO4FvmSaAXX2avxxyW52PlMOkyii/DuRZTebMB5NQGs4VbsX/4yzEr3\nCt3U+qceD1xtsOL9FJlu2AVHx2mcwuso8xkDV8eQJz6fOC9h1416nJGbPoKisD8uFz+JS1a/mzI2\nU4/qrgYcHxEJtHF08Xwa3X7jPuI9E7aiMFZ2fQ710Xf9GL+4046ragqVfzqnDdVtrci25D7WGLg1\nqhgnViTD09+A3/baUevuQ/14IPelzR2otjciO2UzLCaRp3TsvRfwS6oAnPcuKf7j6jKPKjsbUKkE\nFkHNd33bJSxNXIe4oD5cvUEXaGQBdiZRxe7+FRxvuYAj4+mfZrIM+pcLwZhL19EK1F87hm0+3SGy\nnOESSqmsng9bB9vzVmCqchBE7/89ev++WmS123ksnC0C05f5/cnvoDimEZV/pnu0XwRS70MhqPum\nHCWiAsumtSAtcHNoGqqSrIij522eqQKOAS+klFKQlcFbCA6BXj5dTRWDqsx1MngLcjwws8Cni9AU\nZsWHz3ml0xlhTi3Gnvg5tEKUMeNSFCfJ4C0oYzPrsSdjK8oeJ8e090z0GrcMjYE5rRi/iaXPkbuU\nsdBnfuabzpSF4vSNMMvN2aqnispVqlzpo9ei8LkSnHjxbbRYSnE50YqyMMpXmW5CGgrTc9XgLYhj\nT8xFeWq2bAUK4nvu8B1Xl3lUtjwbFGJ8mFMoeIu81MVgtblUDd7CEjqnUdxDA1ctVn7pH7xJ8HKY\nxfCHs1mt2FKZEedrymtqrBfdA/RXv9TrPDG2GMUgRdzsBzphn6L5eMbTS/+NQrx2/2XTmpcAbsl4\nRxn30B6fWIqQEy3G9C6hUmmZN2KLHB9f2SRqYkbERbhgb67CFpvcr7WGgy14Pz3TZ2xkpe0w9t5o\nhkeXjsK4NJGK6LAnjgJDsBttrVXYIN5HpoOBPtuH1+fTo7Jb7p5CTlSe0rL29FzEga/lmLHtA+xt\ntqNnRIeUUBGwtHF0etgvqV2e1CrS3l95eNU4i2MK5Htq45YHsebrGgquFJ+X/wjvhciE2lioy4ZK\n+dlKukHDeOVm1kZbke84hn03GuC4JyOEmGRILeLtz+/G76PVoDCBPmuwAUe8P18c4LJXsVObzxBM\nFyC1ph23a1CinT/bMXX8KjoNr8lkGk9PLfK/PIzjnfQ6nS+H4wNKfwp2ql2bDLEyFfMhKn0rNiPF\nTWWhr0vuZIyxCQvSAoe7D20dtShtmaaLGm7YWyh4i6VM/jWw8MxJYyMYG8ZJ58c4f4dinDEZeUrC\nNGSLxlvvRZTc6YJDvI+S7hSqZwjQMzMiz5QAPLiCIx0NqByWXc1jbpy8X4s1TadQ6pm6+3l6MXjN\n5D9uCfQMt2LbtzZ4kAyzrG+Mj4W2ncMB+dlKuja1kvDYxlyodl7EhhYKnMoEtmpU326FZ1SHuNQ8\nvK+19hV9qGu7iOOTPt8Ac7hsLY+2o7S9Gvn9A7AsseJ0YgG+yNhBlSv/ipPKcdeOqxiGY1DU5lpR\nN0CBfOwuumV9gvkJTsaJtBLkhDWiuukcjk/RSmGMsXkJ4P6z0Fdeq8Cr3X5jpj5c6B6cZhxWr7bI\nUp7d7dOqb3npLeQtoxdMiXIsm6IOfXunuxMOZXuCnSoQj8cAk2gND7Sict5umrGIF01c41qUZXkf\nDz0ys5SWtTbRTy+OCXQ8HmVzwhBViOTTuRMT2Nqxr7cGRTdbaTtB7c4a1wuH/7pj+fkmeW5EPu2J\n3wHb8/nICxvB12I+QfOvsPfW4+Y708Tp1+Lyc8Ww4goOXP8I+5Q5FxKdB1GRm3JiaBCVs0j667mH\nOnUPY4sU3U/EPS6S7uVTLBdTYwBV8P3vQ2yShWmBz4E6/kGt0Gt+lYLxhzYxjSoA1Jo1GRInjQ9b\nDI87ruqGU9wwI9PmcR1iL7rFXbf/HPKnPJ6D4xOSPOKYQMfj318eGoMU+XR2DNgeV4SzkcYpxrqp\n8qN8nr9YmP3HnuTnO5VzQ3lu3IydSQbUOyqwobcB+x50oX6E3itIGwtgs6dD8bIifJa5HkvvnMK2\n1otekwGlwZtwiGGHmKxJ5XP1kixYRM+V6+bcemsY+w78ztVO0ScTm5b49doFJaMghu7fg63qCgw2\no0UXwPGwEY5RI6xpW3FIb1Amwmk2haehMFjr723FFRH3YtejalkCzOKGFqRDoakAxfFKgsfgwhln\nFxCRjT1Ja7FdJz8ryIDCJbmwZRSjSpu05UVUJk2RZvpu6rb4Hpt0WsHsw6fOu0D0RnwYm4ZN3jke\nnICdhij1u5Pzys2Xjj1lM8rkZ8fp0nAiZd2UAfiv0lnwxjNpsJh/js8S6aYfKietie8XYUVVUjpV\ngppx5aGSWopBTsp67Jz0+W44HqoVjRylhhxCLcEo9fyIfKf8KUsWS9bYrAVF4VDyz7E/JRZtN8vx\nw65m1E/ZA9SKM91UloxrqXxmyfKmQ07Eeny4Qj2XdU7/5SCMLT71zit0nwdSVhThRIRRuY+YgmNw\nKKlA+Z0DZ/cVHFeTshmI0PH4ncUzLSPzMcUyLm9+ywzylpXgaNrUC/k9HTVY092qtDLELPTfrxIT\n2dTXNB63G3pD68zLyPyMH4MyY3yaJWLuRlRep/f0aRkl4ERGiVLofHgfU3A6zmYUwBKubvoYppvy\ntRrsUhrD6i9ybRcT2bzR8XgMBngeYxnZagPd3M1rKRDLHT7cdNzldNzqYLS6fMNI+Weg/FN2TRAT\n0drFWDYxbMS1VdmTJ9aJfAluxcmvarBXySM13yHz1vcnbuUSKfcUy6qeFvL6mJYsI2q+zNRrJJZd\nVqBEdCkqv8RWPLm8iQrWjQps4ADOnqRHLPOC+CW28mfTJ99HXA044Lg4j8OYT6/F1wInZ+5UYVvj\nJTjue81ycrXjajO1TmTwFpyD9XjzOqVzya5gsQ78VjWOdM/hJjbWh5KWYzhyqxlObQxGrHHuvogj\nTf7BW+hCqVjb3E8tI+01Su/RJsAJ1DLacr0c1Z1d8Pi/51+04C24ceDb36jptH1iHXjzhUnj/I/q\nqvsifvxNBao72uF0yzcdHYbnXiPOX5sI3hMoADfXwq7NWBffs7MWpR0yeAvuC9jlsKFHez95LAca\na6mVnobCF3egipeALIyxdmxzVOFkt1cZEb+F3lSBfA7eLIDUOU+hpKkBbeP3b3EfuYB9HLwf2dxa\n4Oyp4ttCZowxtpgtyhY4Y4wxxmbGAZwxxhgLQNyFzhhjjAUgboEzxhhjAYgDOGOMMRaAOIAzxhhj\nAYgDOGOMMRaAOIAzxhhjAYgDOGOMMRaAOIAzxhhjAYgDOGOMMRaAOIAzxhhjAYgDOGOMMRaAOIAz\nxhhjAYgDOGOMMRaAOIAzxhhjAWhu/zcy41a0ZGTKDS9Dd9HWcxlHeuw48wT+X2d50TtwNLUXlV9+\nhANy34QYVD27AzmmxmleX4wycfalrUi5VYGs/j657xG9HIauojDg2kPk/2oEn8vd4tSffs+IV+DG\nu78cRrnc+0QFGbFz2evYHp8Gk0FHO4bhud8Fe3ct3rx/Fz1qqqeWNdyK/UlrYV5ioC1x7K2o7/gY\nux664FSTqIIScOiZ1/GT6AToRTa52indaZS6/NIx9kTpcGj52ygc/QgrOxrlvmkEW/DJqlyY6VZl\nbzqILS65X8NlfkoL0wIPjUJKUi6OrrSiUFQRnmahVtheege26Bi5Y5FaFYrdqfL5fEnV4fqvI3H9\np/NwkoOoYrXyLexJTZfBW9BBvyQZq9NL8Vlq9lNdlgqjS3Aic50M3oI49nTkZO5AjVHLDxKUjBPm\nEhTGyxuZYEyGNWMHTpuMcgdjT5Yp2IBC43qsj5Y7ZqRDWfxGmEfd8Mg9PrjMT2teArioMa38cuKx\nwV6Dun43ncV1eCNCJlo0+lByQ3zPQGl9zxcdXskLoRb34mSO/BFyTICzsxZ7vzosy9JhbBFlqc8F\nz6AbVKKeTrps/NPyBMDdirrrx7BGHLvtMEqvN6Bn1ABLbBasMmlxTC6sdM/y9JyjfFLzqESmM694\nHft5UIw9SaJXVjRoXtyNQxnZiHuE8mgK34ji+Huou311ygDOZX56C3LojqFWlHTUK12eKfpF3jL9\nG9HdMkStcB1KKU4sRpbQKPpvM37bZcfJ0WF1J4ZhF2Wp7RiyOp/McMx3YXVEGuJH7qL+Zg1KHrjU\noYKxYZx/cBH/JUZMQvSIE/uQhrx4yidXA4502CifxL5h1FG6N28209VMLXZuhbNAQq3r8uVZcN4+\ng10eukdNwmV+JvMyBj7lmIVuLb54YT30yrhtrDKGa5EviVZwnb0af1ySi53PpMMUSrvuXkTpzQac\nVxOo44HLX4ZZ6T4chrPfht9+ewH7/M7xaoMV76fIdMMuODpO4xReR5nPGLg6hjzx+cR5Cbtu1OOM\n3PQRFIX9cbn4SVyy+t2G3ejpr0d1VwOOj4gE2ji6eD6Nbr9xH/GeCVtRGCu7gYb66Lt+jF/cacdV\nNYXKP53Thuq2VmRbcuc0Bt70Hw9wb3ME/r7lAb5fMYpb04yBp8YE44P/qccrK0PU6h1dVE21gyj9\ndAx/VlLIfzdTvezaQyT8SsmoR2aNKsaJFcnw9Dfgt7121Lr7UD8eyH1pcxyq7Y3ITtkMi0mcezpH\nvRfwS6oAnPcu0f7j6vJcVnY2oFK5GQhq+dC3XcLSxHWIC+rD1RunUB9ZgJ1JdKD3r+B4ywUcGU//\nHQjSYVP4q3jPvBamrhqs6WqFM2wdbM9TW3yqchBEx/A9KuN9tchqt/NYOFsE5H3X/17opTBmBw4t\nbcTelks4qbPCZlmHNu94wmV+RgvSAjeHpqEqyaq0Gto8UwUcA15IKaUgK4O3EBwCvXy6mioGVWI8\ncHzsTwdTdDaKMwt8uktMYVZ8+JxXOp0R5tRi7ImfQ41MGYstRXGSDN6CzoC4+PXYk7EVZY+TY9p7\nJnqN4YTGwJxWjN/E0ufIXSJfyp75mW86UxaK0zfCLDcf2+goTvyBaj9ZoTg4XSvcFIKadyLwSroM\n3oI+FBk/jcDpnwZjvofQvdVTheoqXbT66LUofK4EJ158Gy2WUlxOtKIsjM6/TDchDYXpuWrwFsQ5\nSsxFeWo2ctQ9ROTnDt9xdXkuy5Znj3dLa8wpFLzFOdfFYLW5VA3ewhIqe1HfTU+SqJyILsiWrLdR\n/lw29N212NVNwVu8SGVG5MOU19RYL7oH6K9+qdfxM7aIhVqxJxmou03Be7pmJJf5Gc1LALdk0A1H\n3HTk4xNLEXKiDUort1KpSTViizZG3iRqYkbERbhgb67CFpvcr7WGgy14Pz0T+tEu1HuNB+690QyP\nLh2FcWkiFdFhTxzdcIPdaGutwgbxPjIdDNpEII3X59OjslvunkJOVJ7Ssvb0XMSBr+VYrO0D7G22\no2dEh5RQEQi0cXR62C8pN1cn1RC191ceXjXO4pgC+Z7aGM5BrPm6hoIWxczlP8J7FC8VeisK4+m7\nu2yolJ+tpBs0jFdu5qLm3BD+/DAUP86bOhgf/Ec9MsLHcO+PD7D7XwaQ8E8DyP/Xh7j1MAhLX9MC\n/xjyf6m+lvC+G/doz71PXeq29phl61sx2op8xzHsu9EAxz052i0mQ1KLePvzu/H7aPVCnkB5MtiA\nI975JE7EslexU5t3ERyDFGpNO27XoEQrZ7ZjONlD7x+dhtdkMo2npxb5Xx7G8U56ncqVw/EBpT8F\n+yCdJ0OsTPVdooqLPoGOQW4y9tQw4mjSOui//Ri76Ppij2dBWuBw96GtoxalLdN0UcMNewsFb7FE\nyL/mFZ4JM32rtps12OY1HnjS+THO36EYZ0xGnpIwDdmiUdR7ESV3uuAQ76OkO4XqGQL0zIzIM1GU\nenAFRzoaUDksu3DH3Dh5vxZrmk6h1DN1t+70YvCayX8MB+gZbsW2b23wIBlmWd/YZFxBQcqF+rZz\nOCA/W0nXplYS5oxa4VWXp2uFB+P7qyjjuzx49/+MokbOJvm8ZQT5/yE2QvHi9xc4koy5UO28iA0t\nFDiVCWzVqL7dCs+oDnGpeXhf65VQ9KGu7SKOT8onA8zhsrU82o7S9mrk9w/AssSK04kF+CJjB1UC\n/St4KsddO65iGI5BUetsRd0ABfKxu+iW9Ynvwpl+WRHUJrEtXYuyFO9eBcYC32rT68gLa8Dx3va/\nya7v+TIvAdx/FvrKaxV4tdtvLNKHC92D04xv6tWWTsqzu31a9S0vvYW8ZfSCKVGOZdPdnL69090J\nh7I9wU4ViMdjEL3IwEArKqf97rMVi3jRdDTSjTjL+3jokZmltKy1iX56cUyg4/GfijlEFSL5dK5q\nzlIr3CNa4VqzXxMEg/gyd8ZQo+4Yd6ubWuX0Vx+ubn83xAS2duzrrUHRzVbappaoTzdELxz+c15k\nPplkGRLnc0/8Dtiez6ebxQi+FvMemn+Fvbcet3x8h+QktiPtd4FlWSgQXft0fOJmN+XE0CAqZ5H0\n13MPdeoexhan4Ey8tzx98j3Rsk7pZRvv0U3K5DL/VyxMC3wOznh66b/UCr3mVykYf2gT06gCQK1Z\nkyFx0viwxTDFyX4kbjhF729kGrbPW2OzF92iBPafQ/6Ux3NwfHKGRxwT6Hj8+8tDY5Ain86ZaIV/\nSpHve6H4vij848bgFhWHZUEoUneMS40PwlL663mobs8/A7bHFeFspNGvm1zlVPLFXyzM2hwFjcwn\np1KGqGwYN2NnkgH1jgps6G3AvgddqB+h9wryr7w8SQYcSn4L1zI3Y8+0ZU6nDqEM3oRDdOfHZE0q\nn6uXZMEieq5cN7lFwxa3ELpOw+Tzv4bL/IwWXQDHw0Y4Ro2wpm3FIb1BLp9RbQpPQ2Gw1o/aiisi\n7sWuR9WyBJjFyQ3SodBUgOJ4JcFjcOGMswuIyMaepLXYrpOfFWRA4ZJc2DKKUTX+IyMTRNwzRZrp\nu6nbygxindZN24dPndSKit6ID2PTsMk7x4MTsNMQpX53cl4piHTsKZtRJj87TpeGEylqzXS+KK3w\noRDofSoKo/jTNaoRJejx7v8IRpF8TcxGP/2PYmMIX/3Jr1tCxtWl5hCUaq1zOr4i75P2KHQWvPFM\nGizmn+OzRLpQQ+WkNZGPEVZUJVFtfbQZV3wqEDHISVmPnZPyyQ3HQ7VClKO0xEOo9h6lliNRPug8\nliWLJWuLhRu/ezAAfTgdNx3P+IQ98V2NG7FHfNfB27Ared2KM91UlqjlsicpS5Y3HXIi1uPDFWoe\n1Tn9l4MwtsgM1SNrioaMNp9ovEdXmUfEZX4mInQ8fmfxTMvIfEyxjMub3zKDvGUlOJo29VRpT0cN\n1shZuWIW+u9XiYls6msaj9sNvaF15mVkfsaPQZkxPs0SMXcjKq/Te/osJ0rAiYwS5YcGfHgfU3A6\nzmYUwDJVF/QwFdBrNdil3KANKEsqxXYxkc0bHY/HYIBnLsvIagbwyh/kPlL6UwPefY2CX5/XMjJT\nCD7/ZTgyJn3PMdz79CF+/J9i+Zm3YHx8MAJ/759Xj7GMbLWBLkjzWgrEcocPN52fcjo/6mC0uozM\nSOfZQOdZ2TVBTERrF2PZxLAR11ZlT54AKM5fcCtOflWDvcq5VMsHZBnw/SleuWTQ/Qg/B/m4Zipz\nfseu/ipV8eTyJiouNyqwgQM4e5Km+3ltzQxLypRftfRfRiZwmZ+WX+hbHM7cqcK2xktw3PeaPeRq\nx9XmcvxQW1JDnIP1ePM6pXPJpqBYB36rGke653BCx/pQ0nIMR241w6mNsYq1w90XcaTJP3gLXSgV\na4b7qZaovUbpPdoEOIFqiVuul6O6s0ssq1Zp7/kXLXgLbhz49jdqOm2fWAfefGHSOP9clVMrvMl/\nrN05gqKDD/B5MwVf7VjEOvD/fID8ScFbGEXpvz7A/7vtlX50BJ6B2dcJr7ov4sffVKC6ox1Otzz4\n0WF47jXi/DWvADaOAnBzLezajHWRn521KO2QwVtwX8Auhw092vvJPD/QWEut9DQUvrgDVf7d8E+C\nVuZaGye+K+SxN1agyPvYx9qxzVGFk91eZUT8LnRTBfI5eLOnEZf5ac2tBc7YEzDz/6yGMcb+NizK\nFjhjjDHGZsYBnDHGGAtA3IXOGGOMBSBugTPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4gDPG\nGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4\ngDPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wxFoA4gDPGGGMBiAM4Y4wx\nFoA4gDPGGGMBiAM4Y4wxFoA4gDPGGGMBKDgmNhGhoWFykzHGGGOBIOjHG//7mHzOGGOMsQDBXeiM\nMcZYwAH+P9a4dZRWiUdRAAAAAElFTkSuQmCC\n"
    }
   },
   "cell_type": "markdown",
   "id": "27877e30-19eb-4027-a044-d4811c2d3170",
   "metadata": {},
   "source": [
    "###  Provide an example of a confusion matrix and explain how precision, recall, and F1 score can be calculated from it.\n",
    "\n",
    "In the example, we are classifying whether emails are \"spam\" or \"not spam.\"\n",
    "\n",
    "Assume we have the following confusion matrix:\n",
    "\n",
    "![cm1.png](attachment:b4c609fb-62de-4011-9205-4ae8dd9329f5.png)\n",
    "\n",
    "Here's how to calculate precision, recall, and the F1 score using this confusion matrix:\n",
    "\n",
    "1. **Precision:**\n",
    "   Precision measures the proportion of true positive predictions among all positive predictions made by the model.\n",
    "\n",
    "   Precision = TP / (TP + FP) = 120 / (120 + 30) = 0.8\n",
    "\n",
    "   In this example, the precision is 0.8 or 80%. It means that out of all the emails predicted as \"spam,\" 80% of them were actually \"spam.\"\n",
    "\n",
    "2. **Recall (Sensitivity or True Positive Rate):**\n",
    "   Recall measures the proportion of true positive predictions among all actual positive instances in the dataset.\n",
    "\n",
    "   Recall = TP / (TP + FN) = 120 / (120 + 10) = 0.923\n",
    "\n",
    "   In this example, the recall is approximately 0.923 or 92.3%. It indicates that the model correctly identified 92.3% of all actual \"spam\" emails.\n",
    "\n",
    "3. **F1-Score:**\n",
    "   The F1-Score is the harmonic mean of precision and recall and provides a balance between the two metrics.\n",
    "\n",
    "   F1-Score = 2 * (Precision * Recall) / (Precision + Recall)\n",
    "\n",
    "   F1-Score = 2 * (0.8 * 0.923) / (0.8 + 0.923) ≈ 0.857\n",
    "\n",
    "   In this example, the F1-Score is approximately 0.857. It balances the trade-off between precision and recall. A higher F1-Score indicates a model that performs well in terms of both precision and recall."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b0fdbee6-1338-4ead-a83c-c115761c74e2",
   "metadata": {},
   "source": [
    "### Discuss the importance of choosing an appropriate evaluation metric for a classification problem and explain how this can be done.\n",
    "\n",
    "Why it's important to choose the right evaluation metric and how we can do it:\n",
    "\n",
    "**1. Understanding the Problem:**\n",
    "   - The first step in choosing an appropriate metric is understanding the specific classification problem we're trying to solve.\n",
    "   - Consider the domain and application of our problem. Are false positives or false negatives more critical? Does one class need to be prioritized over the other?\n",
    "\n",
    "**2. Importance of Different Errors:**\n",
    "   - Different classification errors may have varying consequences. For example, in a medical diagnosis scenario, a false negative (missing a disease) can be more critical than a false positive (incorrectly diagnosing a disease).\n",
    "   - Understand the cost or impact of each type of error in our problem, and choose a metric that aligns with our priorities.\n",
    "\n",
    "**3. Common Classification Metrics:**\n",
    "   - There are several common evaluation metrics for classification problems, including:\n",
    "     - **Accuracy:** Measures the overall correctness of predictions. Suitable when the class distribution is balanced.\n",
    "     - **Precision:** Measures the ability to correctly identify positive instances. Use when false positives are costly.\n",
    "     - **Recall (Sensitivity or True Positive Rate):** Measures the ability to capture all positive instances. Use when false negatives are costly.\n",
    "     - **Specificity (True Negative Rate):** Measures the ability to correctly identify negative instances.\n",
    "     - **F1-Score:** Balances precision and recall and is useful when we want a harmonic mean of the two metrics.\n",
    "     - **Area Under the ROC Curve (AUC-ROC):** Measures the model's ability to discriminate between classes, especially in imbalanced datasets.\n",
    "     - **Area Under the Precision-Recall Curve (AUC-PR):** Measures precision and recall across different probability thresholds.\n",
    "\n",
    "**4. Model Goals and Trade-offs:**\n",
    "   - Consider the goals of your model. Are we aiming for a high true positive rate, or do want to minimize false positives?\n",
    "   - Understand the trade-offs between different metrics. Improving one metric may come at the expense of another.\n",
    "\n",
    "**5. Data Distribution:**\n",
    "   - Assess the class distribution in your dataset. If it's highly imbalanced, accuracy may not be an appropriate metric, and we might need to focus on precision, recall, or AUC-ROC instead.\n",
    "\n",
    "**6. Use Case Examples:**\n",
    "   - Here are some examples of when to use specific metrics:\n",
    "     - Use **precision** when identifying fraudulent transactions to minimize false alarms.\n",
    "     - Use **recall** when screening for diseases to minimize missed cases.\n",
    "     - Use **AUC-ROC** or **AUC-PR** when ranking documents in information retrieval tasks.\n",
    "\n",
    "**7. Validation and Cross-Validation:**\n",
    "   - Evaluate model using appropriate validation techniques like cross-validation to ensure that the chosen metric reflects the model's generalization performance on unseen data.\n",
    "\n",
    "**8. Multiple Metrics:**\n",
    "   - In some cases, it may be beneficial to use multiple metrics to get a comprehensive view of model performance. For example, we can use a combination of precision, recall, and F1-Score to assess a model's performance from different angles."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c508f5d0-c3c6-4acc-9609-2e77d19c9bdf",
   "metadata": {},
   "source": [
    "###  Provide an example of a classification problem where precision is the most important metric, and explain why.\n",
    "\n",
    "An example of a classification problem where precision is the most important metric is in the context of email spam detection. In this scenario, we want to build a classifier that can accurately identify spam emails while minimizing false positives (i.e., legitimate emails incorrectly classified as spam). Precision is crucial in this case because a high precision means that the majority of the emails classified as spam are indeed spam, reducing the chances of important or legitimate emails being mistakenly marked as spam.\n",
    "\n",
    "Here's why precision is the most important metric in email spam detection:\n",
    "\n",
    "1. **Cost of False Positives:** In email spam detection, the cost of false positives can be high. When a legitimate email (e.g., an important work-related message or a personal communication) is classified as spam and moved to the spam folder or deleted, it can lead to missed opportunities, misunderstandings, and frustration for users.\n",
    "\n",
    "2. **User Experience:** False positives can harm the user experience by causing users to miss important emails. This can lead to a lack of trust in the email system and dissatisfaction with the email service.\n",
    "\n",
    "3. **Compliance and Legal Implications:** In some cases, incorrectly classifying certain emails as spam can have legal or compliance-related consequences. For example, regulatory agencies or legal authorities may require that certain types of emails (e.g., financial statements, legal notices) are not treated as spam.\n",
    "\n",
    "4. **Spam Filtering Customization:** Many email services allow users to customize their spam filters to some extent. Users can mark emails as spam or not spam, which helps improve the accuracy of the filtering system. However, if false positives are common, users may become hesitant to mark emails as spam, making it challenging to improve the filtering system.\n",
    "\n",
    "5. **Overall System Reputation:** Email service providers strive to maintain a good reputation for their email delivery services. High false positive rates can result in emails from the provider being marked as spam by other email services, affecting their reputation and deliverability.\n",
    "\n",
    "Given these considerations, in email spam detection, it's essential to prioritize precision to minimize the chances of false positives. This ensures that legitimate emails are not mistakenly treated as spam, preserving the user experience, compliance, and the overall reputation of the email service."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9c2c8b0d-b7f4-4c57-99f1-5294ca8fe1ec",
   "metadata": {},
   "source": [
    "###  Provide an example of a classification problem where recall is the most important metric, and explain why.\n",
    "\n",
    "An example of a classification problem where recall is the most important metric is in the context of medical testing for a rare and life-threatening disease, such as a certain type of cancer. In such cases, it's crucial to prioritize recall to ensure that the model correctly identifies as many true positive cases as possible, even if it means accepting a higher number of false positives. Here's why recall is of utmost importance in this scenario:\n",
    "\n",
    "1. **Life-Threatening Consequences:** In medical diagnosis, especially for rare and serious diseases, the consequences of missing a true positive case (false negative) can be severe. For instance, if a cancer diagnosis is missed, it could lead to delayed treatment, reduced chances of survival, and significant harm to the patient.\n",
    "\n",
    "2. **Early Detection:** Detecting the disease at an early stage often leads to more effective treatment and better patient outcomes. A high recall ensures that a higher percentage of cases at risk are detected early, potentially saving lives.\n",
    "\n",
    "3. **Risk Mitigation:** Medical professionals often prioritize a conservative approach when it comes to diagnosing rare and serious diseases. It's preferable to conduct additional tests or evaluations to rule out false positives than to miss a genuine case.\n",
    "\n",
    "4. **Patient Well-Being:** The emotional and psychological impact of a false negative diagnosis on patients and their families can be substantial. False negatives can lead to anxiety, stress, and distrust in the medical system.\n",
    "\n",
    "5. **Public Health Considerations:** In the case of contagious diseases or public health emergencies, identifying as many true cases as possible (even with some false positives) is critical to implementing containment measures and preventing the spread of the disease.\n",
    "\n",
    "6. **Resource Allocation:** Healthcare resources, such as medical professionals' time, diagnostic tests, and treatment facilities, can be scarce and expensive. Maximizing recall helps allocate resources more effectively to individuals who need further evaluation or treatment.\n",
    "\n",
    "In medical diagnostics, a high recall indicates that the model is effective at identifying most of the positive cases, reducing the risk of missing critical diagnoses. While a higher recall may lead to more false positives, these can be further evaluated through additional testing and medical expertise. Overall, prioritizing recall in this context is essential for patient safety, early intervention, and better health outcomes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "be0df672-7321-41cb-abcf-95e5e207800e",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}