{"id":2308,"date":"2025-06-11T10:47:07","date_gmt":"2025-06-11T05:17:07","guid":{"rendered":"https:\/\/texpertssolutions.com\/notes\/?p=2308"},"modified":"2025-06-26T14:53:31","modified_gmt":"2025-06-26T09:23:31","slug":"what-to-do-when-my-ml-model-is-underfitted","status":"publish","type":"post","link":"https:\/\/texpertssolutions.com\/notes\/2025\/06\/11\/what-to-do-when-my-ml-model-is-underfitted\/","title":{"rendered":"What to do when my ML model is underfitted?"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\ud83d\ude15 What is Underfitting (Quick Reminder)?<\/h2>\n\n\n\n<p>Your model <strong>hasn\u2019t learned enough<\/strong> from the training data \u2014 it\u2019s <strong>too simple<\/strong> to capture the patterns.<\/p>\n\n\n\n<p>\ud83d\udcd8 Like a student who didn\u2019t study enough<br>\u274c Fails both practice and final exams<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udee0\ufe0f What To Do When Your Model is Underfitted?<\/h2>\n\n\n\n<p>Here\u2019s your <strong>toolbox<\/strong> to fix it \ud83d\udd27\ud83e\uddf0\ud83d\udc47<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">1. \ud83e\udde0 <strong>Use a More Complex Model<\/strong><\/h3>\n\n\n\n<p>Your model might be <strong>too basic<\/strong>!<\/p>\n\n\n\n<p>\u2705 Add more:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Layers or neurons (for neural networks) \ud83e\uddf1<\/li>\n\n\n\n<li>Depth or estimators (for decision trees, random forests) \ud83c\udf32<\/li>\n\n\n\n<li>Features (inputs) that matter \ud83c\udfaf<\/li>\n<\/ul>\n\n\n\n<p>\ud83d\udd01 Let it learn <strong>richer patterns<\/strong>!<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">2. \ud83c\udfcb\ufe0f\u200d\u2642\ufe0f <strong>Train for More Epochs<\/strong><\/h3>\n\n\n\n<p>Your model may need more time to learn!<\/p>\n\n\n\n<p>\u23f3 If training and validation loss are <strong>still high<\/strong>, let it run longer.<\/p>\n\n\n\n<p>\ud83d\udcc8 Keep training until it starts learning better!<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">3. \ud83c\udfaf <strong>Reduce Regularization<\/strong><\/h3>\n\n\n\n<p>Too much regularization = your model stays too simple \ud83d\ude13<\/p>\n\n\n\n<p>\u2705 Try:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Lower dropout rate (e.g., from 0.5 \u27a1\ufe0f 0.3)<\/li>\n\n\n\n<li>Reduce L1\/L2 penalty strength (make lambda smaller)<\/li>\n<\/ul>\n\n\n\n<p>Let your model have more freedom to learn! \ud83e\udde0\ud83d\udca1<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">4. \ud83d\udcc8 <strong>Improve Feature Engineering<\/strong><\/h3>\n\n\n\n<p>Sometimes, the model is okay \u2014 but the <strong>input data is not helpful<\/strong>.<\/p>\n\n\n\n<p>\u2705 Try:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Creating new features (ratios, averages, etc.)<\/li>\n\n\n\n<li>Removing noisy\/irrelevant ones<\/li>\n\n\n\n<li>Using domain knowledge to add meaning \ud83c\udf10<\/li>\n<\/ul>\n\n\n\n<p>Better features = smarter learning! \ud83e\uddee\u2728<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">5. \ud83d\udd27 <strong>Tune Hyperparameters<\/strong><\/h3>\n\n\n\n<p>Use a tool like <strong>Grid Search<\/strong> or <strong>Random Search<\/strong> to try different settings:<\/p>\n\n\n\n<p>\u2705 Try different:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Learning rates \ud83d\udd22<\/li>\n\n\n\n<li>Activation functions (ReLU, Tanh, etc.) \ud83d\udd0c<\/li>\n\n\n\n<li>Optimizers (Adam, SGD, etc.) \u2699\ufe0f<\/li>\n<\/ul>\n\n\n\n<p>It\u2019s like adjusting recipe ingredients for the perfect dish \ud83c\udf72\ud83d\ude0b<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">6. \ud83d\udd01 <strong>Try Different Architectures or Models<\/strong><\/h3>\n\n\n\n<p>Sometimes switching models helps a lot!<\/p>\n\n\n\n<p>\u2705 Example:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Switch from <strong>linear regression \u27a1\ufe0f decision tree<\/strong><\/li>\n\n\n\n<li>Or from <strong>shallow network \u27a1\ufe0f deep neural network<\/strong><\/li>\n<\/ul>\n\n\n\n<p>Try what fits your data best! \ud83e\udde9<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\">\u2705 Summary Table:<\/h3>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Fix<\/th><th>Why It Helps<\/th><th>Emoji<\/th><\/tr><\/thead><tbody><tr><td>\ud83e\udde0 More Complex Model<\/td><td>Learns deeper patterns<\/td><td>\ud83e\uddf1<\/td><\/tr><tr><td>\u23f3 Train Longer<\/td><td>Gives model more time<\/td><td>\ud83d\udd52<\/td><\/tr><tr><td>\ud83e\uddfd Reduce Regularization<\/td><td>Allows more learning freedom<\/td><td>\ud83c\udfaf<\/td><\/tr><tr><td>\ud83e\uddee Better Features<\/td><td>Makes data more meaningful<\/td><td>\ud83d\udd0d<\/td><\/tr><tr><td>\ud83d\udd27 Tune Hyperparameters<\/td><td>Finds better model settings<\/td><td>\u2699\ufe0f<\/td><\/tr><tr><td>\ud83d\udd04 Try Other Models<\/td><td>Some models fit better<\/td><td>\ud83d\udd01<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\ud83d\ude15 What is Underfitting (Quick Reminder)? Your model hasn\u2019t learned enough from the training data \u2014 &hellip; <a title=\"What to do when my ML model is underfitted?\" class=\"hm-read-more\" href=\"https:\/\/texpertssolutions.com\/notes\/2025\/06\/11\/what-to-do-when-my-ml-model-is-underfitted\/\"><span class=\"screen-reader-text\">What to do when my ML model is underfitted?<\/span>Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":2352,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[641],"tags":[],"class_list":["post-2308","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-machine-learning"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/texpertssolutions.com\/notes\/wp-content\/uploads\/2025\/06\/9.png?fit=1280%2C720&ssl=1","jetpack-related-posts":[],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/posts\/2308","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/comments?post=2308"}],"version-history":[{"count":2,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/posts\/2308\/revisions"}],"predecessor-version":[{"id":2369,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/posts\/2308\/revisions\/2369"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/media\/2352"}],"wp:attachment":[{"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/media?parent=2308"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/categories?post=2308"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/texpertssolutions.com\/notes\/wp-json\/wp\/v2\/tags?post=2308"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}