Lisan al-Data

Regularization in Logistic Regression: Same Idea, Different Function

Feb 18, 20251 min read

Well, still similar to the Regularization applied to linear, the regularized cost function for logistic regression is defined by: $$J(\mathbf{w}, b) =...

Regularization in Logistic Regression: Same Idea, Different Function

The Balancing Act: Choosing the Right Lambda in Regularization (Linear Regression)

Feb 18, 20251 min read

Since we can't be sure which of the parameter to penalize, we penalize all by adding the Regularization term to the cost function. A regularized cost...

The Balancing Act: Choosing the Right Lambda in Regularization (Linear Regression)

Shrink the Weights, Save the Model: A Quick Look at Regularization

Feb 17, 20251 min read

So, to simply put, Regularization is just simply making your parameters smaller and relatively less effective to avoid overfitting. oh, and the...

Shrink the Weights, Save the Model: A Quick Look at Regularization

Overfitting? Fear Not, There’s a Way Out!

Feb 14, 20251 min read

I bring thee good news. There are ways of mitigating overfitting! Collect more training data. (but, but, but sometimes, collecting more data can be...

Overfitting? Fear Not, There’s a Way Out!

Underfitting, Overfitting—And Finally Recovering

Feb 13, 20251 min read

So I have not been feeling well, but thankfully I just recovered. I'm just going to give a summary of what I have learnt so far. Underfitting: This...

Underfitting, Overfitting—And Finally Recovering

Logistic Regression: When a Line Learns to Decide

Feb 8, 20252 min read

I found Logistic Regression really interesting and it was quick for me to understand--I think that is largely because Linear Regression has created a...

Logistic Regression: When a Line Learns to Decide