What is the relationship between regularization terms and prior terms in linear classification? How do you estimate a regularization term?
-
I am working on linear classification. To reduce the overfitting problem, this method adds regularization terms. My question is: what is the relationship between regularization terms and prior terms? How to estimate regularization term?
-
Answer:
Regularization Regularization are independent of the data itself, and aim to reduce the magnitude of the parameters "weights" of every feature. It is shown as theta below. This way, even if there are a lot of features, any one feature doesn't have doesn't overbear the others. This may increase the variance, but also keeps the model from overfitting the data. Specific types of Regularization methods are called L1 (Lasso) regularization and L2 reg.
Kaushik Kasi at Quora Visit the source
Related Q & A:
- How do I audit a policy document? What areas should I look at and how should it be written?Best solution by Yahoo! Answers
- How do you become a marine mammal vet and what exactly do they do?Best solution by Yahoo! Answers
- What is a good term for a search on Google?Best solution by wiki.answers.com
- How do i become a financial analyst? What is a financial analyst?Best solution by Yahoo! Answers
- What is a literary term for a dramatic beginning?Best solution by answers.yahoo.com
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.