Skip to content

validation data is getting better accuracy and lower loss, than training data #2416

Answered by Mattral
CareNetAI asked this question in General
Discussion options

You must be logged in to vote

This indicates the presence of high bias in your dataset. It is underfitting. The solutions to issue are:-

  • Probably the network is struggling to fit the training data. Hence, try a little bit bigger network.

  • Try a different Deep Neural Network. I mean to say change the architecture a bit.

  • Train for longer time.

  • Try using advanced optimization algorithms.

  • Make sure the is small class imbalance

  • This happens when you use Dropout, since the behaviour when training and testing are different.

When training, a percentage of the features are set to zero (50% in your case since you are using Dropout(0.5)). When testing, all features are used (and are scaled appropriately). So the mod…

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@CareNetAI
Comment options

Answer selected by CareNetAI
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants