Wednesday, July 29, 2020

Answer for How many nodes should exist within a hidden layer of a neural network?

https://365datascience.com/dwqa-answer/answer-for-how-many-nodes-should-exist-within-a-hidden-layer-of-a-neural-network/ -

Hi John,

Thanks for reaching out.

The number of nodes in a hidden layer can vary. There is no “rule” to determine it.

There is one big consideration though! If you have 5 input nodes and you have 2 nodes in the consequent hidden layer, you are not creating information, you are decreasing the dimensionality of the problem (thus losing information). Therefore, in general, we want to have more hidden nodes in the hidden layers than there are nodes in the input layer. 

This is also the reason why in all pictures we represent the hidden layers with more nodes than the input layer.

Best,

Iliya




#365datascience #DataScience #data #science #365datascience #BigData #tutorial #infographic #career #salary #education #howto #scientist #engineer #course #engineer #MachineLearning #machine #learning #certificate #udemy

No comments:

Post a Comment