Tuesday, March 31, 2020

Answer for Introduction to TensorFlow 2 – Model layout: learning rate, input size not specified

https://365datascience.com/dwqa-answer/answer-for-introduction-to-tensorflow-2-model-layout-learning-rate-input-size-not-specified/ -

Hi JeanMichel,

Thanks for reaching out and very good questions indeed!

TensorFlow 2.0 can now automatically detect that and there is no need to explicitly write it. However, sometimes (especially when dealing with CNNs) we need to preprocess the input layer in some way. Therefore, it is a good practice to specify it.

Regarding the learning rate, since we are using Adam, the initial learning rate is mostly irrelevant. The algorithm will find (adapt) the best learning rate for each weight individually!

Best,
Iliya




#365datascience #DataScience #data #science #365datascience #BigData #tutorial #infographic #career #salary #education #howto #scientist #engineer #course #engineer #MachineLearning #machine #learning #certificate #udemy

No comments:

Post a Comment