The deep neural networks with different activation functions are characterized by a different value of the scaling factor. Its product with the network depth plays a pivotal role in whether we can ...