Deep Learning and Reinforcement Learning Week 5 All Quiz

Practice: Transfer Learning 

1. The main idea of transfer learning of a neural network is:

A) To keep the early layers of a pre-trained network and re-train the later layers for a specific application.
B) To use the early layers to capture features that are more particular to the specific data you are trying to classify.
C) To train the early layers such that their weights have a higher impact on the final result.
D) To re-train the early layers for a specific application and transfer it to a different data set

ANSWER= (A) To keep the early layers of a pre-trained network and re-train the later layers for a specific application.

 

2. In the context of transfer learning, which is a guiding principle of fine tuning?

A) Fine tuning the hyperparameters of the CNNs
B) Using data that is similar to the pre-trained network
C) Adjust the weights of the neural network
D) Increase the number of later layers iteratively

ANSWER= (B) Using data that is similar to the pre-trained network

 

3. In the context of transfer learning, what do we call the process in which you only train the last or a few layers instead of all layers of a neural network?

A) Frozen layers
B) Frozen weights
C) Updated learning
D) Updated layers

ANSWER= (A) Frozen layers

Practice: Convolutional Neural Network Architectures  

1. This concept came as a solution to CNNs in which each layer is turned into branches of convolutions:

A) Inception
B) Workload portion
C) Hebbian Principle
D) Network Concatenation

ANSWER= (A) Inception

 

2. Which CNN Architecture is considered the flash point for modern Deep Learning?

A) AlexNet
B) VGG
C) Inception
D) ResNet
E) LeNet

ANSWER= (A) AlexNet

 

3. Which CNN Architecture can be described as a "simplified, deeper LeNet" in which the more layers, the better?

A) Deep Lenet
B) AlexNet
C) VGG
D) Inception
E) ResNet

ANSWER= (C) VGG

4. Which CNN Architecture is the precursor of using convolutions to obtain better features and was first used to solve the MNIST data set?

A) AlexNet
B) VGG
C) Inception
D) ResNet
E) LeNet

ANSWER= (E) LeNet

 

5. The motivation behind this CNN Architecture was to solve the inability of deep neural networks to fit or overfit the training data better when adding layers.

A) LeNet
B) AlexNet
C) VGG
D) Inception
E) ResNet

ANSWER= (E) ResNet

 

6. This CNN Architecture keeps passing both the initial unchanged information and the transformed information to the next layer.

A) LeNet
B) AlexNet
C) VGG
D) Inception
E) ResNet

ANSWER= (E) ResNet

 

7. Which activation function was notably used in AlexNet and contributed to its success?

A) ReLU (Rectified Linear Unit)
B) Sigmoid
C) Tanh
D) Leaky ReLU

ANSWER= (A) ReLU (Rectified Linear Unit)

 

Practice: Regularization  

1. Which regularization technique can shrink the coefficients of the less important features to zero?

A) L2
B) Dropout
C) Batch Normalization
D) L1

ANSWER= (D) L1

 

2. (True/False) Batch Normalization tackles the internal covariate shift issue by always normalizing the input signals, thus accelerating the training of deep neural nets and increasing the generalization power of the networks.

A) True
B) False

ANSWER= (A) True

 

3. Regularization is used to mitigate which issue in model training?

A) Underfitting
B) High bias and low variance
C) Overfitting
D) Both underfitting and overfitting

ANSWER= (C) Overfitting

 

Week 5 Final Quiz  

1. (True/False) In Keras, the Dropout layer has an argument called rate, which is a probability that represents how often we want to invoke the layer in the training.

A) True
B) False

ANSWER= (B) False

 

2. What is a benefit of applying transfer learning to neural networks?

A) Train early layers for specific applications and generalize that with later pre-trained layers.
B) Save early layers for generalization before re-training later layers for specific applications.
C) Easily adjust weights of early layers to reduce training time.
D) Place heavy focus on training layers that generalize the model.

ANSWER= (B) Save early layers for generalization before re-training later layers for specific applications.

 

3. By setting ` layer.trainable = False` for certain layers in a neural network, we____

A) set the layers’ weights to zero
B) exclude the layers during training because they should be discarded
C) freeze the layers such thattheir weights change synchronously during training.
D) freeze the layers such that their weights don’t update during training.

ANSWER= (D) freeze the layers such that their weights don’t update during training.

 

4.Which option correctly orders the steps of implementing transfer learning?
1. Freeze the early layers of the pre-trained model.
2. Improve the model by fine-tuning.
3. Train the model with a new output layer in place.
4. Select a pre-trained model as the base of our training.

A) 3, 1, 2, 4
B) 3, 2, 4, 1
A) 4, 2, 3, 1
B) 4, 1, 3, 2

ANSWER= (B) 4, 1, 3, 2

 

5. Given a 100x100 pixels RGB image, there are _____ features.

A) 300
B) 100
C) 30000
D) 10000

ANSWER= (C) 30000

 

6. Before a CNN is ready for classifying images, what layer must we add as the last?

A) Dense layer with the number of units corresponding to the number of classes
B) Flattening layer with the number of units corresponding to the number of classes
C) Flattening layer with the number of units corresponding to (number of classes*input size)
D) Dense layer with the number of units corresponding to (number of classes*input size)

ANSWER= (A) Dense layer with the number of units corresponding to the number of classes

 

7. In a CNN, the depth of a layer corresponds to the number of:

A) filters applied
B) input layers
C) channel-filter combinations
D) color channels

ANSWER= (A) filters applied