Hands-On Machine Learning with Scikit-Learn & TensorFlow Exercise Q&A Chapter08

Q1. What are the main motivations for reducing a dataset's dimensionality? What are the main drawbacks?

A1:  

Motivations:

• To speed up a subsequent training algorithm.
• To visualize the data and gain insights on the most important features.
• Simply to save space like compression.

Drawbacks:

• Some information is lost, possibly degrading the performance of subsequent training algorithms.
• It can be computationally intensive.
• It adds some complexity to your Machine Learning pipelines.
• Transformed features are often hard to interpret or reconstruct.

 

Q2. What is the curse of dimensionality?

A2: The curse of dimensionality is the fact that many problems that do not exist in low-dimensional space arise in high-dimensional space. 

 

Q3. Once a dataset's dimensionality has been reduced, is it possible to reverse the operation? If so, how? If not,