Why is rotation of components so important in Principle Component Analysis (PCA)?

 - Methods to deal with outliers include removing them, transforming data (e.g., log transformation), or using robust statistical techniques like the median instead of the mean.