Regression Metrics
Machine Learning
Performance Metrics
Interview questions on Performance Metrics.
118 questions
Regression Metrics
Q2. Write down mathematical expression of MSE?
Regression Metrics
Q3. What are benefits of using MSE as loss function?
Regression Metrics
Q4. State the range of MSE?
Regression Metrics
Q5. How can we interpret mse value?
Regression Metrics
Q6. What value MSE encode?
Regression Metrics
Q7. Why do we square the differences in MSE?
Regression Metrics
Q8. What is the significance of a low MSE value?
Regression Metrics
Q9. How can you minimize MSE in a machine learning model?
Regression Metrics
Q10. What are weaknesses of mean-squared error(mse)?
Regression Metrics
Q11. Write the expression for Root Mean Squared Error(RMSE)?
Regression Metrics
Q12. What is the benefit of using RMSE over MSE?
Regression Metrics
Q13. What are weaknesses of RMSE?
Regression Metrics
Q14. Write the mathematical expression for Mean Absolute Error(MAE)?
Regression Metrics
Q15. What is the benefit of using MAE over RMSE or MSE?
Regression Metrics
Q16. State one drawback of using MAE over RMSE or MSE?
Regression Metrics
Q17. What is the difference between MSE and RMSE (Root Mean Square Error)?
Regression Metrics
Q18. What is Mean Absolute Percentage Error (MAPE), and how is it calculated?
Regression Metrics
Q19. Why might MAPE be misleading if the actual values of the target variable are very small?
Regression Metrics
Q20. In which scenarios would MAPE be preferred over metrics like RMSE or MAE?
Regression Metrics
Q21. How does MAPE handle negative values in the actual data, and why might this be problematic?
Regression Metrics
Q22. Can MAPE be used to evaluate a model’s performance if the target variable contains zero values?
Regression Metrics
Q23. What are the benefits of using MAPE in a business context, and what potential pitfalls should be considered?
Regression Metrics
Q24. How does MAPE handle asymmetric errors, and what might be the implications for model evaluation?
Regression Metrics
Q25. What is R-squared ($R^2$)?
Regression Metrics
Q26. When R-squared is more suitable to use?
Regression Metrics
Q27. What is the range of R-squared values?
Regression Metrics
Q28. What does an R-squared value of 0.75 mean?
Regression Metrics
Q29. State the expression for R-squared?
Regression Metrics
Q30. Can R-squared be negative?
Regression Metrics
Q31. What are the benefits of using R-squared as performance indicator?
Regression Metrics
Q32. How do you interpret R-squared?
Regression Metrics
Q33. What are the limitations of R-squared?
Regression Metrics
Q34. When should you use R-squared as an evaluation metric?
Regression Metrics
Q35. Why do we need adjusted R-squared instead of standard R-squared?
Regression Metrics
Q36. What is the expression of adjusted R-squared?
Regression Metrics
Q37. What is the limitation of adjusted R-squared?
Regression Metrics
Q38. What is pearson correlation?
Regression Metrics
Q39. Write the expression of pearson correlation $\rho$?
Regression Metrics
Q40. What is the range of pearson correlations?
Regression Metrics
Q41. State the weakness of pearson correlation?
Regression Metrics
Q42. What is spearman correlation?
Regression Metrics
Q43. What is the benefit of using spearman correlation over pearson correlation?
Regression Metrics
Q44. Write the formula of spearman correlation?
Regression Metrics
Q45. How can you compute the spearman correlation between two variable $X$ and $Y$?
Regression Metrics
Q46. How to interpret spearman correlation values?
Regression Metrics
Q47. State the one scenario where spearman correlation is more appropriate than pearson coefficients?
Regression Metrics
Q48. What is the limitation of spearman correlation?
Regression Metrics
Q49. How can we handle asymmetric errors?
Classification Metrics
Q50. What metrics we can use to evaluate a classifier?
Classification Metrics
Q51. What is the purpose of a confusion matrix?
Classification Metrics
Q52. Explain True Positive (TP) and False Positive (FP).
Classification Metrics
Q53. Define True Negative (TN) and False Negative (FN).
Classification Metrics
Q54. How can you use a confusion matrix to choose an appropriate threshold for a binary classifier?
Classification Metrics
Q55. Define accuracy score?
Classification Metrics
Q56. Write the mathematical expression of accuracy score?
Classification Metrics
Q57. What is the range of accuracy score?
Classification Metrics
Q58. How does accuracy is related with negative log(logistic) loss?
Classification Metrics
Q59. What is the main issue with accuracy score?
Classification Metrics
Q60. How can we overcome with accuracy score limitations?
Classification Metrics
Q61. What do you mean by precision? How can we calculate it?
Classification Metrics
Q62. When precision is preferred?
Classification Metrics
Q63. What is the range of precision value?
Classification Metrics
Q64. What are the weaknesses of precision as a metric in classification, and how can it be misleading in certain scenarios?
Classification Metrics
Q65. State one scenario where you should use precision of the system as evaluation metric?
Classification Metrics
Q66. What is the other name of recall?
Classification Metrics
Q67. Define recall score?
Classification Metrics
Q68. What does recall measures? How is it calculated?
Classification Metrics
Q69. What does higher value of recall indicates?
Classification Metrics
Q70. When should we use recall?
Classification Metrics
Q71. What is the range of recall metric?
Classification Metrics
Q72. What is the main limitation of recall metric?
Classification Metrics
Q73. State one scenario where recall is more desirable?
Classification Metrics
Q74. Explain the tradeoff between recall and precision?
Classification Metrics
Q75. Define F Scores?
Classification Metrics
Q76. What is F-1 Score? When should we use it?
Classification Metrics
Q77. What is range of F Scores?
Classification Metrics
Q78. What are the weaknesses of F-1 score?
Classification Metrics
Q79. Explain the difference between Type I and Type II errors in the context of a confusion matrix.
Classification Metrics
Q80. What is the main limitations with confusion matrix summarization?
Classification Metrics
Q81. What is precision and recall curve?
Classification Metrics
Q82. State the use of precision and recall curve?
Classification Metrics
Q83. How can we construct precision and recall curve?
Classification Metrics
Q84. What are the limitations of precision and recall curve?
Classification Metrics
Q85. What does ROC Curve depicts?
Classification Metrics
Q86. For an ideal model what should ROC-AUC?
Classification Metrics
Q87. State what does mean to have AUC of 0.2?
Classification Metrics
Q88. Can we use ROC-AUC score for multi-class classification?
Classification Metrics
Q89. What is the range of ROC-AUC?
Classification Metrics
Q90. What is the limitations of ROC-AUC score?
Classification Metrics
Q91. Your team is building a system to aid doctors in predicting whether a patient has cancer or not from their X-ray scan. Your colleague announces that the problem is solved now that they’ve built a system that can predict with 99.99% accuracy. How would you respond to that claim?
Classification Metrics
Q92. Given a binary classifier that outputs the following confusion matrix.
- Calculate the model’s precision, recall, and F1.
- What can we do to improve the model’s performance?
Classification Metrics
Q93. Consider a classification where $99%$ of data belongs to class A and $1%$ of data belongs to class B.
- If your model predicts A 100% of the time, what would the F1 score be? Hint: The F1 score when A is mapped to 0 and B to 1 is different from the F1 score when A is mapped to 1 and B to 0.
- If we have a model that predicts A and B at a random (uniformly), what would the expected be?
Classification Metrics
Q94. Show that the negative log-likelihood and cross-entropy are the same for binary classification tasks.
Classification Metrics
Q95. For classification tasks with more than two labels (e.g. MNIST with $10$ labels), why is cross-entropy a better loss function than MSE?
Classification Metrics
Q96. Consider a language with an alphabet of $27$ characters. What would be the maximal entropy of this language?
Classification Metrics
Q97. Suppose you want to build a model to predict the price of a stock in the next 8 hours and that the predicted price should never be off more than $10%$ from the actual price. Which metric would you use?
Clustering Metrics
Q98. What are common evaluation metrics used for clustering algorithms?
Clustering Metrics
Q99. How does the Silhouette Score evaluate clustering performance?
Clustering Metrics
Q100. State the expression of silhouette score?
Clustering Metrics
Q101. What are the pros and cons of the Silhouette Score?
Clustering Metrics
Q102. What does the Davies-Bouldin Index measure?
Clustering Metrics
Q103. What are the advantages and disadvantages of the Davies-Bouldin Index?
Clustering Metrics
Q104. Write the mathematical expression of Davies-Bouldin Index?
Metrics in NLP
Q105. What is Word Error Rate (WER)?
Metrics in NLP
Q106. How can we calculate Word Error Rate (WER)?
Metrics in NLP
Q107. How do you compute the WER over an entire dataset?
Metrics in NLP
Q108. What are the main advantages and disadvantages of using WER?
Metrics in NLP
Q109. How is Word Accuracy Rate related to WER?
Metrics in NLP
Q110. What does the BLEU score measure?
Metrics in NLP
Q111. What are the key components of BLUE score?
Metrics in NLP
Q112. What is the formula for the BLEU score, and how is it typically computed?
Metrics in NLP
Q113. What are the strengths and weaknesses of the BLEU score?
Metrics in NLP
Q114. How does BLEU compare to other metrics like ROUGE or METEOR?
Metrics in NLP
Q115. What is Perplexity and how is it used in evaluating language models?
Metrics in NLP
Q116. What are the bounds of Perplexity and what does it indicate?
Metrics in NLP
Q117. What are the limitations of using Perplexity as a metric?
Metrics in NLP