DecodeAI
← Question Bank

Machine Learning

Performance Metrics

Interview questions on Performance Metrics.

118 questions

Regression Metrics

Q1. List down metrics for evaluating regression tasks?

Sign in to bookmark

Regression Metrics

Q2. Write down mathematical expression of MSE?

Sign in to bookmark

Regression Metrics

Q3. What are benefits of using MSE as loss function?

Sign in to bookmark

Regression Metrics

Q8. What is the significance of a low MSE value?

Sign in to bookmark

Regression Metrics

Q9. How can you minimize MSE in a machine learning model?

Sign in to bookmark

Regression Metrics

Q10. What are weaknesses of mean-squared error(mse)?

Sign in to bookmark

Regression Metrics

Q11. Write the expression for Root Mean Squared Error(RMSE)?

Sign in to bookmark

Regression Metrics

Q12. What is the benefit of using RMSE over MSE?

Sign in to bookmark

Regression Metrics

Q14. Write the mathematical expression for Mean Absolute Error(MAE)?

Sign in to bookmark

Regression Metrics

Q15. What is the benefit of using MAE over RMSE or MSE?

Sign in to bookmark

Regression Metrics

Q16. State one drawback of using MAE over RMSE or MSE?

Sign in to bookmark

Regression Metrics

Q17. What is the difference between MSE and RMSE (Root Mean Square Error)?

Sign in to bookmark

Regression Metrics

Q18. What is Mean Absolute Percentage Error (MAPE), and how is it calculated?

Sign in to bookmark

Regression Metrics

Q19. Why might MAPE be misleading if the actual values of the target variable are very small?

Sign in to bookmark

Regression Metrics

Q20. In which scenarios would MAPE be preferred over metrics like RMSE or MAE?

Sign in to bookmark

Regression Metrics

Q21. How does MAPE handle negative values in the actual data, and why might this be problematic?

Sign in to bookmark

Regression Metrics

Q22. Can MAPE be used to evaluate a model’s performance if the target variable contains zero values?

Sign in to bookmark

Regression Metrics

Q23. What are the benefits of using MAPE in a business context, and what potential pitfalls should be considered?

Sign in to bookmark

Regression Metrics

Q24. How does MAPE handle asymmetric errors, and what might be the implications for model evaluation?

Sign in to bookmark

Regression Metrics

Q28. What does an R-squared value of 0.75 mean?

Sign in to bookmark

Regression Metrics

Q31. What are the benefits of using R-squared as performance indicator?

Sign in to bookmark

Regression Metrics

Q34. When should you use R-squared as an evaluation metric?

Sign in to bookmark

Regression Metrics

Q35. Why do we need adjusted R-squared instead of standard R-squared?

Sign in to bookmark

Regression Metrics

Q36. What is the expression of adjusted R-squared?

Sign in to bookmark

Regression Metrics

Q37. What is the limitation of adjusted R-squared?

Sign in to bookmark

Regression Metrics

Q39. Write the expression of pearson correlation $\rho$?

Sign in to bookmark

Regression Metrics

Q40. What is the range of pearson correlations?

Sign in to bookmark

Regression Metrics

Q41. State the weakness of pearson correlation?

Sign in to bookmark

Regression Metrics

Q43. What is the benefit of using spearman correlation over pearson correlation?

Sign in to bookmark

Regression Metrics

Q44. Write the formula of spearman correlation?

Sign in to bookmark

Regression Metrics

Q45. How can you compute the spearman correlation between two variable $X$ and $Y$?

Sign in to bookmark

Regression Metrics

Q46. How to interpret spearman correlation values?

Sign in to bookmark

Regression Metrics

Q47. State the one scenario where spearman correlation is more appropriate than pearson coefficients?

Sign in to bookmark

Regression Metrics

Q48. What is the limitation of spearman correlation?

Sign in to bookmark

Classification Metrics

Q50. What metrics we can use to evaluate a classifier?

Sign in to bookmark

Classification Metrics

Q51. What is the purpose of a confusion matrix?

Sign in to bookmark

Classification Metrics

Q52. Explain True Positive (TP) and False Positive (FP).

Sign in to bookmark

Classification Metrics

Q53. Define True Negative (TN) and False Negative (FN).

Sign in to bookmark

Classification Metrics

Q54. How can you use a confusion matrix to choose an appropriate threshold for a binary classifier?

Sign in to bookmark

Classification Metrics

Q56. Write the mathematical expression of accuracy score?

Sign in to bookmark

Classification Metrics

Q58. How does accuracy is related with negative log(logistic) loss?

Sign in to bookmark

Classification Metrics

Q59. What is the main issue with accuracy score?

Sign in to bookmark

Classification Metrics

Q60. How can we overcome with accuracy score limitations?

Sign in to bookmark

Classification Metrics

Q61. What do you mean by precision? How can we calculate it?

Sign in to bookmark

Classification Metrics

Q63. What is the range of precision value?

Sign in to bookmark

Classification Metrics

Q64. What are the weaknesses of precision as a metric in classification, and how can it be misleading in certain scenarios?

Sign in to bookmark

Classification Metrics

Q65. State one scenario where you should use precision of the system as evaluation metric?

Sign in to bookmark

Classification Metrics

Q68. What does recall measures? How is it calculated?

Sign in to bookmark

Classification Metrics

Q69. What does higher value of recall indicates?

Sign in to bookmark

Classification Metrics

Q72. What is the main limitation of recall metric?

Sign in to bookmark

Classification Metrics

Q73. State one scenario where recall is more desirable?

Sign in to bookmark

Classification Metrics

Q74. Explain the tradeoff between recall and precision?

Sign in to bookmark

Classification Metrics

Q76. What is F-1 Score? When should we use it?

Sign in to bookmark

Classification Metrics

Q78. What are the weaknesses of F-1 score?

Sign in to bookmark

Classification Metrics

Q79. Explain the difference between Type I and Type II errors in the context of a confusion matrix.

Sign in to bookmark

Classification Metrics

Q80. What is the main limitations with confusion matrix summarization?

Sign in to bookmark

Classification Metrics

Q82. State the use of precision and recall curve?

Sign in to bookmark

Classification Metrics

Q83. How can we construct precision and recall curve?

Sign in to bookmark

Classification Metrics

Q84. What are the limitations of precision and recall curve?

Sign in to bookmark

Classification Metrics

Q86. For an ideal model what should ROC-AUC?

Sign in to bookmark

Classification Metrics

Q87. State what does mean to have AUC of 0.2?

Sign in to bookmark

Classification Metrics

Q88. Can we use ROC-AUC score for multi-class classification?

Sign in to bookmark

Classification Metrics

Q90. What is the limitations of ROC-AUC score?

Sign in to bookmark

Classification Metrics

Q91. Your team is building a system to aid doctors in predicting whether a patient has cancer or not from their X-ray scan. Your colleague announces that the problem is solved now that they’ve built a system that can predict with 99.99% accuracy. How would you respond to that claim?

Sign in to bookmark

Classification Metrics

Q92. Given a binary classifier that outputs the following confusion matrix.

Sign in to bookmark

[""Predicted TruePredicted FalseActual True3020Actual False540]\begin{bmatrix} \textbf{""} & \textbf{Predicted True} & \textbf{Predicted False} \\\\ \textbf{Actual True} & 30 & 20 \\\\ \textbf{Actual False} & 5 & 40 \\\\ \end{bmatrix}

  1. Calculate the model’s precision, recall, and F1.
  2. What can we do to improve the model’s performance?

Classification Metrics

Q93. Consider a classification where $99%$ of data belongs to class A and $1%$ of data belongs to class B.

Sign in to bookmark
  1. If your model predicts A 100% of the time, what would the F1 score be? Hint: The F1 score when A is mapped to 0 and B to 1 is different from the F1 score when A is mapped to 1 and B to 0.
  2. If we have a model that predicts A and B at a random (uniformly), what would the expected F1F_1 be?

Classification Metrics

Q94. Show that the negative log-likelihood and cross-entropy are the same for binary classification tasks.

Sign in to bookmark

Classification Metrics

Q95. For classification tasks with more than two labels (e.g. MNIST with $10$ labels), why is cross-entropy a better loss function than MSE?

Sign in to bookmark

Classification Metrics

Q96. Consider a language with an alphabet of $27$ characters. What would be the maximal entropy of this language?

Sign in to bookmark

Classification Metrics

Q97. Suppose you want to build a model to predict the price of a stock in the next 8 hours and that the predicted price should never be off more than $10%$ from the actual price. Which metric would you use?

Sign in to bookmark

Clustering Metrics

Q98. What are common evaluation metrics used for clustering algorithms?

Sign in to bookmark

Clustering Metrics

Q99. How does the Silhouette Score evaluate clustering performance?

Sign in to bookmark

Clustering Metrics

Q100. State the expression of silhouette score?

Sign in to bookmark

Clustering Metrics

Q101. What are the pros and cons of the Silhouette Score?

Sign in to bookmark

Clustering Metrics

Q102. What does the Davies-Bouldin Index measure?

Sign in to bookmark

Clustering Metrics

Q103. What are the advantages and disadvantages of the Davies-Bouldin Index?

Sign in to bookmark

Clustering Metrics

Q104. Write the mathematical expression of Davies-Bouldin Index?

Sign in to bookmark

Metrics in NLP

Q107. How do you compute the WER over an entire dataset?

Sign in to bookmark

Metrics in NLP

Q108. What are the main advantages and disadvantages of using WER?

Sign in to bookmark

Metrics in NLP

Q112. What is the formula for the BLEU score, and how is it typically computed?

Sign in to bookmark

Metrics in NLP

Q113. What are the strengths and weaknesses of the BLEU score?

Sign in to bookmark

Metrics in NLP

Q114. How does BLEU compare to other metrics like ROUGE or METEOR?

Sign in to bookmark

Metrics in NLP

Q115. What is Perplexity and how is it used in evaluating language models?

Sign in to bookmark

Metrics in NLP

Q116. What are the bounds of Perplexity and what does it indicate?

Sign in to bookmark

Metrics in NLP

Q117. What are the limitations of using Perplexity as a metric?

Sign in to bookmark