Question

Which of the following statement(s) is/are correct about Stacking in the context of machine learning?
(A) A logistic regression will definitely work better in the second stage as compared to other classification models.
(B) A machine learning model is trained on predictions of multiple machine learning models.
(C) First stage models are trained on full/partial feature space of training data.
Choose the correct answer from the options given below:

• (B) and (C) only.
• (A) and (B) only.
• (A) and (C) only.
• (B) only.

Hint:

Understand that stacking uses base models to generate predictions, which are then used by a meta-model for final predictions.

Answer 1

The Correct Option is A

(A): Incorrect. Logistic regression is frequently applied in the second stage; however, its superior performance compared to other classifiers is not guaranteed. (B): Correct. Stacking entails training a meta-model (e.g., logistic regression) using the predictions from base models. (C): Correct. First-stage models are trained on the feature space of the training data.