Question

Which fundamental principle does the K-Nearest Neighbours (K-NN) algorithm operate on?

• A. Objects that are similar tend to be located far apart.
• B. Objects that are similar tend to be located at random distances.
• C. Objects that are similar tend to be located in a scattered manner.
• D. Objects that are similar tend to be located close to each other.

Hint:

K-NN: Similar points stay close — distance matters!

Answer 1

The Correct Option is D

The K-Nearest Neighbours (K-NN) algorithm operates on the principle that data points with akin characteristics are situated adjacently in feature space.
This is referred to as the locality assumption.
For predictions, K-NN identifies the training examples closest (the nearest neighbours) to a novel data point and bases its prediction on their corresponding values.
Options (A), (B), and (C) diverge from this concept by positing that similar objects are distant, randomly distributed, or dispersed, which conflicts with K-NN's logic.
Consequently, the accurate response asserts that similar objects are proximate.