Step 1: Understand the task.
Homophones are words that sound the same but are spelt differently and mean different things. We must find the odd word that does not sound like the other three.
Step 2: Say each word aloud.
'Site' means a place. 'Cite' means to quote. 'Sight' means the power to see. 'Kite' is a toy flown in the air.
Step 3: Compare the sounds.
'Site', 'cite', and 'sight' are all pronounced the same way, as 'sahyt'. So these three are homophones of each other.
Step 4: Listen to 'kite'.
'Kite' begins with a hard 'k' sound, 'kahyt'. It only rhymes with the others, but it does not sound exactly the same.
Step 5: Pick the odd one.
Since three words share one identical sound and 'kite' does not, 'kite' is the word that breaks the group.
Step 6: State the conclusion.
The odd word that is not a homophone of the rest is 'Kite'.
\[ \boxed{\text{Kite}} \]