The fundamental unit of data in computing is the binary digit, also known as a bit. It exists in one of two states, represented by 0 or 1. These distinct values correspond to the two states inherent in binary systems, which are integral to processing and storing information within computers.