Step 1: Start by sorting ovarian cancers into their three big families - epithelial, germ cell and sex cord stromal. The epithelial family dominates and supplies most malignant ovarian tumors.
Step 2: Inside the epithelial family, the serous subtype outnumbers the mucinous, endometrioid and clear cell subtypes. Its cancerous version, the serous cystadenocarcinoma, frequently appears in both ovaries and can show calcified psammoma bodies under the microscope.
Step 3: The other choices rank lower. Mucinous cystadenocarcinoma is a less common epithelial cancer, malignant teratoma belongs to the rarer germ cell line, and sarcoma of the ovary is distinctly uncommon.
Step 4: So the leading malignant tumor of the ovary is the serous cystadenocarcinoma.
\[\boxed{\text{Serous cystadenocarcinoma}}\]