Calcium signaling is essential for neuronal function, and its dysregulation has been implicated across neurodegenerative diseases, including Alzheimer’s disease (AD). A close reciprocal relationship exists between calcium signaling and mitochondrial function. Growing evidence in a variety of AD models indicates that calcium dyshomeostasis drastically alters mitochondrial activity which, in turn, drives neurodegeneration. This review discusses the potential pathogenic mechanisms by which calcium impairs mitochondrial function in AD, focusing on the impact of calcium in endoplasmic reticulum (ER)–mitochondrial communication, mitochondrial transport, oxidative stress, and protein homeostasis. This review also summarizes recent data that highlight the need for exploring the mechanisms underlying calcium-mediated mitochondrial dysfunction while suggesting potential targets for modulating mitochondrial calcium levels to treat neurodegenerative diseases such as AD.