Gangliogliomas are central nervous system tumors located in the temporal lobe of young patients, frequently associated with epilepsy. In this paper, we propose a grading system based solely on histopathological criteria. We reevaluated all cases of ganglioglioma, atypical ganglioglioma, and anaplastic ganglioglioma diagnosed between 2011 and 2020 in the Pathology Department of the Emergency Clinical Hospital Bagdasar-Arseni, based on the type of glial mitoses, the number of neuronal and glial mitoses, presence of necrosis, microvascular proliferation, eosinophilic granular bodies, hypercellularity, presence and disposition of inflammatory infiltrate and atypical pleomorphism. Based on the proposed grading system, a score of 0–4 corresponded to a benign ganglioglioma, 5–9 to an atypical ganglioglioma, and 10–18 to an anaplastic ganglioglioma. The survival rates were 90% for benign ganglioglioma, 71.43% for atypical ganglioglioma, and 62.54% for anaplastic ganglioglioma. One case of benign ganglioglioma underwent a malignant transformation into anaplastic ganglioglioma, and recurrences were noticed in 28.57% of atypical ganglioglioma cases and 30.7% of all anaplastic gangliogliomas. The presence of rare glial mitoses and hypercellularity was correlated with mortality in cases of atypical ganglioglioma. We believe this histopathological scoring system could be used as a three-tier system to identify atypical ganglioglioma cases that are bound to have an aggressive course of evolution and require close follow-up. The other option would be to convert it to a two-tier grading system that can separate low-grade gangliogliomas from high-grade ones. The latter category can encompass both atypical and anaplastic ganglioglioma due to the high mortality of both entities.