We combine deep learning and transformers to automate and improve heart condition diagnoses from ECG. Transformers are particularly able to tackle long-range patterns crucial for comprehensive analysis, potentially leading to more accurate and objective interpretations despite challenges like data needs and explainability. These promising approaches hold significant potential for the future of heart disease diagnosis.