Encoding the images using resnet-50 and using them along with the meta-data of the patient, we try to classify cancerous tissues using a decision tree classifier. We were able to see better performance with information gained from the meta data, when compared to using transfer learning on the breast mammograms.
Link for the dataset: https://www.kaggle.com/datasets/theoviel/rsna-breast-cancer-512-pngs