The application of deep learning model in image classification and feature detection is becoming widespread in the medical community. This webpage presents a deep learning model that takes a dermascopic image along with meta data to infer the type of lesion, and it has resulted in performance improvement compared to the base model without the metadata. Please note this is NOT a diagnostic tool, the output of the model is not to be interpreted as an actual diagnosis. In practice, such a platform would serve the purpose of monitoring skin lesions (especially for patients with family history) and encouraging the user to seek medical attention more efficiently.
A DenseNet model was trained on data set provided by the International Skin Imaging Collaboration (ISIC). The goal was to classify dermoscopic images for 8 categories (the bolded ones are cancerous):
The ISIC 2019 data is provided courtesy of the following sources: BCN_20000 Dataset: (c) Department of Dermatology, Hospital Clínic de Barcelona HAM10000 Dataset: (c) by ViDIR Group, Department of Dermatology, Medical University of Vienna; https://doi.org/10.1038/sdata.2018.161 MSK Dataset: (c) Anonymous; https://arxiv.org/abs/1710.05006 ; https://arxiv.org/abs/1902.03368.
With the incorporation of data for gender and age, the model performance has been improved and the following table shows the metrics of the model when evaluated on the validation data set.
|Basal cell carcinoma||0.84||0.84||0.84||0.98|
|Squamous cell carcinoma||0.57||0.74||0.65||0.98|
To run the app, simply upload a dermascopic image and enter information for gender and age below. All the information are required for the model to make its prediction.
To help you get started, feel free to use these sample images from ISIC.
ISIC_0028537(Melanoma, age 35, Male), ISIC_0030207(Benign keratosis, age 75, Female), ISIC_0072880(Basal cell carcinoma, age 85, Male), ISIC_0058863(Melanoma, age 45, Female), ISIC_0058864(Actinic keratosis, age 70, Male), ISIC_0060302(Squamous cell carcinoma, age 45, Female), ISIC_0069896(Nevus, age 50, Male), ISIC_0034094(Melanoma, age 55, Female), ISIC_0055686(Actinic keratosis, age 85, Female)
For questions and comments please contact Jenny Yu (jypucca[at]hotmail[dot]com)