A machine learning model which uses Siamese network based architecture to perform multi-class classification to identify and separate Pneumonia, Normal, COVID-19, and Severe COVID-19 patients on the basis of the X-Ray images. The obtained accuracy is 98%.