An MMS service that allows the user to take a photo of a flower, send it to a phone number, and receive the classifiction of the flower in return. Here is an outline of how it works:
- Uses Twilio as an MMS service and hosts the receiving phone number
- Node server takes the image from Twilio and passes it so a Flask microservice being hosted locally on a Raspberry Pi.
- Flask microservice uses a custom EfficientNet_B2 image classificiation PyTorch model to classify the flower (hosted on HuggingFace at https://huggingface.co/spaces/MylesJP/Nature-Walk)
- Response from microservice is parsed and the result is sent back to the user as an SMS message.
![](https://private-user-images.githubusercontent.com/96148570/265829254-071d1940-a79a-4516-95d4-ebd1e1649a8d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg1Mzc0MDIsIm5iZiI6MTcxODUzNzEwMiwicGF0aCI6Ii85NjE0ODU3MC8yNjU4MjkyNTQtMDcxZDE5NDAtYTc5YS00NTE2LTk1ZDQtZWJkMWUxNjQ5YThkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjE2VDExMjUwMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUwODg3NGMyNmY0ZTNiMmQwYWJhN2RkNmIzYWYxZGFlMmQzZTY2NmZiZDFkOTU2ZWJjNmU2OTNlZTQ3M2NhMDMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.9nL3blU9aJrUvR0yY80MQqrD9UivFb1XONcQwyPkz5c)
![](https://private-user-images.githubusercontent.com/96148570/265829261-18e402dc-e9ed-4634-9b50-faa7faa6c41c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg1Mzc0MDIsIm5iZiI6MTcxODUzNzEwMiwicGF0aCI6Ii85NjE0ODU3MC8yNjU4MjkyNjEtMThlNDAyZGMtZTllZC00NjM0LTliNTAtZmFhN2ZhYTZjNDFjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjE2VDExMjUwMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTgxZTI2MDYyNjgzYWQwODRmN2Q3MjgwZTkyYzA1OWU3YjY5MDdlZjI0YTAxODBmYWQ0YjA0YjI2N2IxN2RhMmYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.mJOKWI9H32r_KmtN3WSnD-u9BukUoYcRf7JmVTwXBOM)