Smile Detection Model
I worked on a smile detection model using machine learning that can accurately predict when a person is smiling or not, given an image of the person.
| Engineer | School | Area of Interest | Grade |
|---|---|---|---|
| Sanay B | Archbishop Mitty | Computer Science/Machine Learning | Incoming Junior |
Demo Night
Challenges: One of the main challenges I had was that some of the tutorials I was using had outdated code from 2015. For example, the cross_selection function that calls on KFold that splits the train and test data, was replaced by sklearn to model_selection. The two have the exact same purpose, except for the name. Another major challenge I had was matching the image pixel size that was given by the olivetti faces dataset. The images in this dataset were 64 by 64, but images I got from google or took of myself were not always 64 by 64. As a result, I used the code below to extract a 64 by 64 image of the image I had already inputted, by matching coefficients for each image and multiplying it by the height and width to get that exact pixel size.
Reflection: Overall, I realized I like the software/problem solving side of computer science a lot. Though debugging and errors can be really frustrating, fixing them and getting the code to work is really worth it. This project also helped me understand more about machine learning as I had never actually integrated it into my code before or really used it. The amount of paths and possibilies someone can explore with OpenCV and image classification cannot be numbered.
Final Milestone
My final milestone was getting my web app working. When I press the detect button, my web cam is able to start up a video and use OpenCV to process my face and detect if I am smiling or not. The OpenCV renders accurate results, and my model is able to detect when I am changing my face from smiling to no smile.
I used Flask to set up my web server, and I used HTML, CSS, and Bootstrap on the frontend.
Second Milestone
The first part of my second milestone involved getting my model to actually work and detect faces when I upload them. It was decently accurate. My model, once trained and tested, had an accuracy of 82%. After this was done, I used this model to be able to detect when I am smiling or not using a live webcam. This part worked much better as I had provided coefficients for my face that made it easier for the model algorithm to correctly identify whether I was smiling or not.
This is my code for training my model and getting its accuracy. I used Kfold to split the train and test data. Because of this, my model is able to use one as a reference point and see if it is able to accurately predict the images in the olivetti faces dataset. Once it predicts an image, it checks to see if it is right based on how I already classified the images before. If it right, it’s accuracy improves. If it’s wrong, it tries to improve and figure out what went wrong.
First Milestone
My first milestone involved setting up my raspberry pi and being able to display and classify the olivetti faces dataset using Jupyter Notebook. My code came up with a simple UI that had two buttons, smile and sad face, which I used to classify 200 unique images. Then, I was able to dump the data into an xml file, load it, and classify each one of them as smiling or not smiling using a string. Based on the true and false values from when I first pressed the buttons, my code was able to match that to whether the images were smiling or not. True means that they are, and false means that they are not.