COMPUTER NETWORKS AND CYBER, Schemes and Mind Maps of Computer Networks

An internship is a period of work experience offered by an organization for a limited period of time. Once confined to medical graduates, internship is used practice for a wide range of placements in businesses, non-profit organizations and government agencies.

Typology: Schemes and Mind Maps

2022/2023

Uploaded on 04/27/2023

official-sf
official-sf 🇮🇳

4 documents

1 / 20

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
VISVESVARAYA TECHNOLOGICAL UNIVERSITY
Jnana Sangama, Belgaum-590014
A TECHNICAL MAJOR PROJECT REPORT
ON
MUSIC RECOMMENDATION BASED ON FACE EMOTION
RECOGNITION
Submitted in the partial fulfillment for the requirement of 7th Semester
BACHELOR OF ENGINEERING IN COMPUTER SCIENCE AND
ENGINEERING
Submitted By:
ABHIJIT D (1BC19CS001)
ROHIT KUMAR (1BC19CS009)
AKASH BHARDWAJ (1BC19CS003)
SHAIKH FAISAL (1BC19CS012)
BCET
BANGALORE COLLEGE OF ENGINEERING & TECHNOLOGY
Bangalore-560099
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14

Partial preview of the text

Download COMPUTER NETWORKS AND CYBER and more Schemes and Mind Maps Computer Networks in PDF only on Docsity!

VISVESVARAYA TECHNOLOGICAL UNIVERSITY

Jnana Sangama, Belgaum-59001 4

A TECHNICAL MAJOR PROJECT REPORT

ON

“ MUSIC RECOMMENDATION BASED ON FACE EMOTION

RECOGNITION ”

Submitted in the partial fulfillment for the requirement of 7 th^ Semester BACHELOR OF ENGINEERING IN COMPUTER SCIENCE AND ENGINEERING Submitted By: ABHIJIT D (1BC19CS001) ROHIT KUMAR (1BC19CS009) AKASH BHARDWAJ (1BC19CS003) SHAIKH FAISAL (1BC19CS012)

BCET

BANGALORE COLLEGE OF ENGINEERING & TECHNOLOGY

Bangalore-

BANGALORE COLLEGE OF ENGINEERING & TECHNOLOGY

Department of Computer Science and Engineering Bangalore- 560099

CERTIFICATE

This is to certify that the Base paper Project work entitled “LAPTOP SERVICE ” is a Bonafide work carried out by AYUSH DWIVEDI, and in partial fu l f i l l m e n t for the requirement of 7 th Semester , Bachelor of Engineering in Computer Science and Engineering of Visvesvaraya Technological University , Belgaum during the year 2022-2023. It is certified thatall corrections / suggestions indicated for the internal assessment have been incorporated in the report. This report has been approved as it satisfies the academic requirements in respect of base paper project work prescribed for Bachelor of Engineering Degree. Signature of the project guide Signature of HOD Signature of principal MRS. T.M. KAVITHA , M. E MRS. T.M. KAVITHA, M. E DR. CHANNANKAIAH, Dept. of CSE Dept. of CSE Ph.D. BCET

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY ABSTRACT The purpose of the project entitled as “ Music Recommendation Based on Face Emotion Recognition ” play an important role in today’s world growing IT industries. It is often confusing for a person to decide which music he/she have to listen from a massive collection of existing options. There have been several suggestion frameworks available for issues like music, dining, and shopping depending upon the mood of user. The main objective of our music recommendation system is to provide Suggestions to the users that fit the user’s preferences. The analysis of the facial expression/user emotion may lead to understanding the currentemotional or mental state of the user. Music and videos are one region where there is a significant chance to prescribe abundant choices to clients in light of them inclinations and also recorded information.

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY INDEX

  1. ACKNOWLEDGEMENT
  2. ABSTRACT
  3. INTRODUCTION
  4. PURPOSE
  5. METHODOLOGY 5.1 Database Description 5.2 Emotion Detection Module 5.2.1 Face Detection 5.2.2 Feature Extraction 5.2.3 Emotion Detection 5.3 Music Recommendation Module 5.3.1 Song Database 5.3.2 Music Playlist Recommendation
  6. FUTUR SCOPE
  7. SYSTEM REQUIREMENTS
  8. RESULT & ANALYSIS
  9. REFERENCES CONCLUSION
  10. REFERENCES

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

  1. PURPOSE The review is done to get insights into the methods, their shortcoming which we can overcome. A literature review, a litera- ture survey is a text of a scholarly paper, which includes the current understanding along with great findings, as well as theo- retical and methodological contributions to a particular topic. The latent qualities of humans that can provide inputs to any system in various ways have brought the attention of several learners, scientists, engineers, etc. from all over the world. The current mental state of the person is provided by facial expressions. Most of the time we use nonverbal clues like hand gestures, facial expressions, and tone of voice to express feelings in interpersonal communication. Preema et al [6] stated that it is very time-consuming and difficult to create and manage a large playlist. The paper states that the `music player itself selects a song according to the current mood of the user. The application scans and classifies the audio files according to au- dio features to produce mood-based playlists. The application makes use of the Viola-Jonas algorithm that is used for face detection and facial expression extraction. Support Vector Machin e (SVM) was used in the classification extracted features into 5 major universal emotions like anger, joy, surprise, sad, and disgust.

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

  1. METHODOLOGY 5.1 Database Description We built the Convolutional Neural Network model using the Kaggle dataset. The database is FER2013 which is split into two parts training and testing dataset. The training dataset consists of 24176 and the testing dataset contains 6043 im- ages. There are 48x48 pixel grayscale images of faces in the dataset. Each image in FER-2013 is labeled as one of five emotions: happy, sad, angry, surprise, and neutral. The faces are automatically registered so that they are more or less centered in each image and take up about the same amount of space. The images in FER-2013 contain both posed and unposed headshots, which are in grayscale and 48x48 pixels. The FER-2013 dataset was created by gathering the results of a Google image search of every emotion and synonyms of the emotions. FER systems being trained on an imbalanced dataset may perform well on dominant emotions such as happy, sad, angry, neutral, and surprised but they perform poorly on the under-represented ones like disgust and fear. Usually, the weighted-SoftMax loss approach is used to handle this problem by weighting the loss term for each emotion class supported by its relative proportion within the training set. However, this weighted-loss approach is predicated on the SoftMax loss function, which is reported to easily force features of various classes to stay apart without listening to intra-class compactness. One effective strategy to deal with the matter of SoftMax loss is to use an auxiliary loss to coach the neural network. To treating missing and Outlier values we have used a loss function named categorical crossentropy. For each iteration, a selected loss function is employed to gauge the error value. So,to treating missing and Outlier values, we have used a loss function named categorical crossentropy.

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY Figure 3. Face detection. 5.2.2 Feature Extraction While performing feature extraction, we treat the pre-trained network that is a sequential model as an arbitrary feature ex- tractor. Allowing the input image to pass on it forward, stopping at the pre-specified layer, and taking the outputs of that layer as our features. Starting layers of a convolutional network extract high-level features from the taken image, so use only a few filters. As we make further deeper layers, we increase the number of the filters to twice or thrice the dimension of the filter of the previous layer. Filters of the deeper layers gain more features but are computationally very intensive. Figure 4. Visualization of The Feature Map. Doing this we utilized the robust, discriminative features learned by the Convolution neural network [10]. The outputs of the model are going to be feature maps, which are an intermediate representation for all layers after the very first layer. Load the input image for which we want to view the Feature map to know which features were promi nent to clas- sify the image. Feature

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY maps are obtained by applying Filters or Feature detectors to the input image or the feature map output of the prior layers. Feature map visualization will provide insight into the interior representations for specific i n- put for each of the Convolutional layers within the model. 5.2.3 Emotion Detection Figure 5. Convolution neural network Architecture Convolution neural network architecture applies filters or feature detectors to the input image to get the feature maps or activation maps using the Relu activation function [11]. Feature detectors or filters help in identifying various features pre- sent in the image such as edges, vertical lines, horizontal lines, bends, etc. After that pooling is applied over the feature maps for invariance to translation. Pooling is predicted on the concept that once we change the input by a touch amount, the pooled outputs don’t change. We can use any of the pooling from min, average, or max. But max-pooling provides better performance than min or average pooling. Flatten all the input and giving these flattened inputs to a deep neural network which are outputs to the class of the object. Figure 6. Feature Extraction by each layer in Convolutional Neural Network

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY 5.3 Music Recommendation Module 5.3.1 Song Database We created a database for Bollywood Hindi songs. It consists of 100 to 150 songs per emotion. As we all know music is un- doubtedly involved in enhancing our mood. So, suppose a user is sad then the system will recommend such a music playlist which motivates him or her and by this automatic mood will be delighted.

5.3.2 Music Playlist Recommendation

By using the emotion module real-time emotion of the user is detected. This will give the labels like Happy, Sad, Angry, Sur- prise, and Neutral. Using the os.listdir() method in python we connected these labels with the folders of the songs database which we have created. Table 1 shows the list of songs. This method of os.listdir() is used to get the list of any file in the spec- ified directories. if label== 'Happy': os.chdir("C:/Users/deepali/Downloa ds/Happy") self.mood.set("You are looking happy, I am playing song forYou")

Fetching Songs

songtracks = os.listdir() Table 1. Database of songs. Emotion Songs Happy Track^1 “Baarish” Track 2 “kaun tujhe” Track 3 “phir bhi tumko chahunga” Sad Track 1 “huu va hai aja phali bar” Track 2 “jab tak” Track 3 “zaroorat” Angry Track^ I^ “tere^ hone^ lage^ ham” Track 2 “yad hai na” Track 3 “awari” Surprise Track^ I^ “aa^ jao^ meri^ tamana” Track 2 “shubhanala” Track 3 “shubhanala” Neutral Track^1 “kabhi^ jo^ badal^ barse” Track 2 “ 31 soniyo” Track 3 “onde matram”

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

Inserting Songs into Playlist

For track in songtracks: self.playlist.insert (END,track) This will result in the recommended playlist for the user in the GUI of the music player by showing captions according to detected emotions. We have used a library called Pygame for playing the audio as this library supports playing various mul- timedia formats like audio, video, etc. Functions of this library such as playsong, pauseong, resumesong, and stopsong are used to working with the music player. Variables like playlist, songstatus, and root are used for storing the name of all songs, storing the status of currently active songs, and for the main GUI window respectively. For developing the GUI, we have used Tkinter. Figure 8. GUI of the front page. Figure 9. Detection of emotion

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

6. FUTURE SCOPE

This system, although completely functioning, does have scope for improvement in the future. There are various aspects of the application that can be modified to produce better results and a smoother overall experience for the user. Some of these that an alternative method, based on additional emotions which are excluded in our system as disgust and fear. This emotion included supporting the playing of music automatically. The future scope within the system would style a mechanism that might be helpful in music therapy treatment and help the music therapist to treat the patients suffering from mental stress, anxiety, acute depression, and trauma. The current system does not perform well in extremely bad light conditions and poor camera resolution thereby provides an opportunity to add some functionality as a solution in the future.

7. SYSTEM REQUIREMENT

The following are the minimum requirements to develop this application

  1. Hardware requirements  Processor : 2GHz  RAM : 1 GB
  2. Browser  Chrome 51 or higher  Firefox 47 or higher  Opera 37  Edge 105
  3. Database  Firebase  NoSQL
  4. API : Affective Emotion Recognition API

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

  1. RESULT & ANALYSIS We evaluated a number of the studies which use support vector machine (SVM), extreme learning machine (ELM), and con- volutional neural network [12]. Table 2 shows the comparison of related algorithms. Corresponding algorithms and accuracy values are given for each study. The usage of a Convolutional Neural Network improves the efficiency of the emotion detec- tion accuracy. Table 2. Validation and Testing accuracyfor the three algorithms on the Fer2013 Dataset. Algorithm SV M EL M CN N Validation Accuracy 0.66 0.62 0. Testing Accuracy 0.66 0.63 0. Table 3 shows hyperparameters for the trained CNN network. The learning rate regulates the update of the weight at the end of each batch. Several epochs of the iterations of the entire training dataset to the network during training. Batch size the number of patterns shown in the network before the weights are updated. Activation functions allow the model to learn nonlinear prediction boundaries. Adam may be a replacement optimization algorithm for stochastic gradient descent for training deep learning models. The loss function categorical- crossentropy is employed to quantify deep learning model er- rors, typically in single-label, multi-class classification problems. Table 3. Hyperparameter for trained CNN network. Hyperparameters Values Batch size 128 No. of classes 5 Optimizer Adam Learning rate 0. Epoch 48 No. of Layers 28 Activation function Relu, SoftMax Loss function Categorical-crossentropy

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY

  1. REFERENCES [1] Ramya Ramanathan, Radha Kumaran, Ram Rohan R, Rajat Gupta, and Vishalakshi Prabhu, an intelligent music player based on emo- tion recognition, 2nd IEEE International Conference on Computational Systems and Information Technology for Sustainable Solutions 2017. https://doi.org/10.1109/CSITSS.2017. [2] Shlok Gilda, Husain Zafar, Chintan Soni, Kshitija Waghurdekar, Smart music player integrating facial emotion recognition and music mood recommendation, Department of Computer Engineering, Pune Institute of Computer Technology, Pune, India, (IEEE),2017. https://doi.org/10.1109/WiSPNET.2017. [3] Deger Ayata, Yusuf Yaslan, and Mustafa E. Kamasak, Emotion-based music recommendation system using wearable physiological sensors, IEEE transactions on consumer electronics, vol. 14, no. 8, May 2018.https://doi.org/10.1109/TCE.2018. [4] Ahlam Alrihail, Alaa Alsaedi, Kholood Albalawi, Liyakathunisa Syed, Music recommender system for users based on emotion detection through facial features, Department of Computer Science Taibah University, (DeSE), 2019. https://doi.org/10.1109/DeSE.2019. [5] Research Prediction Competition, Challenges in representation learning: facial expression recognition challenges, Learn facial expres- sion from an image, (KAGGLE). [6] Preema J.S, Rajashree, Sahana M, Savitri H, Review on facial expression-based music player, International Journal of Engineering Re- search & Technology (IJERT), ISSN-2278-0181, Volume 6, Issue 15,
    [7] AYUSH Guidel, Birat Sapkota, Krishna Sapkota, Music recommendation by facial analysis, February 17, 2020. [8] CH. sadhvika, Gutta.Abigna, P. Srinivas reddy, Emotion-based music recommendation system, Sreenidhi Institute of Science and Technology, Yamnampet, Hyderabad; International Journal of Emerging Technologies and Innovative Research (JETIR) Volume 7, Is- sue 4, April 2020. [9] Vincent Tabora, Face detection using OpenCV with Haar Cascade Classifiers, Becominghuman.ai,2019. [10] Zhuwei Qin, Fuxun Yu, Chenchen Liu, Xiang Chen. How convolutional neural networks see the world - A survey of convolutional neural network visualization methods. Mathematical Foundations of Computing, May

BANGALORE COLLEGE OF ENGINEERING AND TECHNOLOGY [11] Ahmed Hamdy AlDeeb, Emotion- Based Music Player Emotion Detection from Live Camera, ResearchGate, June 2019. [12] Frans Norden and Filip von Reis Marlevi, A Comparative Analysis of Machine Learning Algorithms in Binary Facial Expression Recogni- tion, TRITA-EECS-EX-2019:143. [13] P. Singhal, P. Singh and A. Vidyarthi (2020) Interpretation and localization of Thorax diseases using DCNN in Chest X-Ray. Journalof Informatics Electrical and Elecrtonics Engineering,1(1), 1, 1- [14] M. Vinny, P. Singh (2020) Review on the Artificial Brain Technology: BlueBrain. Journal of Informatics Electrical and Electronics Engi- neering,1(1), 3, 1-11. [15] A. Singh and P. Singh (2021) Object Detection. Journal of Management and Service Science, 1(2), 3, pp. 1-20. [16] A. Singh, P. Singh (2020) Image Classification: A Survey. Journal of Informatics Electrical and Electronics Engineering,1(2), 2, 1-9. [17] A. Singh and P. Singh (2021) License Plate Recognition. Journal of Management and Service Science, 1(2), 1, pp. 1-14.