Difference between revisions of "BeagleBoard/GSoC/2020Proposal/AnirudhSivakumar"
Anirudh666 (talk | contribs) |
Anirudh666 (talk | contribs) |
||
Line 3: | Line 3: | ||
[[Category: GSoCProposal2020]] | [[Category: GSoCProposal2020]] | ||
− | = | + | =[https://elinux.org/BeagleBoard/GSoC/2020Proposal/AnirudhSivakumar Proposal for Emotions Recognition in School Kids using Deep Learning and NLP with BeagleBone Black] = |
<!-- latest video will go here --> | <!-- latest video will go here --> | ||
Line 33: | Line 33: | ||
===Description=== | ===Description=== | ||
− | School kids are often | + | School kids are often unrecognized in many of the Asian educational systems. They carry various emotions, right from parent’s fights to getting bullied. Kids often make intangible opinions about their life and future lifestyle based on experienced perception, thus impacting their carrier. The education system of many countries advice to identify such students and make a personal peer to peer counseling system. Apart from human intervention in decision making, we are looking forward to creating a trained algorithm that can identify such induced emotions and identify students who aren’t approachable nor identified by teachers. |
+ | |||
Natural Language Processing (NLP) using deep learning algorithm has proven to be the best fit for decision making over human intelligence in speech recognition. A deep learning algorithm is always built and trained over time to make it best fit for small range applications like a mobile app or a desktop executable file. | Natural Language Processing (NLP) using deep learning algorithm has proven to be the best fit for decision making over human intelligence in speech recognition. A deep learning algorithm is always built and trained over time to make it best fit for small range applications like a mobile app or a desktop executable file. | ||
− | + | ||
+ | |||
The project deals in three stages. The first stage includes the use of beaglebone black and a microphone, which is capable enough to record interview voices of students from various schools in India, and store the data via the cloud. The second stage consists of storing data to be fed to a deep learning algorithm and keep training until it identifies as a best-fit percentage and the third stage deals with the design and development of a mobile application to be remotely used and to test the efficiency of the trained algorithm. | The project deals in three stages. The first stage includes the use of beaglebone black and a microphone, which is capable enough to record interview voices of students from various schools in India, and store the data via the cloud. The second stage consists of storing data to be fed to a deep learning algorithm and keep training until it identifies as a best-fit percentage and the third stage deals with the design and development of a mobile application to be remotely used and to test the efficiency of the trained algorithm. | ||
− | The idea behind the project is to identify the emotions of the school kids and their social | + | The idea behind the project is to identify the emotions of the school kids and their social behavior. This helps the teachers to make more efficient peer to peer counseling. The outcome of the project would be long term research over speech recognition using NPL and Deep learning and help scientific society with best-fit speech samples for future R&D in economically slow countries. |
===Timeline=== | ===Timeline=== | ||
Line 82: | Line 84: | ||
===Experience and approach=== | ===Experience and approach=== | ||
I have been part of 2 student project teams. I was in the electronics and control subsystem in [https://www.formulamanipal.in/ Formula Manipal] and I am currently the co-founder and electronics and propulsion head in [http://loopmit.in/ loopMIT]. I am also currently in the semi-finals of [https://innovate.mygov.in/india-innovation-challenge-design-contest-2019/ IICDC 2019] with the project E_agri, which is a smart agricultural system based on IoT. I have a lot of experience in working with electronics and embedded systems. I have also designed a Data Acquisition system using the BeagleBone Black for the Formula Manipal Electric car, which communicated through CAN protocol and acted as the master controller of the system. | I have been part of 2 student project teams. I was in the electronics and control subsystem in [https://www.formulamanipal.in/ Formula Manipal] and I am currently the co-founder and electronics and propulsion head in [http://loopmit.in/ loopMIT]. I am also currently in the semi-finals of [https://innovate.mygov.in/india-innovation-challenge-design-contest-2019/ IICDC 2019] with the project E_agri, which is a smart agricultural system based on IoT. I have a lot of experience in working with electronics and embedded systems. I have also designed a Data Acquisition system using the BeagleBone Black for the Formula Manipal Electric car, which communicated through CAN protocol and acted as the master controller of the system. | ||
− | I am also set to present a research paper at the international conference of [http://actse.in/index.php#home ACTSE 2020] and I am currently working on another research paper based on deep learning. I also did an internship at Center for Artificial Intelligence and Robotics (Defence Research Development Organisation, India) where I worked on the development of cost map for a hex-copter using ROS on Jetson TX1 | + | I am also set to present a research paper at the international conference of [http://actse.in/index.php#home ACTSE 2020] and I am currently working on another research paper based on deep learning. I also did an internship at the Center for Artificial Intelligence and Robotics (Defence Research Development Organisation, India) where I worked on the development of a cost map for a hex-copter using ROS on Jetson TX1. |
Since I have worked with BeagleBone Black before, I will start with designing the hardware part of the circuit, and make a dedicated PCB for it. Then I will start with the coding for the deep learning algorithm, using Python. | Since I have worked with BeagleBone Black before, I will start with designing the hardware part of the circuit, and make a dedicated PCB for it. Then I will start with the coding for the deep learning algorithm, using Python. | ||
===Contingency=== | ===Contingency=== | ||
− | If I | + | If I do get stuck on a problem, I believe that I will first start looking into all the systems that are linked to that problem and I will read about those systems in detail and see if I can find other solutions online, so I can get back to the system with a better approach. Since there are a plethora of resources online, about the BeagleBone controllers, Neural Networks and Deep learning, I will be able to find a solution to the problem. |
If, after multiple attempts, if I am still not able to correct the system, I will approach one of my faculties at my university, who has worked in this field of embedded systems and deep learning. | If, after multiple attempts, if I am still not able to correct the system, I will approach one of my faculties at my university, who has worked in this field of embedded systems and deep learning. | ||
===Benefit=== | ===Benefit=== | ||
− | If completed, it will help in understanding the emotions of not only students, but all individuals in all fields who are facing problems regarding mental health, and it can help them seek attention. | + | If completed, it will help in understanding the emotions of not only students, but all individuals in all fields who are facing problems regarding mental health and are unable to get any help or be identified, and it can help them seek attention. |
Include quotes from BeagleBoard.org community members who can be found on http://beagleboard.org/discuss and http://bbb.io/gsocchat. | Include quotes from BeagleBoard.org community members who can be found on http://beagleboard.org/discuss and http://bbb.io/gsocchat. | ||
==Misc== | ==Misc== | ||
− | + | The code for the task can be found in the Github repository [https://github.com/Aneroid666/gsoc-application/tree/new_branch here] submitted through the pull request [https://github.com/jadonk/gsoc-application/pull/143 #143] generated in Github. | |
===Suggestions=== | ===Suggestions=== | ||
Is there anything else we should have asked you? | Is there anything else we should have asked you? |
Revision as of 10:23, 30 March 2020
Contents
Proposal for Emotions Recognition in School Kids using Deep Learning and NLP with BeagleBone Black
A short summary of the idea will go here.
Student: Anirudh Sivakumar
Mentors:
Code: https://github.com/Aneroid666/gsoc-application/tree/new_branch
Wiki: https://elinux.org/BeagleBoard/GSoC/2020Proposal/AnirudhSivakumar
GSoC:
Status
This project is currently just a proposal.
Proposal
Completed all the requirements listed on the ideas page. The code for the task can be found in the Github repository here submitted through the pull request #143 generated in Github.
About you
IRC: Anirudh666
Github: Anirudh666
School: Manipal Institute of Technology, Manipal
Country: India
Primary language : English, Tamil
Typical work hours : 7AM to 9PM IST
About your project
Project name: Emotions Recognition in School Kids using Deep Learning and NLP with BeagleBone Black
Description
School kids are often unrecognized in many of the Asian educational systems. They carry various emotions, right from parent’s fights to getting bullied. Kids often make intangible opinions about their life and future lifestyle based on experienced perception, thus impacting their carrier. The education system of many countries advice to identify such students and make a personal peer to peer counseling system. Apart from human intervention in decision making, we are looking forward to creating a trained algorithm that can identify such induced emotions and identify students who aren’t approachable nor identified by teachers.
Natural Language Processing (NLP) using deep learning algorithm has proven to be the best fit for decision making over human intelligence in speech recognition. A deep learning algorithm is always built and trained over time to make it best fit for small range applications like a mobile app or a desktop executable file.
The project deals in three stages. The first stage includes the use of beaglebone black and a microphone, which is capable enough to record interview voices of students from various schools in India, and store the data via the cloud. The second stage consists of storing data to be fed to a deep learning algorithm and keep training until it identifies as a best-fit percentage and the third stage deals with the design and development of a mobile application to be remotely used and to test the efficiency of the trained algorithm.
The idea behind the project is to identify the emotions of the school kids and their social behavior. This helps the teachers to make more efficient peer to peer counseling. The outcome of the project would be long term research over speech recognition using NPL and Deep learning and help scientific society with best-fit speech samples for future R&D in economically slow countries.
Timeline
Provide a development timeline with a milestone each of the 11 weeks and any pre-work. (A realistic timeline is critical to our selection process.)
Mar 30 | Proposal complete, Submitted to https://summerofcode.withgoogle.com |
Apr 27 | Proposal accepted or rejected |
May 18 | Pre-work complete, Coding officially begins! |
May 25 | Milestone #1, Introductory YouTube video |
June 1 | Milestone #2 |
June 8 | Milestone #3 |
June 15 18:00 UTC | Milestone #4, Mentors and students can begin submitting Phase 1 evaluations |
June 19 18:00 UTC | Phase 1 Evaluation deadline |
June 22 | Milestone #5 |
June 29 | Milestone #6 |
July 6 | Milestone #7 |
July 13 18:00 UTC | Milestone #8, Mentors and students can begin submitting Phase 2 evaluations |
July 17 18:00 UTC | Phase 2 Evaluation deadline |
July 20 | Milestone #9 |
July 27 | Milestone #10 |
August 3 | Milestone #11, Completion YouTube video |
August 10 - 17 18:00 UTC | Final week: Students submit their final work product and their final mentor evaluation |
August 17 - 24 18:00 UTC | Mentors submit final student evaluations |
Experience and approach
I have been part of 2 student project teams. I was in the electronics and control subsystem in Formula Manipal and I am currently the co-founder and electronics and propulsion head in loopMIT. I am also currently in the semi-finals of IICDC 2019 with the project E_agri, which is a smart agricultural system based on IoT. I have a lot of experience in working with electronics and embedded systems. I have also designed a Data Acquisition system using the BeagleBone Black for the Formula Manipal Electric car, which communicated through CAN protocol and acted as the master controller of the system. I am also set to present a research paper at the international conference of ACTSE 2020 and I am currently working on another research paper based on deep learning. I also did an internship at the Center for Artificial Intelligence and Robotics (Defence Research Development Organisation, India) where I worked on the development of a cost map for a hex-copter using ROS on Jetson TX1. Since I have worked with BeagleBone Black before, I will start with designing the hardware part of the circuit, and make a dedicated PCB for it. Then I will start with the coding for the deep learning algorithm, using Python.
Contingency
If I do get stuck on a problem, I believe that I will first start looking into all the systems that are linked to that problem and I will read about those systems in detail and see if I can find other solutions online, so I can get back to the system with a better approach. Since there are a plethora of resources online, about the BeagleBone controllers, Neural Networks and Deep learning, I will be able to find a solution to the problem. If, after multiple attempts, if I am still not able to correct the system, I will approach one of my faculties at my university, who has worked in this field of embedded systems and deep learning.
Benefit
If completed, it will help in understanding the emotions of not only students, but all individuals in all fields who are facing problems regarding mental health and are unable to get any help or be identified, and it can help them seek attention. Include quotes from BeagleBoard.org community members who can be found on http://beagleboard.org/discuss and http://bbb.io/gsocchat.
Misc
The code for the task can be found in the Github repository here submitted through the pull request #143 generated in Github.
Suggestions
Is there anything else we should have asked you?