File:GSoC' 19 Mind control project.txt

Summary
=ProposalTemplate =

The proposed idea uses brain waves i.e alpha, beta, gamma and delta to read the persons brain activity. These are categorised based on the data collected from UCI and attention and meditation level is calculated along the values from different alpha, beta, gamma and delta bands. To convert the raw EEG data to category based numerical data is running on Arduino. So if the attention level id greater than what is specified by the user then the arduino will communicate with single board computer through digital IO pins that will act as a switch and if the attention level is high for 5 seconds then it will send a trigger that will turn on the camera and the single board computer will be running an text detection and text recognition model using Tesseract and OpenCV that will detect the text of the appliances or devices infront of it. After detecting and recognising the text the single board computer using IR will send the command wirelessly to the remote arduino connected to the main power supply of the appliance or device hence it will aloow using your brainwaves and and your gaze to the appliance to control it. The camera will move in the direction of where the user is looking at using servo motors.

Student: Rashbir Singh Mentors: Jason Kridner Code: https://github.com/RashbirSingh/MindControll Wiki: https://elinux.org/index.php?title=File:GSoC%27_19_Mind_control_project.txt&oldid=488926 GSoC: GSoC entry

=Status= This project has a ready prototype.

=Proposal= Please complete the requirements listed on the ideas page and fill out this template.

About you

 * IRC: RashbirSingh
 * Github: https://github.com/RashbirSingh
 * School: Amity School of Engineering and Technology, Noida
 * Country: India
 * Primary language: Hindi and English
 * Typical work hours: 8AM-10PM IST
 * GSoC participation: This is my first time participating in GSoC. As I heard about it from one of my friend and as I have so many projects that uses IoT and Various ML models so I though of giving it a try to see if something good come out of it. I love to learn and GSoC is the best platform for it to work under such smart brains and get professional outlook and learn from people who are best in their race. I love to work in IoT and data field and beagle bone is perfect for that domain that I am looking for, I have been developing projects for past 3 years in IoT and recently started learning data science.
 * Skills: Machine Learning, Data acquiring and data analysis, Data Engineering, Computer vision, Internet of things, Cloud deployment and API generation, circuit designing, Android programming, Natural language processing.
 * Tools(proficient) : Git, Linux, Rapid miner.
 * Operating System: Linux, OSX, Windows.
 * Languages: C, C++, Embedded C, C# Java, Python, Arduino programming.
 * Web front end and backend: HTML, PHP, database and connectivity.
 * Hardware Skills: Raspberry Pi, Arduino, BoltIoT, NodeMCU.

About your project
Project name: Mind Controlled devices and environment manipulation

Description
This project uses EEG headgear that is a Neurosky and uses Arduino to convert raw brain waves data into interpretable numerical format code for it is available on github that interfaces with single board computer running python script to control the onboard small camera and uses text detection and text recognition and transmits command to another Arduino over IR and wirelessly control the appliance by looking at it and paying attention. It will help people with physical disabilities, speech impairment, old aged and have applications in industrial factories.

It uses languages like:

 * C++
 * Python
 * linux bash scripting

For hardware It uses:

 * Microcontroller like Arduino
 * Single board computer like Beagleboan or Raspberry pi
 * Infra red lights for communication
 * Relays
 * LEDs
 * on Camera more text detection
 * Servos
 * Bluetooth Module

=Timeline= Timeline of milestone

2019-05-27:

 * Pre-work and Elux creation

2019-06-03: Milestone #1

 * Introductory Youtube video and hardware purchasing.

2019-06-10: Milestone #2

 * Understanding the I/O supply and schematics of each sensor, microcontroller, single board computer and other hardware.

2019-06-17: Milestone #3

 * Developing first code and delivering it.

2019-06-24: First evaluation milestone

 * Developing prototype hardware running the code Without IR support.

2019-07-01: Milestone #5

 * Adding cloud support and developing API.

2019-07-08: Milestone #6

 * Adding IR support and multiple micrcontrollers.

2019-07-15: Milestone #7

 * Compacting the size by removing bulky microcontrollers and adding a single chip to made device more mobile and easy to install.

2019-07-22: Second evaluation milestone

 * Delivering the project with compact and optimised version of the device.

2019-08-05: Milestone #9

 * Adding Iris controlled servo for camera.

2019-08-12: Milestone #10

 * Final delivery and quality check.

2019-08-19:

 * Coding completion milestone
 * Completion Youtube video

=Experience and approach= I have 3+ years of experince with micro controllers and single board computers and working on linux for more than 2 years. I have also filled several patents and published several papers in this domain only. Have won several award in my university for most innovative idea and best project idea. I have also worked on very thin deadlines and successfully deliver my promise even if that takes me to spend countless sleepless nights. Please go to my Linkedin to know more about me.

=Contingency= I will simply try to first google the solution, refer books. I am good at debugging and a self learner so if one thing fail I will try to find alternative way to implement it. Like one time My wifi module got burned and I had no other module left while my whole script was based on wifi module and was controlling the room using it. So I changed the implementation from Wifi to I2C over usb and converted the whole implementation from HTML to command line based as I had to present the project the next day. So I can surely say that I will find my way out, and in worst case scenario I will ask some professional I personally know to help me out.

=Benefit= If successfully completed, what will its impact be on the BeagleBoard.org community? Include quotes from BeagleBoard.org community members who can be found on http://beagleboard.org/discuss and http://bbb.io/gsocchat.

=Suggestions= Is there anything else we should have asked you?