File:GSoC' 19 Mind control project.txt

Summary
=Mind Controlling and Environment Manipulation= The proposed idea uses brain waves i.e alpha, beta, gamma and delta to read the persons brain activity. These are categorised based on the data collected from UCI and attention and meditation level is calculated along the values from different alpha, beta, gamma and delta bands. To convert the raw EEG data to category based numerical data is running on Arduino. So if the attention level id greater than what is specified by the user then the arduino will communicate with single board computer through digital IO pins that will act as a switch and if the attention level is high for 5 seconds then it will send a trigger that will turn on the camera and the single board computer will be running an text detection and text recognition model using Tesseract and OpenCV that will detect the text of the appliances or devices infront of it. After detecting and recognising the text the single board computer using IR will send the command wirelessly to the remote arduino connected to the main power supply of the appliance or device hence it will aloow using your brainwaves and and your gaze to the appliance to control it. The camera will move in the direction of where the user is looking at using servo motors.

Student: Rashbir Singh Mentors: Jason Kridner Code: Github Wiki: GSoC: GSoC entry

=Status= This project has a ready prototype.

=Prerequisite= Here I will input the link to Hello World code.

=About me=
 * IRC: RashbirSingh
 * Github: Github
 * School: Amity School of Engineering and Technology, Noida
 * Country: India
 * Primary language: Hindi and English
 * Typical work hours: 8AM-10PM IST
 * GSoC participation: This is my first time participating in GSoC. As I heard about it from one of my friend and as I have so many projects that uses IoT and Various ML models so I though of giving it a try to see if something good come out of it. I love to learn and GSoC is the best platform for it to work under such smart brains and get professional outlook and learn from people who are best in their race. I love to work in IoT and data field and beagle bone is perfect for that domain that I am looking for, I have been developing projects for past 3 years in IoT and recently started learning data science.
 * Skills: Machine Learning, Data acquiring and data analysis, Data Engineering, Computer vision, Internet of things, Cloud deployment and API generation, circuit designing, Android programming, Natural language processing.
 * Tools(proficient) : Git, Linux, Rapid miner.
 * Operating System: Linux, OSX, Windows.
 * Languages: C, C++, Embedded C, C# Java, Python, Arduino programming.
 * Web front end and backend: HTML, PHP, database and connectivity.
 * Hardware Skills: Raspberry Pi, Arduino, BoltIoT, NodeMCU.

=About your project= Project name: Mind Controlled devices and environment manipulation

Description
This project uses EEG headgear that is a Neurosky and uses Arduino to convert raw brain waves data into interpretable numerical format code for it is available on github that interfaces with single board computer running python script to control the onboard small camera and uses text detection and text recognition and transmits command to another Arduino over IR and wirelessly control the appliance by looking at it and paying attention. It will help people with physical disabilities, speech impairment, old aged and have applications in industrial factories.

Previous Work Done
I have a previous experince with working and using EEG headgear and have a EEG headgear of my own that i can use for this project. To show my ability I would like to share a video of my sample work. Sample work video[Figure 1] for Brain controlled servo based on the data collected using Arduino and Neurosky.

Software part is consist of

 * C++
 * Python
 * linux bash scripting

Hardware used

 * Microcontroller like Arduino
 * Single board computer like Beagleboan or Raspberry pi
 * Infra red lights for communication
 * Relays
 * LEDs
 * on Camera more text detection
 * Servos
 * Bluetooth Module

Methodology


Figure 2. shows the methodology used to develop a device to provide people with ability to turn appliances ON and OFF just by concentrating on the specific appliance. The technology used here is Bluetooth to transfer brainwaves over bluetooth to the Arduino micro-controller from EEG. Then the raw brainwaves are converted to numerical format and if concentration is more than the specified than it sends a trigger to the raspberry pi over GPIOs which then triggers a python script. The script analyse if the concentration to a specific object is more than 5 seconds than the raspberry pi runs a script to take picture of the object which then is analysed by the OCR running with the help of openCV in python environment. If the text says LED then it triggers and supply the power to the LED, hence result in turning the LED on. If the text is not LED then the scripts run again and stay in a constant loop.

Detailed Page
Detailed Description PDF can be found here.

=Timeline= Timeline of milestone

2019-05-27:

 * Pre-work and Elux creation

2019-06-03: Milestone #1

 * Introductory Youtube video and hardware purchasing.

2019-06-10: Milestone #2

 * Understanding the I/O supply and schematics of each sensor, microcontroller, single board computer and other hardware.

2019-06-17: Milestone #3

 * Developing first code and delivering it.

2019-06-24: First evaluation milestone

 * Developing prototype hardware running the code Without IR support.

2019-07-01: Milestone #5

 * Adding cloud support and developing API.

2019-07-08: Milestone #6

 * Adding IR support and multiple micrcontrollers.

2019-07-15: Milestone #7

 * Compacting the size by removing bulky microcontrollers and adding a single chip to made device more mobile and easy to install.

2019-07-22: Second evaluation milestone

 * Delivering the project with compact and optimised version of the device.

2019-08-05: Milestone #9

 * Adding Iris controlled servo for camera.

2019-08-12: Milestone #10

 * Final delivery and quality check.

2019-08-19:

 * Coding completion milestone
 * Completion Youtube video

=Experience= I have 3+ years of experince with micro controllers and single board computers and working on linux for more than 2 years. I have also filled several patents and published several papers in this domain only. Have won several award in my university for most innovative idea and best project idea. I have also worked on very thin deadlines and successfully deliver my promise even if that takes me to spend countless sleepless nights. Please go to my Linkedin to know more about me.


 * Refer this to know project related experience.


 * Please refer my CV to know more about my experience.

=Contingency= I will simply try to first google the solution, refer books. I am good at debugging and a self learner so if one thing fail I will try to find alternative way to implement it. Like one time My wifi module got burned and I had no other module left while my whole script was based on wifi module and was controlling the room using it. So I changed the implementation from Wifi to I2C over usb and converted the whole implementation from HTML to command line based as I had to present the project the next day. So I can surely say that I will find my way out, and in worst case scenario I will ask some professional I personally know to help me out.