Difference between revisions of "ECE497 Project Gesture Based Control"

From eLinux.org
Jump to: navigation, search
m (Grading Template: Draft Feedback)
(Added a lot more info on the project)
Line 31: Line 31:
 
== Executive Summary ==
 
== Executive Summary ==
  
This project is meant to use gesture control to perform various functions.  The functions are as yet undefined.
+
This project is meant to use gesture control to perform various functions.   
  
The project can accurately detect gestures using the Sparkfun Breakout for the Avago APDS 9960.
+
The project can accurately detect gestures using the Sparkfun Breakout for the Avago APDS 9960.
  
Literally all I have working is an accurate detection of gestures.  There is nothing to control yet.  This was the result of extremely poor planning on my part.
+
The gesture sensor can control an etch-a-sketch game on the LED Matrix.
 
 
I am hoping to get the gesture sensor to control inputs and outputs today.
 
  
 
== Packaging ==
 
== Packaging ==
Line 55: Line 53:
 
== User Instructions ==
 
== User Instructions ==
  
Once everything is installed, how do you use the program?  Give details here, so if you have a long user manual, link to it here.
+
Run the program using node
 +
 
 +
 
  
 
== Highlights ==
 
== Highlights ==
  
Here is where you brag about what your project can do.
+
The project can control an Etch-a-Sketch game on the LED Matrix.  Swiping in any direction will cause the corresponding LED on the matrix to light up.  The purpose of this is to be able to draw a picture on the LED matrix without physically touching any hardware.
  
 
Include a [http://www.youtube.com/ YouTube] demo.
 
Include a [http://www.youtube.com/ YouTube] demo.
Line 65: Line 65:
 
== Theory of Operation ==
 
== Theory of Operation ==
  
Give a high level overview of the structure of your software.  Are you using GStreamer?  Show a diagram of the pipelineAre you running multiple tasks?  Show what they do and how they interact.
+
The software uses an interrupt to detect whether a new gesture was received by the sensor.   
  
 
== Work Breakdown ==
 
== Work Breakdown ==
Line 71: Line 71:
 
Interfacing with the APDS-9960 - Jake Bellis
 
Interfacing with the APDS-9960 - Jake Bellis
  
This is the only thing completely as of now as I had a really bad quarter.  The only thing I am able to accomplish is detecting whether a hand was swiped left, right, up, or down over the sensor.
+
This is the only thing completely as of now as I had a really bad quarter.  The only thing I am able to accomplish is detecting whether a hand was swiped left, right, up, or down over the sensor.  This took a lot of work, as the two main i2c packages that I tried initially (Bonescript and i2c) did not
 +
 
 +
Controlling an Etch-a-Sketch Game - Jake Bellis
 +
 
 +
The gesture recongition software can control an Etch-a-Sketch game on an 8x8 LED Matrix adapted from previous exercises.
  
 
== Future Work ==
 
== Future Work ==
  
With the time constraints, I was only able to detect up, down, left, and right gestures.  I would like to be able to detect more complex gestures in the future.  Additionally, I would like to do more complex tasks with gesture control that were not implemented in this project.
+
With the time constraints, I was only able to detect up, down, left, and right gestures.  I would like to be able to detect more complex gestures in the future.  Additionally, I would like to do more complex tasks with gesture control that were not implemented in this project.  I would also like to make a game using gestures which would require more accurately sensing hand motions.
  
 
== Conclusions ==
 
== Conclusions ==
  
Give some concluding thoughts about the project. Suggest some future additions that could make it even more interesting.
+
I am happy that I got gesture based control to work fairly well on the beaglebone black using the Avago APDS 9960.
  
 
{{YoderFoot}}
 
{{YoderFoot}}

Revision as of 21:20, 13 November 2016

thumb‎ Embedded Linux Class by Mark A. Yoder


Team members: Jake Bellis

Grading Template

Draft Feedback

Good you see you are getting this started. Needs much more work.


I'm using the following template to grade. Each slot is 10 points. 0 = Missing, 5=OK, 10=Wow!

00 Executive Summary
00 Installation Instructions 
00 User Instructions
00 Highlights
00 Theory of Operation
00 Work Breakdown
00 Future Work
00 Conclusions
00 Demo
00 Late
Comments: I'm looking forward to seeing this.

Score:  10/100

(Inline Comment)

Executive Summary

This project is meant to use gesture control to perform various functions.

The project can accurately detect gestures using the Sparkfun Breakout for the Avago APDS 9960.

The gesture sensor can control an etch-a-sketch game on the LED Matrix.

Packaging

If you have hardware, consider Small Build, Big Execuition for ideas on the final packaging.

Installation Instructions

Give step by step instructions on how to install your project.

  • Include your github path as a link like this to the read-only git site: https://github.com/MarkAYoder/gitLearn.
  • Be sure your README.md is includes an up-to-date and clear description of your project so that someone who comes across you git repository can quickly learn what you did and how they can reproduce it.
  • Include a Makefile for you code.
  • Include any additional packages installed via opkg.
  • Include kernel mods.
  • If there is extra hardware needed, include links to where it can be obtained.

User Instructions

Run the program using node


Highlights

The project can control an Etch-a-Sketch game on the LED Matrix. Swiping in any direction will cause the corresponding LED on the matrix to light up. The purpose of this is to be able to draw a picture on the LED matrix without physically touching any hardware.

Include a YouTube demo.

Theory of Operation

The software uses an interrupt to detect whether a new gesture was received by the sensor.

Work Breakdown

Interfacing with the APDS-9960 - Jake Bellis

This is the only thing completely as of now as I had a really bad quarter. The only thing I am able to accomplish is detecting whether a hand was swiped left, right, up, or down over the sensor. This took a lot of work, as the two main i2c packages that I tried initially (Bonescript and i2c) did not

Controlling an Etch-a-Sketch Game - Jake Bellis

The gesture recongition software can control an Etch-a-Sketch game on an 8x8 LED Matrix adapted from previous exercises.

Future Work

With the time constraints, I was only able to detect up, down, left, and right gestures. I would like to be able to detect more complex gestures in the future. Additionally, I would like to do more complex tasks with gesture control that were not implemented in this project. I would also like to make a game using gestures which would require more accurately sensing hand motions.

Conclusions

I am happy that I got gesture based control to work fairly well on the beaglebone black using the Avago APDS 9960.




thumb‎ Embedded Linux Class by Mark A. Yoder