Twinkle: Programming with Color
Jay Silver (MIT)
Abstract
Twinkle allows anyone to program using colors in the real world. Twinkle uses a color sensor to read colors from arrangements of objects, drawings, or collages all in the physical world. Those colors are then mapped to certain actions, like sounds, robotic movements, or any type of program execution in the virtual world. The result is that you can program a computer or a robot, or compose a musical score, just by drawing on a piece of paper with crayons. Of course it’s not limited to crayons, you could build your program with Legos, arrange your program with the multi colored leaves of early Fall, or think of any collection of objects in the world as a program, even a handful of M&Ms. The musical score functionality is already implemented and exemplified in the video. Future work, to be finished by January 2010, will include programming robots and computers with color.
Documents
http://tei-conf.org/10/uploads/Program/p383.pdf
Comments (how to comment)
Great demo! (link to target) (edit comment) - Lillian Spina-Caza? @ January 26, 2010, at 05:22 PM
If you are interested, in the TEI '10 Graduate Student Consortium papers I presented a paper about a video game that uses motion detection and color to instigate virtual play (the paper is in the proceedings). In the spring of 2009, I collaborated on a design team to create a prototype of an experimental educational videogame for children that lets them use untethered objects to control gameplay. It was demonstrated at the 2009 Annual Game Festival & Symposium at RPI. See the video demo, link available at my website:
http://www.llc.rpi.edu/pl/students-599/?objectID=718
(hint: password is 'teirox')
(hint: you need to put a username in the 'author' field)
TEI, the conference on tangible, embedded, and embodied interaction, is about HCI, design, interactive art, user experience, tools and technologies, with a strong focus on how computing can bridge atoms and bits into cohesive interactive systems.
Sign-up for our low-volume list to get news & updates on TEI'10.
The official hash tag of TEI'10 is #teiconf. Use this in your tweets to share with other TEIers.
Or, follow our Twitter user, TEI10, to see what we have to say about TEI, in 140 chars or less of course ;-)
TEI 2010 | About | Register | Program | Supporters | Participation | Venue & Travel | Contact