Archive for the ‘OpenFrameworks’ Category

Machine learning for the maker community

Wednesday, April 27th, 2016


At Arduino Day, I talked about a project I and my collaborators have been working on to bring machine learning to the maker community. Machine learning is a technique for teaching software to recognize patterns using data, e.g. for recognizing spam emails or recommending related products. Our ESP (Example-based Sensor Predictions) software recognizes patterns in real-time sensor data, like gestures made with an accelerometer or sounds recorded by a microphone. The machine learning algorithms that power this pattern recognition are specified in Arduino-like code, while the recording and tuning of example sensor data is done in an interactive graphical interface. We’re working on building up a library of code examples for different applications so that Arduino users can easily apply machine learning to a broad range of problems.

The project is a part of my research at the University of California, Berkeley and is being done in collaboration with Ben Zhang, Audrey Leung, and my advisor Björn Hartmann. We’re building on the Gesture Recognition Toolkit (GRT) and openFrameworks. The software is still rough (and Mac only for now) but we’d welcome your feedback. Installations instructions are on our GitHub project page. Please report issues on GitHub. (more…)

MAKEmatics – Mathematics for Makers

Wednesday, May 9th, 2012

Makers need to familiarize themselves with the core concepts and the theory involved in creating applications such as Motion Sensing and Face Tracking. As the technology is churning out new hardware day and night, DIYers need to work hard to keep up and always be in touch with the latest technology around them.

For example, anyone working with Accelerometers/ Gyroscopes or Inertial Measurement Units needs to understand the theory of Vectors, Force, Gravity and be able to work out complex mathematical problems. They may easily get an Arduino Board and an Accelerometer Breakout or an IMU Board and use a library instead of writing their own code but to truly understand the theory behind it; how the device actually works, is not for the faint of heart.


One such problem is the Face Tracking Application. Unless you know the real theory behind how the Algorithm actually works, you can only wonder about that robot which follows its master. Greg Borenstein had an idea of creating a website dedicated to this issue. Makematics – Math for Makers.


In an introductory post, Greg writes:

” I hope to show that a normal programmer with no special academic training can grapple with these areas of research and find a way in to understanding them. And as I go I aim to create material that will help others do the same. If I can do it, there’s no reason you can’t.”

More and more people should step forward and create or compile a good amount of research data to help fellow makers and DIYers in solving complex mathematical problems.

A revisit to open frameworks

Saturday, May 5th, 2012

Remember this?

A good tutorial by Sparkfun will help us make the above display. Before we begin let us take a few questions on Open Frameworks.

Q> What is Open Frameworks?

openFrameworks is a very handy software library written in C++ that is written for the sole purpose of reducing the software development overhead faced by designers and artists that would like to create pieces that use various media (graphics, sound, video, electronics, etc.).

Q> Why Open Frameworks when there is Processing?

Because there are some things that oF is well suited for that Processing just can’t handle. oF is much better at creating projects that use a lot of 3D Graphics, computer vision libraries like OpenCV or projects that involve the real-time manipulation of video. Also, while Processing requires a Java backend, oF is simply a set of C++ libraries, meaning that developers comfortable with C++ will be right at home.

Q> Where can I find more data and examples on Open Frameworks?

You can start by reading this article.

Try it, it works!


A Wall of 250 Canon Cameras Flashing Their Lights In A Matrix

Wednesday, August 3rd, 2011

Japanese band Androp realized for it’s latest single “Bright Siren” a 250 Flash light-based interactive Matrix.

Japan musicians Androp built a backdrop of 250 Canon cameras and programmed all their flashes to fire off in a sort of digital stop-motion screen.

The “Making of” after the break.


Fluid Dresses And Other Casual Profanities

Monday, January 31st, 2011

[Charlie Bucket]  is developing a personal look towards materials: pumping fluids in tubes to change objects’ (and cloths’, as you see in the video) substance and feeling. Magic-like.

The installation is based on openFrameworks, and uses 6 arduino-driven pumps to make the fluid flowing through the tubes. Very interesting fabrication pictures on Flickr.

More on [] Source [CasualProfanity]

Wireless + Arduino + oF [Tutorial]

Friday, July 23rd, 2010

Nice tutorial letting you wirelessly communicate with oF cia Arduino. Cool.

In the last tutorial we used an openFrameworks application to control a process running on an Arduino board. In this tutorial we’re going to reverse that and use an Arduino board to control an openFrameworks application that’s playing back music and we’ll do it wirelessly and (relatively) inexpensively. The electronics in this tutorial are a little more involved than the previous one because we need an oF application to control and two Arduino controllers: one to send transmit data and one to receive data and communicate with the oF application. There are a whole bunch different ways to do wireless communication that we’ll outline in the section below on wireless but for this tutorial, to mitigate the cost of requiring two Arduinos, I’m going to use inexpensive Radio Frequency (RF) components to send and receive the data.

via []

Flash, Arduino & Parallax Ping

Monday, May 24th, 2010

[Gabor] reports about a simple project with this video to follow. (low down the volume before pressing “play”)

initially i have planned to realize the art project i was writing in my previous post about, in C++ Open Frameworks. Since I had some trouble though getting the range finder data into OF i have settled for Flash which worked out straight away using a flash’s binary socket and a custom written java proxy server by James Alliban. There are still some performance issues i believe that need to be fixed as well as sudden jumps in range values, which i still need pin point down. Anyways…here’s the result.

You may wonder why using OF or Flash and not, simply, Processing. I do as well. That is why the whole project caught my attention.

via [Kapsid]

Arduino-powered kinetic sculpture

Tuesday, April 20th, 2010

Nice Arduino-tentacles-based interactive installation going on in Toronto (video after the break)

Anthros is a project I began working on as my fourth-year university thesis project for New Media at Ryerson University (Toronto, Canada). It uses open source tech (OpenFrameworks, Arduino) to make large tentacle-like nodes follow a user through a space. It was shown at Meta 2010, our thesis project show, in Arta Gallery at the distillery district of Toronto.

The system is run off of a computer tucked away behind a wall. A webcam mounted on the ceiling above the piece is aimed down to see the field of people and tentacles. The computer processes this video stream using OpenFrameworks, ofxOpenCv, and the software written on top of these for managing tentacle positions and calculations. The computer then outputs the data via USB to an Arduino, which controls and updates a servo controller.

Wires run from the servo controller to each node, which includes two high-torque servo motors (x, y axes), which cause the node’s spine to bend in a particular direction, giving it movement. The skin is composed of a lightweight vinyl which has a skin-like texture to help keep the balance between the synthetic and the organic.?