Geek-Press

14Aug/110

Shell Scripting

For the first time in 10 years of programming someone asked for a shell script to do a bunch of operations.

I had never done such thing but I tought it should be easy.

One thing that helped me a lot was this cheat sheet. Extremelly usefull for some basic operations.

Also I was faced with a problem: How to get a dump of a pg database that is on a remote machine?

Well, I found a nice approach thanks to www.stackoverflow.com website. So here is the a little sample on how to perform that:

ssh $USERNAME@$HOSTNAME "pg_dump -f /dev/stdout -t tb1 -t tb2 -t tb3 dbname" &gt; /export/bin/dbexport.sql err=$? if [ $err -ne 0 ]; then   echo "Dump failed with error code ${err}!" fi

Was this usefull or what?

Tagged as: Shell Script No Comments

26Jul/110

First Demo

Ok, so here is my first demo... Simple stuff, basically I have 2 views, one with the RGB VideoStream and another with the DepthFieldStream.

Pretty similar to the one of the Channel9 tutorial with some minor changes like I'm not using 3 diferent distance keys to draw the colors and implemented a grayscale colouring depending on the distance.... so it becomes a very smooth...

Here's a vid about it

Tagged as: Kinect No Comments

26Jul/117

Kinect + Emgu

Sorry about the inactivity but having and a daytime job and girlfriend sometimes leaves us without time.

Started to play with Computer Vision and Kinect, didn't done a big thing but I was completly unaware of how CV works and after reading a while about it I hear that Emgu is a great wrapper for openCV library.

In fact you can do some face detection without any worries at all.

So let's do a hands-on on this library

For this example you need

Microsoft Kinect SDK

Emgu Wrapper

and to make things even more easier Coding4Fun Kinect Toolkit

This last one is great for helping to pass the kinect raw data to bitmaps

I strongly recommend to read the Emgu documentation before using it... it may be tricky

So let's start by creating a new windows project, after that it's time to add the references.

Add the Microsoft.Research.Kinect reference that can be found on the .NET references and then the Coding4Fun dll, and all the dlls needed for Emgu.

As you can see Emgu as lots of references and on the bin folder you should add the unmanaged libraries like

cvextern.dll, opencv_calib3d220 and so on... As I said before check the Emgu documentation to know what to do...

On the design view I added a EmguCV.UI.ImageBox and called it imageBox1.

On the code I added

using Emgu.CV;
using Emgu.CV.UI;
using Emgu.CV.Structure;
using Emgu.Util;
using Emgu.CV.CvEnum;
using Microsoft.Research.Kinect.Nui;
using Coding4Fun.Kinect.WinForm;

This is all the using you will need to a simple a Face Detection.

To make this work we will need 3 objects

Kinect.Nui.Runtime,

Emgu.CV.Image

and since the face detection will use the HaarCascade Algorithm we will use the HaarCascade object provided by Emgu

HaarCascade algorith need an xml file from where it will learn the patterns to recognize a face, there are a lot of files for face detection over the internet and you can create your own following this guide as an example (there are lot's of other guides covering this topic)

haar = new HaarCascade("haarcascade_frontalface_alt_tree.xml");

will populate the the haarCascade object with that file.

Then it's time to initialize the kinect. For now I will only need the RGB camera so I will use the RuntimeOption.UseColor.

We also need to create the event VideoFrameReady in order to get the frames we are working with and finally open the VideoStream.

For those who are not familiar with VideoStream.Open, it will support 4 parameters, the ImageStreamType, poolSize (the minimun value is 2, this will work as a backbuffer for storing data in memory), the ImageResolution and finaly the ImageType:

kinect.Initialize(RuntimeOptions.UseColor);
kinect.VideoFrameReady += new EventHandler(kinect_VideoFrameReady);
kinect.VideoStream.Open(ImageStreamType.Video, 2, ImageResolution.Resolution640x480, ImageType.Color);

and this is it... the complete constructor should look like this:

public Form1()
{
      InitializeComponent();
      haar = new HaarCascade("haarcascade_frontalface_alt_tree.xml");
      kinect.Initialize(RuntimeOptions.UseColor);
      kinect.VideoFrameReady += new EventHandler(kinect_VideoFrameReady);
      kinect.VideoStream.Open(ImageStreamType.Video, 2, ImageResolution.Resolution640x480, ImageType.Color);
}

Now when there is a VideoFrameReady the event will be fired and call kinect_VideoFrameReady method. it will receive the sender and an ImageFrameReadyEventArgs where you can find the image data generated by the sdk

The first task will be convert the captured image to a bitmap and convert it again to a Emgu image so it can be processed

 Image kinImage = new Image(e.ImageFrame.ToBitmap());

this does the trick!

then using the Emgu colored image we will process that nasty face detection

So we will convert the the Colored Emgu Image to a Grayscale one (better for image processing):

   Image grayframe = nextFrame.Convert();

and then we will retrieve all the faces detected on that frame using the haarCascade:

 grayframe.DetectHaarCascade(
                                    haar, 1.4, 4,
                                    HAAR_DETECTION_TYPE.DO_CANNY_PRUNING,
                                    new Size(grayframe.Width / 8, grayframe.Height / 8)
                                    )[0];

and finally for each face detected we will get the face rectangle and draw it over the initial image,

  foreach (var face in faces)
                    {                         
nextFrame.Draw(face.rect, new Bgr(0, double.MaxValue, 0), 3);                    
 }

and finally set the image to the imagebox1.

imageBox1.Image = nextFrame;

for the lazy ones here is who like to copy paste without understanding the code (can't figure why they do it) here it goees:

void kinect_VideoFrameReady(object sender, ImageFrameReadyEventArgs e)
      {
            Image kinImage = new Image(e.ImageFrame.ToBitmap());
            using (Image; nextFrame = kinImage)
            {
                if (nextFrame != null)
                {
                    // there's only one channel (greyscale), hence the zero index
                    Image grayframe = nextFrame.Convert();
                    var faces =
                            grayframe.DetectHaarCascade(
                                    haar, 1.4, 4,
                                    HAAR_DETECTION_TYPE.DO_CANNY_PRUNING,
                                    new Size(grayframe.Width / 14, grayframe.Height / 14)
                                    )[0];
                    foreach (var face in faces)
                    {
                        nextFrame.Draw(face.rect, new Bgr(0, double.MaxValue, 0), 3);
                    }
                    imageBox1.Image = nextFrame;
                }
            }
        }

So as you can see easy code 😀

you can download the .cs file with all the code needed to do it

Here is a small demo of how it works, i'm sorry about the low framerate (my capture software sucks) and bad light conditions but it's already 2am and my girlfriend is sleeping next to me so it's better to don't have more light.

But it's nice too see that it still can detect my face in such bad lightning conditions 🙂
with good lightning, the detection occurs flawlessly

Tagged as: Emgu, Kinect 7 Comments

26Jul/113

Kinect SDK + EmguCV

I guess that it's better to start with the basics

Let's try to login in our application with face recognition 🙂

Today I will start creating some controls to play with kinect. The first one will be a Login Control and I thought it will be great if I create a face recognition for use, and speech recognition to insert the password.

Later on I will post some code and the control code be aware 🙂

Tagged as: Emgu, Kinect 3 Comments

21Jul/110

Power Supply Adapter has arrived

Almost miss the carrier delivery but I managed to get the power supply today so it's time to start downloading the sdk and development IDE

Filed under: My Projects No Comments

21Jul/110

Requirements

As I believe, if you're reading this blog probably you are interested in develop over kinect or you're already doing it.

For those who are interested in start to code on kinect, please follow this link to Kinect SDK QuickStart Series.

But that will not be enough... so I sugest you also download the Coding4Fun Kinect Toolkit. There you will be able to find all the starting resources you need.

It will take some time to get the Enviromnent running but it's worthy.

Filed under: My Projects No Comments

21Jul/110

Still Waiting

Right now I am anxiously waiting for the Kinect Power Supply Adapter to arrive and put the hand on...

Tagged as: Kinect No Comments

« Newer Entries

Geek-Press Geeky Blog about software development

Shell Scripting

First Demo

Kinect + Emgu

Kinect SDK + EmguCV

Power Supply Adapter has arrived

Requirements

Still Waiting

Language

Tags

Categories

Links