Mindsensors NXTCam, What To Do With It

[srobot]

My project is very different then other projects here, mine is about using the Mindsensors NXTCam which is a camera for the Lego Mindstorms NXT robot.

With the NXTCam you do not need a computer for processing, it's all on board!

NXTCam Identifying Red and Blue Balls:

hS7gO-cM2mA

#97 Most Viewed (Today) [September 19 2007] - Howto & DIY

#90 Most Viewed (Today) [September 20 2007] - Howto & DIY

#77 - Most Linked (This Week) [September 21 2007] - Howto & DIY

#64 - Most Linked (This Week) [September 22 2007] - Howto & DIY

#57 - Most Linked (This Week) [September 23 2007] - Howto & DIY

NXTCam Tracking a Ball:

WC8XTcq3JvI

#98 Most Viewed (Today) [September 19 2007] Howto & DIY

#92 Most Viewed (Today) [September 20 2007] Howto & DIY


NXTCam Tracking A Lamp Shade:

iUfF0p8to_w

In the bottom two videos I made color maps with AVRCamView from JRobot (http://jrobot.net), and that's it (and videos of course).

In the top video I used NXTCamView created by Paul Tingey (http://www.tingeys.com) to make the color maps. And used custom NXTCam NXT-G programming blocks created by Mindsensors, for the programming (I used blocks from Lego for the voice, flow, etc. in the program).

The color maps are used to identify colors, like red and blue in the top video.

The NXTCam takes up to 8 color maps, but you can just use 1 if you want.

So the part I did in the top video was:

1) Make the robot (easy, just put a few parts together)

2) Use NXTCamView to create a color map

3) Use NXT-G blocks to make a program.

I was the only known person in the beta test group to get off the AVRCamView and NXTCamView (sending video back to the computer), and program a true robot that works.

Please note that Mindsensors is working on the above to make it easier.

The way I see it is the part I did is like using a RN-1, adding a gyro, and programming it with custom code in RoboBasic.

There was no docs/how tos supplied, all I had was a Lego Mindstorm NXT kit, a computer, NXT-G programming blocks, NXTCamView, AVRCamView, and a NXTCam.

There was no examples on how to program it, I had to do that myself (In the finale release I'm sure there will be instructions and examples).

The last I heard it should retail for about $100 (well worth it), although don't quote me on that.

While the beta version uses a serial port to connect to a computer, the finale one will come preassembled with a USB port.

If you have any more questions let me know.

More to come.

http://www.Mindsensors.com

--Scotty

[Dave]

That's pretty cool. Does it come with the video processing software shown in the video?

[srobot]

I don't know the latest on software, but the stuff in the bottom two videos is AVRCamView from JRobot.

I *think* they are going to use NXTCamView (created by one of the beta testers) which I used for making color maps in the top video.

They have an NXT-G block for programming.

If you would like I will explain this further tomorow.

--Scotty

[Alex]

This is indeed pretty cool Scotty! We'd love to hear more about it.

However, I have to ask, is this a demonstration of software that comes with Mindsensors NXTCam, or did you write the algorithms for the vision tracking and color recognition yourself? If it's a demonstration of the software, then we really can't enter it into the contest, sorry:(

[srobot]

This is indeed pretty cool Scotty! We'd love to hear more about it.

However, I have to ask, is this a demonstration of software that comes with Mindsensors NXTCam, or did you write the algorithms for the vision tracking and color recognition yourself? If it's a demonstration of the software, then we really can't enter it into the contest, sorry:robotsad:

I understand.

In the bottom two videos I made color maps with AVRCamView from JRobot, and that's it (and videos of course).

In the top video I used NXTCamView created by Paul Tingey (http://www.tingeys.com/) to make the color maps. And used custom NXTCam NXT-G programming blocks created by Mindsensors, for the programming (I used blocks from Lego for the voice, flow, etc. in the program).

The color maps are used to identify colors, like red and blue in the top video.

The NXTCam takes up to 8 color maps, but you can just use 1 if you want.

So the part I did in the top video was:

1) Make the robot (easy, just put a few parts together)

2) Use NXTCamView to create a color map

3) Use NXT-G blocks to make a program.

I was the only known person in the beta test group to get off the AVRCamView and NXTCamView (sending video back to the computer), and program a true robot that works.

Please note that Mindsensors is working on the above to make it easier.

The way I see it is the part I did is like using a RN-1, adding a gyro, and programming it with custom code in RoboBasic.

There was no docs/how tos supplied, all I had was a Lego Mindstorm NXT kit, a computer, NXT-G programming blocks, NXTCamView, AVRCamView, and a NXTCam.

There was no examples on how to program it, I had to do that myself (In the finale release I'm sure there will be instructions and examples).

The last I heard it should retail for about $100, although don't quote me on that.

If you have any more questions let me know.

--Scotty

[Alex]

Thanks for all the info Scotty, that's the kind of stuff we like to hear about for project submissions;)

Thanks for the submission!

[srobot]

The top video has gotten these honors:

#97 Most Viewed (Today) [September 19 2007] - Howto & DIY

#90 Most Viewed (Today) [September 20 2007] - Howto & DIY

#77 - Most Linked (This Week) [September 21 2007] - Howto & DIY

#64 - Most Linked (This Week) [September 22 2007] - Howto & DIY

#57 - Most Linked (This Week) [September 23 2007] - Howto & DIY

--srobot

[srobot]

Mindsensors is now taking preorders!

NXTCams will ship on Oct 12th 2007

Price: $97.75 USD

From the Mindsensors website:

"This camera connects directly to NXT and supports tracking of upto 8 objects.

Connects to NXT on a sensor port
Connects to computer using USB interface
Tracks upto 8 objects (with 8 different user defined colors) at 30fps
Provides realtime tracking statistics to NXT
Maximum power consumption: 5V at 57 mA
PC not needed for autonomous operation on NXT
Supported environments: NXT-G, RobotC"
http://www.mindsensors.com

--Scotty

[Alex]

Awesome!! I can't wait for us to start carrying mindstorms, so we can start checking out all of this cool stuff you've been working with:D