Color Vision & Skits

[Synaptein]

After reading through the forum, I've learned that Pleo's vision is limited, especially with access from the USB/UART connection we can make with him via the belly ports.

I am currently playing with some of the third-party applications for pleo. I used to use a terminal for pleo access (using USB connection), but started to use DinoMite. I've additionally began to dabble with MySkit.

Does anybody know an easy way (or if it's possible) using the available third-party applications to make pleo run a certain skit depending on what color he sees? For example, if he was shown a blue object or line, he would run skit1. If he was shown a red object, he would run skit2, etc.

If not with third party applications, this should probably be doable through PAWN?

Thanks for any info and/or insight into this!

[hobbesi]

I very much doubt that’s possible. If I understand correctly Color recognition is like any other object recognition, in that Pleo needs to be programmed to distinguish one color from another. Currently life OS only recognizes colors in the green/yellow range for leaf detection.

To have a Pleo that recognizes lots of different colors and play appropriate skits would require a new personality programmed to recognize those colors and play custom skits.

If I’m wrong.. Please let me know. ;)

[mweed]

You are basically correct. SO, you could create the skit with MySkit, but you'll have to wait for the PDK to come out as color recognition will require programming with pawn.

[PleoMiami]

What I can tell you is that Pleo definitely has color recognition. Try using the "camera average" command in Dino-MITE and you'll get 3 numbers back in YUV format representing the average color value across all pixels in Pleo's camera. Internally, Pleo's color feedback can be changed between Mono, RGB (the one you probably want), and YUV - I haven't been able to change the feedback from the camera average command to be anything other than YUV, though.

To convert between YUV and RGB you'll have to do some math: http://www.fourcc.org/fccyvrgb.php

[Synaptein]

What I can tell you is that Pleo definitely has color recognition. Try using the "camera average" command in Dino-MITE and you'll get 3 numbers back in YUV format representing the average color value across all pixels in Pleo's camera. Internally, Pleo's color feedback can be changed between Mono, RGB (the one you probably want), and YUV - I haven't been able to change the feedback from the camera average command to be anything other than YUV, though.

To convert between YUV and RGB you'll have to do some math: http://www.fourcc.org/fccyvrgb.php

Thanks for the replies all.

PleoMiami, thanks for the suggestion. I have used the "average" color recognition that you mentioned, but it unfortunately never very reliable. I never get a consistent reply from pleo (if at all) when I send the average command.

The "average" would be almost exactly what I was looking for if it wasn't so unreliable. :(