Camera and IR?

[MsKtty89]

I know at first Pleo only had an IR sensor to not run into things, but now it has a camera...

What exactly can it "see"? Can it tell colours or shapes?

[amjoie]

From: The Pleo FAQ (taken from official answers to our questions)

http://forums.pleoworld.com/showthread.php?t=75

Can Pleo see in color? Can he see and recognize faces?

Pleo has a color camera to enable him to distinguish objects and edges in certain conditions, but he will not be able to recognize people or faces. PleoWorldHost

[MsKtty89]

Ooooh. Thanks. =) I wonder if that'll change in the future of Pleo...

[cmadmacs]

From the newest video that Ugobe released the camera seems to work very well at object reconition.

[ryane]

From the newest video that Ugobe released the camera seems to work very well at object reconition.

i wonder though if pleo will have true object recognition. i hope so!:D i mean to know a ball by it's shape,

colored or not. he was tracking a ball in the new video, but he could have been tracking the color red. i think

it was red wasn't it? anyway, this also makes me wonder about his training leaf, if pleo will recognize the

color or the actual object. object recognition would be a pretty advanced feature to be included in pleo for

350 bucks!

[cmadmacs]

most likely color.

[MikeCoscia]

Couldn’t what pleo recognizes all be upgraded through a software download? A camera is a camera, it’s how that video feed is interpreted that gives rise to different features. Unless pleo just doesn't have enough processing power to handle it.

[mweed]

Yes, that is exactly the case. The underlying question is whether the PleoDK that Ugobe plans to roll out this fall gives us access to the camera at a low enough level in the code to do something with it, or if we have to wait for Ugobe to develop the enhancements.

[PleoWorldHostCami]

Couldn’t what pleo recognizes all be upgraded through a software download? A camera is a camera, it’s how that video feed is interpreted that gives rise to different features. Unless pleo just doesn't have enough processing power to handle it.

Indeed Pleo's vision can be improved and changed through future software downloads. The ARM7 used for processing is a pretty powerful chip.

[cmadmacs]

Thanks for the information.

[richyroolahs]

Hello. I was just considering a cool IR feature that I thought I might share with the rest of you.
What about when two pleos are together, one might teach the other bad habits like biting hands, etc. But just imagine if one pleo could learn to use a custom sound from another pleo and download it via the IR link. Now that would be interesting. Also, Pleos could create their own private IP type identification, so one pleo might wag his tail and approach another familiar pleo.

Tell me what you think.

Thanks for reading. :rolleyes:
Rich

[ryane]

it sounds possible. you should be able to send a sound file with ir. i know it's possible to share files via ir with my pda. the pleos would have to be perfectly aligned and at a close distance. cool ideas!

[mweed]

I like the idea if each Pleo having a unique ID in its code so that other Pleos can identify each other. I don't think Ugobe has built that in yet, but maybe we can talk them into it! ;)

[brian55127]

From the FAQ: Pleo has a color camera to enable him to distinguish objects and edges in certain conditions, but he will not be able to recognize people or faces.

Could anyone please explain further what is pleo's color camera capabilities? I would guess the camera is mainly for detecting edges of objects (so he won't walk off tables), but since it is color, was it designed specifically to have pleo recognize and be attracted to certain shapes and/or colors? What specifically are these "certain conditions?" I know I've read in other places that pleo does not have a "memory" of locations or things, so his edge avoidance and/or attraction to certain shapes and colors must be written directly in the code?

[Lu Bu]

His camera does have object recognition, though its object recognition focuses on bright colors, such as red.

[brian55127]

His camera does have object recognition, though its object recognition focuses on bright colors, such as red.

Thanks LuBu! So does bright green and red classify as colors that Pleo focuses on? What about orange or yellow? Does his object recognition have any concept of linear, round, or jagged edges? (Like would he gravitate towards a green leaf shape more than a green ball?

[kchamster]

hmm good question

[Lu Bu]

Thanks LuBu! So does bright green and red classify as colors that Pleo focuses on? What about orange or yellow? Does his object recognition have any concept of linear, round, or jagged edges? (Like would he gravitate towards a green leaf shape more than a green ball?

I'm not a UGOBE worker, but I think Pleo's camera isn't as sophisticated as you think. Pleo probably has one of those cameras used in RSV2 and RS Media, which both have color cameras. I think Pleo would gravitate to basic shapes easier, such as squares, circles, rectangles, etc. instead of non polygraphic shapes such as: his leaf, and other sophisticated shapes.

BUT----

You can improve Pleo's vision via software, this can be capable, because the processor used in Pleo is a 32-bit ARM7 Processor, which is a very powerful chip.

But right now, with his weak, current software, he would probably focus on bright colors and can gravitate and detect polygraphic shapes.

[dschenekl]

Here is something interesting my Pleo is attracted dark objects (e.g. black). I have tried different shades of colors as a test and dark colors win every time. Hmm, who knows, I am interested if anyone else is experiencing this.

[Lu Bu]

Here is something interesting my Pleo is attracted dark objects (e.g. black). I have tried different shades of colors as a test and dark colors win every time. Hmm, who knows, I am interested if anyone else is experiencing this.

Including dark red, dark green and shady brown?

[eric]

Colour cam is need for better edge sense & i bet UGOBE is working on object tracking too just like RSV2

I'd like to thank the users of the forum who keep bringing up i-Cybie even tho he's a dead project he was the start! (along side aibo of course)

[Lu Bu]

Colour cam is need for better edge sense & i bet UGOBE is working on object tracking too just like RSV2

I'd like to thank the users of the forum who keep bringing up i-Cybie even tho he's a dead project he was the start! (along side aibo of course)

Does that include me, 'cause I got 'I-Cybie = Medium Ranged Robot' in my sig?

[degers]

Dear Ugobe Person,
Is the colour camera and force feedback sensors on the motors implemented in the current version of the LifeOS?
Currently I fail to see any implementation of the camera or the force feedback sensors.
Is the ledge recognition implemented by way of the optical camera or via IR sensors, or are the IR sensors purely for communication with other Pleos?

Many Thanks

P.s. if anyone has any answers for me other than UGOBE please feel free to speculate in this thread also! :)

[degers]

I recieved word from ugobe during a customer care chat that the force feedback sensors are not implemented at this time.

[Caaahl]

I recieved word from ugobe during a customer care chat that the force feedback sensors are not implemented at this time.

The sensors itself are not implemented or the software support for it!? :confused:

Because they are doing advertise on http://pleoworld.com/discover/lookinside with the force feedback sensors. :rolleyes:

[eric]

maybe pleo's pet can help with his one? hes already stripped his test pleo

also iv love a cost break down on pleo to see how much he actually costs!

[ryane]

maybe pleo's pet can help with his one? hes already stripped his test pleo

also iv love a cost break down on pleo to see how much he actually costs!

probably costs less then half the retail price. i'm only guessing though maybe less then that. it would be interesting to know the exact amount.

[degers]

The sensors itself are not implemented or the software support for it!? :confused:

Because they are doing advertise on http://pleoworld.com/discover/lookinside with the force feedback sensors. :rolleyes:

The force feedback sensors are there, but there is no software currently implemented to deal with the data from them.

[degers]

More Info from ugobe:

Me:Hi there. Does Pleo detect surface edges using the colour camera or the infrared transciever in his head?
UGOBE:The Pleo uses the combination of the camera and IR to detect surface edges.

Me:What functions does the colour camera currently perform in the current LifeOS release?
UGOBE:At the present time the purpose of the camera has not been expanded.

So I take it that the camera is not currently working to full function, maybe this accounts for the lack of object tracking etc.

[ryane]

i wonder if the processers in pleo are capable of handling data from the camera, mics, and touch sensors all at one time?

i mean, i wonder if reaction to touch stimulus would become slower if the camera and mics are used to potential?

[degers]

The camera has a separate processor.

[ryane]

The camera has a separate processor.

i know. 32 bit.

[degers]

LOL ok ryane :) u win that round.

[ryane]

32 bit arm 7 i should say Lol

[ryane]

i know it has the two processors, central and imaging, but wouldn't the low ram make it harder to "sense" with everything going on at once?(without some slower reaction) would it be too much data to interpret? the camera has it's own localized intelligence, but then it still has to filter through the main cpu right? maybe they compress it enough that it's not so much memory?

[Caaahl]

i know it has the two processors, central and imaging, but wouldn't the low ram make it harder to "sense" with everything going on at once?(without some slower reaction) would it be too much data to interpret? the camera has it's own localized intelligence, but then it still has to filter through the main cpu right? maybe they compress it enough that it's not so much memory?

I'm quite sure the guys at UGOBE factored that in. It would be really "not clever" to include sensors, which can not be handled by the hardware.

[degers]

i know it has the two processors, central and imaging, but wouldn't the low ram make it harder to "sense" with everything going on at once?(without some slower reaction) would it be too much data to interpret? the camera has it's own localized intelligence, but then it still has to filter through the main cpu right? maybe they compress it enough that it's not so much memory?

I dont know if images from the camera are continuously being analysed, would it not make sense to pause analysis of the images while the Pleo is in the process of executing a movement, as when Pleo moves, the image will change or blur, and I don't know if the Pleo "knows" exactly where it's head is pointing in space at any one time, so it doesnt really know exactly where the image was taken from.

I could be wrong :)

[ryane]

I dont know if images from the camera are continuously being analysed, would it not make sense to pause analysis of the images while the Pleo is in the process of executing a movement, as when Pleo moves, the image will change or blur, and I don't know if the Pleo "knows" exactly where it's head is pointing in space at any one time, so it doesnt really know exactly where the image was taken from.

I could be wrong :)

good point.

[Pleo_Joe]

I dont know if images from the camera are continuously being analysed, would it not make sense to pause analysis of the images while the Pleo is in the process of executing a movement, as when Pleo moves, the image will change or blur, and I don't know if the Pleo "knows" exactly where it's head is pointing in space at any one time, so it doesnt really know exactly where the image was taken from.

I could be wrong :)

This theory/idea is actually what my next blog entry is about. I hope to have it ready late tonight.

[degers]

Can't wait Joe!

[Pleo_Joe]

This theory/idea is actually what my next blog entry is about. I hope to have it ready late tonight.

It's ready at my blog for anyone interested in what I was getting at. :)

[degers]

It shall be a treat after a long days travelling today.

[grahamb]

I noticed last night when I pointed my camcorder at my Pleo, in night shot mode, that one of the two IR leds pulses. Whats the deal with IR? Is it just used to detect other Pleo's?

[pleoman]

I noticed last night when I pointed my camcorder at my Pleo, in night shot mode, that one of the two IR leds pulses. Whats the deal with IR? Is it just used to detect other Pleo's?

Yes it is used to detect other pleos so that they can interact with one another.

[PleoPet]

> that one of the two IR leds pulses.
One is an IR transmitter (IR LED) one is a receiver.
They are used for Pleo-to-Pleo communication, and also to detect objects in front of the nose (the IR signal bounces off an object and reflects to the detector).

There is a simpler transmitter/detector in the mouth (detects 'food')

[Lu Bu]

IR Reciever is to recieve the IR signal/data from another pleo. The transmitter is to send the signals to the other Pleo.

P.S. I never knew Pleo's IR sensors was to detect objects, I thought his camera did all the work.

[mweed]

Supposedly the IR is used for both.

[UgobeTyler]

The IR communication in Pleo 1.0 currently works at a _very_ slow baud rate, so passing custom sounds back and forth would likely not work at all.

We do currently pass a "unique" Pleo "ID" as part of a Pleo "beacon" packet. The issue here is that that unique ID value is a byte (256 values) and so there will be times at which two Pleos have the same ID - in which case they ignore each other (as a by-product of Pleo ignoring his own beacon).

Thank you,
Tyler

[edufix]

Hi,

What are your experiences, can Pleo see? I have tried some experiments on my pooltable with different colored balls but no reaction on it. When holding Pleo he convincingly looks like he can see but when testing he does not track hands or position changes of a human, do you have other experiences?

Regards,

Edufix

[MaryJo]

My Pleo seems to recognize big objects in front of him. When walking in a room, he will go a couple feet, then stop short of an object in front of him, like a stuffed animal or box. He stands there and bellows at it, then backs up and goes on his merry way.

Perhaps a UGOBE rep can explain Pleo's sight capabilities?

Mary Jo

[Lu Bu]

I think Pleo's sight is very, very poor. His camera is probably on PAR, not has advanced but good enough for a decent bot like pleo. though they could've added a better camera.

[chamaeleo]

Will there be upgrades available for eyesight and hearing capabilities?

[Pleo_Joe]

Hi,

What are your experiences, can Pleo see? I have tried some experiments on my pooltable with different colored balls but no reaction on it. When holding Pleo he convincingly looks like he can see but when testing he does not track hands or position changes of a human, do you have other experiences?

Regards,

Edufix


I have many documented videos at my blog that show my experience with Pleo's sight capabilities.
The link is in my signature.

Hope that helps!

[cmadmacs]

I love watching your videos.

[Pleo_Joe]

I love watching your videos.

Thanks for the comment!
I am uploading a new video tonight and will post in my blog about it tomorrow. It actually has to do with the camera - just in regards to edge detection and not object detection/recognition.

[Lu Bu]

Will there be upgrades available for eyesight and hearing capabilities?

It is possible to upgrade Pleo's vision and microphone capabilities. Though I am not sure if UGOBE planned to do this yet.

[edufix]

Thank you for your experiences, it seems that Pleo has the right hardware but the software is not adequate. As early-adaptors as we all are we have to accept, but for me Pleo is not a life-form yet and still a "thing". So as a grown up man I feel now silly playing with it, so I have decided still to study behaviours by buying another Pleo and see whether there will be any development, I hope the software which makes all the promised features come true will be launched soon.

As Ugobe mentioned earlier when postponing production that they only wanted to have a good working Pleo.

PS: Pleo_Joe interesting observations, thanks! By the way, why did you call it Narco....anything to do with the diet..:rolleyes: .....greetings from The Netherlands.... ;)

Edufix

[Pleo_Joe]

...
PS: Pleo_Joe interesting observations, thanks! By the way, why did you call it Narco....anything to do with the diet..:rolleyes: .....greetings from The Netherlands.... ;)

Edufix

Greetings from the USA ;)
The name "Narco" came from a post by UgobeSarah in regards to Pleo's 'narcolepsy'; the regular habit of falling asleep every 5-6 minutes. :)

[Lu Bu]

Good name! Reminds me of Narco Polo, or is it Marco Polo???

[pleoguy101]

Good name! Reminds me of Narco Polo, or is it Marco Polo???

LOL its Marco polo:)

[Pleo_Joe]

Good name! Reminds me of Narco Polo, or is it Marco Polo???

Narco Pleo, actually :)

[Lu Bu]

LOL That's a great full name! :)

[lights]

Can someone tell me what the infared reciever does? I have noticed on my pleo that the infared transmitter flashes blue however the other one on the left doesn't do anything.

Is this right or is something not working?

lights

[pleoWhisperer]

One is a transmitter, which does blink. That's its job; to send out a signal. The other is the receiver that doesn't blink. It only detects signals. Pleo uses these as both a way to communicate to other pleos (and other devices in the future) as well as to help him "see" (signal sent out boucing back and being received). If you put two pleos face to face and watch the infrared ports (you may need a camcorder or other device that picks up the infrared), you'll see that they blink more frequently and in a different pattern. This is the two pleos sending signals back and forth.

[lights]

Thank you for the clarification.:)

Lights

[fancyfont]

Now, I really would love to have another Pleo to watch the interactions between them.:)

[Caaahl]

Did anyone ever try to send pleo some kind of infrared signals via remote control? :p

I know that Helge reacted to furby IR signal before.

[fancyfont]

127Peeky seems to react to my Furbies, too.:)

[jproiett]

little seppi can make my robosapian dance which really suprised the first time he did it :)

[Sonsy]

Is PLEO'S IR harmful for us? infrared rays r not gud 4 our health right?

[fancyfont]

I know to much UV rays can be harmful, but a certain amount is, also, needed.:)

[pleoWhisperer]

Yes, staring for hours into your pleo's infrared port can be damaging to your health. But that has nothing to do with the infrared. ;)

Technically infrared radiation is commonly known as heat. In the winter, you can buy infrared heaters for your house. Anything in large doses is harmful, but you're safe from your pleo. Of course, they're now saying that cell phone radiation is more harmful than smoking! :eek:

[PleoPet]

> Did anyone ever try to send pleo some kind of infrared signals via remote control?
The IR encoding is very specific to the non-extended "NEC" IR protocol
http://www.sbprojects.com/knowledge/ir/nec.htm
FWIW: I have a simple CLIE program that sends/receives that protocol. I don't think it is compatible with regular remote controls.

A PC program could be written to send/receive the signal using "consumer IR" dongles like the RedRat or USB-UIRT devices.
Laptops or USB dongles that only do "IRDA" won't work.
----
> Is PLEO'S IR harmful for us?
The Pleo uses an IR diode, not a frickin laser
Once Pleos are equiped with a laser on their heads, they will be very dangerous
http://www.dtic.mil/ndia/smallarms/Moore.pdf

[pleoguy101]

When I turn off the lights Rocky doesn't seem to notiice in the slighest, he just keeps on doing what he's doing, does pleo have light detection?, Meaning knowing light from dark? pleo should act scared or atleast surprised when the light changes, or when pleo's lonley or sad, he could find a dark coner to huddle into to. UGOBE should really consider light detection for pleo.. If pleo does have light detection... I haven't noticed.

[degers]

Havoc, when the light is turned off will act scared untill conforted, or he will curl up and go to sleep if left alone. He will not do this if he is in the middle of an action though. It will happen eventually if it's dark enough and you leave him alone.

[pirpintine]

ive not tried a sudden light change reaction form catbug, but id be very supprised if pleo didnt have it. even FURBIES had light detection, make it dark, they went to sleep, sudden light, theyd tell you about it XD (if i rmemeber rightly anyway, not played with a furby since i was 12.... and im 18 now.)

[pleoguy101]

yes, they would:) I guess I'll have to test the light detection again:)

[junkroxy]

ive not tried a sudden light change reaction form catbug, but id be very supprised if pleo didnt have it. even FURBIES had light detection, make it dark, they went to sleep, sudden light, theyd tell you about it XD (if i rmemeber rightly anyway, not played with a furby since i was 12.... and im 18 now.)

the light sensor on furby was only a light/dark detector (and IR sensor for communication between 2 furbies), not a built in camera... Maybe the changes in light are not important for Pleo. I tried to feed Glen in a not-so-dark room and he's able to see the leaf;)

[Falseprophet666]

I know this sounds awfully untechnical, but just how primitive is Pleo's eyesight? I know he has a certain degree of edge detection, and he can obviously sense light (although he never reacts to it), but just what is he seeing? Does he just see basic geometric shapes? I know he isnt really looking at me ever, but I'm just really curious. What exactly does he see when he looks around? Perhaps Ugobe could develop some sort of app that allows us to hook Pleo up to our computer so that we can see what he sees'.

[fancyfont]

Falseprophet666 check out this thread.
http://forums.pleoworld.com/images/misc/paperclip.gif (http://forums.pleoworld.com/forumdisplay.php?s=&daysprune=-1&f=48#) http://forums.pleoworld.com/images/misc/subscribed.gif Dino-MITE Software (http://forums.pleoworld.com/showthread.php?t=2078) (http://forums.pleoworld.com/images/misc/multipage.gif 1 (http://forums.pleoworld.com/showthread.php?t=2078) 2 (http://forums.pleoworld.com/showthread.php?t=2078&page=2) 3 (http://forums.pleoworld.com/showthread.php?t=2078&page=3) ... Last Page (http://forums.pleoworld.com/showthread.php?t=2078&page=10))

[pleoguy101]

I know this sounds awfully untechnical, but just how primitive is Pleo's eyesight? I know he has a certain degree of edge detection, and he can obviously sense light (although he never reacts to it), but just what is he seeing? Does he just see basic geometric shapes? I know he isnt really looking at me ever, but I'm just really curious. What exactly does he see when he looks around? Perhaps Ugobe could develop some sort of app that allows us to hook Pleo up to our computer so that we can see what he sees'.

they did, like fancyfont showed. the Dinomite software allows you to see what pleo see's. most images I have seen pleo see are very good:)

[pleoWhisperer]

And pleo does respond to light. http://forums.pleoworld.com/showthread.php?t=2229

[pirpintine]

i think they mean, more how he sees what he sees. we know he can see piuctures quite well, same as aibo witha nose cam... but its how the pleo uses the image, is what the sight is.

with my aibo, i think its sight is just colour, as hes only a ers210, later models had face recognition and all that jazz, but one like mine. masicly...saw what it was seeing, then broke it down into colours that are there, if a colour was one it responded to, like flesh colour for people, he would take it as such, and do something like shake hands to the respective fleshy blob colour (causes no end of trouble with my beige bedroom! XD) and colours like pink/red would mean ball, therefore he would track that colour and kick it about and so on.

im not sure if im totally right, im not a very techy person...

but i think so far pleo is esentially blind can see pictures, but no idea with what to do with them.... i think except the leaf now is supposed to be seen, so im guessing pleo has some kind of green detection... ive not played with dinomite yet,,,

im sure someone will correct my rough guesses! hhaha

[fancyfont]

What's so amazing to me is that Pleo acts as though he can see.:)

[Falseprophet666]

I'll try to download the Dinomite thingee once I get home. Thanks for that!

[pirpintine]

What so amazing to me is that Pleo acts as though he can see.:)


probably down to sensors... he can 'see' objects that way :) but he got no sight as far as using anything, bar whatever he sees a leaf as, to see.... yet. im sure more seeable thinsg will be implemented sooner or later

[Falseprophet666]

It wont work... everytime I get the torrent, it fails. Its not like I really need it, but it seems like a neat thing to have. And no, I dont think plaeo acts as though he can see. To think that is to take it a bit far. He will move away from a wall and occasionally detect an edge. No complaints here, but his eyesight is practically nonexistant, although it is worlds ahead of the standard "light sensors" toys like Tekno and Furby came with.

[Westwood718]

:confused::confused::confused:

[pleoguy101]

at the time, pleos camera does not take pictures "actually I think the dinomite software gets his camera to take pictures:)"

[pleoWhisperer]

The Dino-MITE software will take still pictures using pleo's camera, and writes them to an SD card.

[Allosaurus]

little seppi can make my robosapian dance which really suprised the first time he did it :)

lawl! That's funny!

[1mpleo]

I Dont Think Pleo See's Aswell As They Say, He Does Still Walk Into Walls And Of Ov Tables.

[1mpleo]

/\ iTS rEALY aNOYING