Groepsfoto

final result

Elektrisch schema IR-pen

Exploded view IR pen

Instructable

Wij hebben 2 instructables gemaakt.

In de eerste instructable wordt er uitgelegd hoe de IR-pen gemaakt wordt.
De tweede instructable legt uit hoe de pen, samen met het wii bakje, kan gebruikt worden voor het aansturen van het smartboard en zo reactickles gebruiken.

Instructable voor maken van IR-pen

Instructable voor maken van interactief smartboard met wiimote

 

eindfilmpje

prototype 45

Further stadium of prototype: P44


 
Test:
Expected positive: Bernoux will be positive surprised, rubber ring is good.
Unexpected positive: pen didn't break

Expected negative: Pen will break
Unexpected negative: Rubber ring came loose, pen needs to be very strong.

Design for everyone - Activity Center - Perstekst

Bernoux Demeulemeester is 18 jaar, en heeft een mentale leeftijd van 2 jaar. Ze leeft samen in een leefgroep met een tiental andere jong volwassenen, in het zorgcentrum “Maria ter engelen”.
Op deze leeftijd is Bernoux enerzijds zeer sterk en krachtig, aan de andere kant is ze supersnel afgeleid en wil ze allerlei nieuwe dingen uitproberen. Zo maakt ze bijvoorbeeld veel speelgoed kapot en vraagt ze veel aandacht van de begeleiders. Hierdoor is geen enkel spelletje of activity board boeiend of schokvrij genoeg voor haar.

Wij komen met een oplossing voor dit probleem, namelijk een Wii remote smartboard. Volgens het simpele principe van projectie kan op volledig veilige manier geïnterageerd  worden. Een Wii remote die je in de richting van de projectie plaats kan IR licht van onze IR pen ontvangen. Via online open software kan dit Infrarood licht van onze IR pen omgezet worden naar een muisbeweging. Zo neemt de IR pen de functie over van de computer muis.

Op die manier kunnen dus eindeloos (online) spelletjes gespeeld worden zonder de concentratie te verliezen of iets kapot te maken. Dankzij de hulp van ons Wii remote smartboard is het voor Bernoux en anderen van de leefgroep mogelijk om zich zonder aandacht van de begeleider bezig te houden op een leuke manier.

TEAM

CLIENT :: Bernoux Demeulemeester

IO :: Bert Boute, Ward Meeus

ERGO :: Sarah Carbon

PROCESShttp://activitycenter2014.blogspot.be/
http://designforeveryone.howest.be/

prototype 44

Further stadium of prototype: P40


 
Test:
Expected positive: Positive suprise, focused on the movements
Unexpected positive: calibration works good on a bigger screen, no need for full calibration.

Expected negative: IR-pen will be fast broken, she will not like it.
Unexpected negative: She was very fast distracted from the beamer, light, pen and shapes.

Prototype 41, 42 & 43

In case Bernoux doesn't get's away with the IR-pen, we provided some alternatives to work with.

Prototype 41

First is a simple 2led-bike lamp, where we can change the led into IR leds. It has a ring to put around your finger.

Test:
Expected positive: not much irritation on skin
Unexpected positive: palm of the hand is free, so she can knock on the wall with her hand

Expected negative: Inpired by the thing on her hand, distracted, wil brake it or try to disassemble the light.
Unexpected negative: Uses the other side of the palm to draw on the wall. Weird but that says she's seeying a connection between the leds and the game.

Prototype 42

The second tool is also a bike led light but this time with 3 leds. We only changed the middle led to a IR led. We fasten the light to bike glove with velcro.

Test:
Expected positive: Gloves will be on easy with some help, after that it will not irritate her on the hand.
Unexpected positive: The light keeps good connection to the glove, good handling with the glove

Expected negative: Light will fall of when she is very active. Otherwise she will disassemble it or break it.
Unexpected negative: Uses the other side of the palm to draw on the wall. Weird but that says she's seeying a connection between the leds and the game.

Prototype 43

The last tool is a simple piece of old wetsuit material that stretches nice around the hand. Again the same light as before is attached with velcro.

Test:
Expected positive: Good connection with Wii remote, easy on without help from attendant.
Unexpected positive:  The light keeps good connection to the glove, good handling with the glove.

Expected negative: Will irritate her by its form around her hand. Will be distracted by it.
Unexpected negative: Uses the other side of the palm to draw on the wall. Weird but that says she's seeying a connection between the leds and the game.

prototype 40

Further stadium of prototype: P32


 
Test:
Expected positive: Tracing works well
Unexpected positive: calibration works good on a bigger screen, no need for full calibration.

Expected negative: person who holds the IR pen obstructs sometimes the IR camera view.
Unexpected negative: 

Prototype 36-39

In the following movie you can see the handling of bernoux with the 4 different prototypes.
Bernoux was very calm and happy today so the collaboration was very good.

Movie Prototypes:

https://www.youtube.com/watch?v=R0-C5ECIqjk 

Prototype 36 (Gloves)

On the first test she wasn't able to get the gloves on in the right way. The second time she did.
This hand-tool offers a possibility to work with because she can put/keep it on her hand.

We only did a very short test so wee don't know how long she is able to hold in on (irritation or distraction).
The supervisors also told this was maybe a possibility.

Prototype 37 (Wristband)

As you can see in the movie, the wristband is very use friendly. It's very easy on and off. The disadvantage of this tool is that the (later attached) IR LED will be at the wrist and not the finger. She seems to have no problem having the wristband on.

Prototype 38 (Thick Pin)

The Thick Pin was not so popular. She seems to struggle with the working of it, also moving is very difficult. How thicker the pin, the less good it lies in your hand. So the conclusion with this tool is that it's a little to big to work with.

Prototype 39 (Small Pin)

Drawing has always been a weak point for bernoux. But coloring with a pin seems to work out. She proved that with the smaller pin. With this tool she is able to draw some lines on a piece of paper, the question is again how long she will be focused on the pen and eventually the smartboard.




Till now are of our options are still open. The real reactions will need to be tested with a real interaction. Then we can see how long they are focussed and if it comes throug the game or the hand-tool.

Giving an example of other people in the living group who are asking for attention. Meanwhile Bernoux was very distracted by the actions of the other person, so some of the test where a bit slower then the others

Movie distraction:

https://www.youtube.com/watch?v=s6Xwsww44V4

Testing & observation Bernoux 23/04

This morning we visited Bernoux again to do some testing with ceveral tools for the interaction with the smartboard. We had some interesting object wich can be provided with the IR LED. These object will then be used as recognition tool for the wii remote.

Our goal here was to look and see which tool bernoux handled best, so it doesn't get of or irritates her while playing with the smartboard.

We used the following tools in our test scene:

• Mini towel
• Wristband
• Gloves
• Thick Pin
• Smaller Pin

Everyone was very busy at the moment we arrived, so we tried to do our testing very quickly.

Preparation on the observation on 23/04/2014

Purpose of structured and participatory observation on 04/23/2014:

• Bernoux has sufficient sensorimotor functions and skills .

• Bernoux holds a dominant hand and hand fixation .

• Bernoux mastered sufficient coordination patterns in upper limbs such as reaching , make symmetrical movements , bimanual coordination , dissociations , ...

Types of handles:

- Ulnar handle: grab with pinky and ring finger

- Digito-palmar grip: grip with four fingers and the palm

- Digital Radio handle: grasp the thumb with the four fingers

Ø  Cylinder Handle: grasping with the thumb and fingertips

Ø  Key Grip: grasping with the thumb relative to the radial side of the index finger

Ø  3 - fingertip grip: grip with the thumb , index and middle finger

Ø   Inferior pincer grasp: grab the DIP ( distal inter - phalanx ) of the index finger and thumb

Ø   Superior grip tweezers: grasp with the tips of the thumb and index finger

Ø   Handle Cover Letter: surface of the fingers with full thumb opposition

Ø  Wide grip: Grasping with DIP's all fingers and thumbs

Ø   Handle Scissors: Opposition thumb - middle finger

Ø   Hook Handle: flexion of the fingers , with or without the thumb

Ø   Cross Handle: Opposition of the thumb with the index and middle finger , fixation with the other fingers

Ø  Latero lateral grip: Grasping the lateral sides of two fingers

Ø  Brush Handle: Grasping the thumb, index and middle finger

Ø   Pencil Grip: Grabbing the tips of the thumb and the index finger and the lateral side of the middle finger

Observe which handles Bernoux performs without any trouble .

Objects will be made to analyze in Bernoux . Handles the common during the structured and participant observation. Later, the sensors can be applied to the object (in this grip ) that it uses Bernoux best. (Here we are alert to the power of Bernoux and the possibility of destroying the material = durability!)

 è To use  ‘the Smartboard ' easy, we prefer the digito - palmar grip , grip the cylinder , the 3 - fingertip grip and wide grip .

On Wednesday, 23/04/2014 these handles are observed .

Materials:

- Washing

- Glove

- Thick pin / glue tube

- Soft cloth

- Soft ball ( the mousse can’t be torn)

- Film

- Projector (from GKG )

Proto 35 different kind of IR pens

With the first set up of proto 32 we could only get a range of 30 cm.
To get a longer range, we need a stronger IR led. therefore we will use a LED running at minimum 100mA.   Vishay TSAL6400s

Simple schematic of the IR LED pen set-up.



To get a stronger IR beam, building an IR LED array would be another possibility:

Proto 34 tracking fingers

Using an LED array and some reflective tape, you can use the infrared camera in the Wii remote to track objects, like your fingers, in 2D space. This lets you interact with your computer simply by waving your hands in the air similar to the interaction seen in the movie "Minority Report". The Wiimote can track upto 4 points simultaneously. The multipoint grid software is a custom C# DirectX program.

proto 33 proof of concept

On this video you can see how that the IR LED is working on a laptop screen. Only the callibration was still a problem.

Prototype 32

Smartboard calibration on a laptop screen.

White dots are IR LED's.

This is a Proof of concept showing that the IR LED pen works on a laptop screen.

Further stadium of prototype: P30


 
Test:
Expected positive: IR LED pen will be hard to get it working
Unexpected positive: IR LED pen is easy to install/ work with.

Expected negative: Not compatible or not working.
Unexpected negative: calibration is difficult and LED is too weak. 

Observation Bernoux + Discussion with the educator on 15/03/2014

Observation Bernoux saturday 15/03/2014:

We choose an observation on Saturday. There are less people present at the center. Bernoux is less distracted and we can keep the focus on Bernoux.

- She likes rotating heads.
- She can withstand light noises
- She has some moments distraction -> Activity board -> challenge for Bernoux?
- She covers her ears when the noise is undesirable
- Interpretation: She likes prototype 12: shaped ''things'' with toys on
- She's restless if the educator leaves
- She takes the board of the table.
- She can't look for a longtime in the small mirror
- She throws her board away, if she's irritated


Discussion with the educator:

The educator was enthusiastic when we show her a movie from the Smartboard.
She shows us pictures from the centrum where they can rent some toys. They have a lot of toys that can be integrated in the activitycentrum. So we think also that the Smartboard is a bigger challenge.
We have discuss het price about the material. There is no budget in the centrum. We make a appointment with the dady of Bernoux.

Prototype 31

Reaktickles is an open source platform/ application for people with autism spectrum.