Closing yr challenge utilizing Microsoft HoloLens and Self-Attachment Remedy – Microsoft School Connection

Visitor publish by Nana Asiedu-Ampem College School London, Grasp of Engineering (MENG) pupil, Imperial School London, Computing Diploma



Psychotherapy is a type of remedy geared toward enhancing the psychological well being of individuals affected by psychological sicknesses corresponding to melancholy and anxiousness issues. These sorts of remedy often contain a affected person affected by a psychological sickness discussing their emotions and feelings in a means that enables them to be higher geared up to regulate them. This challenge focuses on a sort of psychotherapy referred to as Self-Attachment Remedy (SAT) (1) with assistance from Augmented Actuality (AR).

Psychological sickness is usually linked to an individual’s lack of safe attachment throughout their childhood (e.g. uncaring and unreliable dad and mom) which has affected their skill to kind significant connections that may assist them overcome their sickness. Self-Attachment Remedy goals to assist sufferers affected by psychological sickness kind a safe attachment with themselves in order that they grow to be extra self-reliant in terms of controlling their feelings. The affected person initially takes the function of the “adult-self” who’s perceived as a main caregiver to an imaginary little one that embodies the particular person’s “inner-child”. The adult-self represents the rational a part of the affected person in addition to their strengths. The inner-child is a illustration of the affected person’s feelings, insecurities and vulnerabilities. It’s as much as the affected person, who’s imitating the first caregiver for the imaginary inner-child, to consolation and present affection in the direction of the inner-child to make them really feel cherished and valued. That is primarily accomplished by way of the affected person verbally complimenting their inner-child. Via the method of the affected person comforting their inner-child, they kind an necessary bond with them that they will use to beat their troubles.

The challenge includes making an software utilizing the Microsoft HoloLens that performs the Self-Attachment Remedy with a affected person by permitting them to visually view their inner-child by way of a 3D avatar mannequin. The 3D avatar will probably be perceived as a hologram positioned able set by the applying within the area round them. The hologram will show a number of key options of a kid corresponding to their face, hair and physique. The affected person would be capable to view the feelings of the avatar in addition to work together with it by way of speech. The avatar will initially present a tragic emotion and frown, however by way of the interactions with the affected person they will grow to be comfortable and smile. That is a part of the method of the affected person forming a bond with their inner-child. The purpose of the challenge is to supply a proof of idea of an software that may considerably enhance the affected person’s engagement with SAT by utilizing know-how to make them really feel extra immersed in a protected surroundings the place they will enhance their psychological well being.

The way it was applied

The appliance was developed on the Unity sport engine utilizing the C# programming language to implement scripts. The app made in depth use of the Microsoft Combined Actuality Device Package. A 3D mannequin of a generic little one was created in Blender. It was then imported into Unity so it may be used because the holographic illustration of the affected person’s inner-child. The mannequin was created by a colleague who was engaged on the same challenge that creates little one fashions based mostly on the affected person’s options.


The mannequin has quite a lot of animations which permits it to specific varied emotional states corresponding to: comfortable, unhappy and scared. The mannequin additionally has an animation that enables it to carry out a dance.

SAT contains of four levels that the affected person has to carry out to kind a loving reference to their inner-child (Verify the reference for extra particulars on the levels (1)). To assist the affected person really feel extra immersed with the remedy, the inner-child was given spatial consciousness on the affected person’s location and their environment. Which means the applying locations the inside little one in an open area within the affected person’s room with its footwear positioned on the ground. This was achieved by having the HoloLens scan the affected person’s surroundings utilizing the gadgets many sensors and the spatial mapping library offered by the Combined Actuality Device Package. This allowed the applying to create an inner illustration of the room’s ground which is used to put the inner-child on the ground. Additionally, 3D meshes that matched varied objects within the affected person’s room have been created (corresponding to tables and chairs). Unity makes use of ray casting to check collisions with these objects inside the software. This was used to keep away from inserting the inner-child in positions that have been obstructed with objects (e.g. a transparent open area within the room will probably be discovered to put the inner-child, versus inserting it in the midst of a desk). The inner-child can also be continuously turning to face the affected person. These options have been applied to make the inner-child really feel like a extra practical addition to the consumer’s surroundings. This can make it considerably simpler for the affected person to carry out the remedy levels.

How it is going to be used

Self-Attachment Remedy was developed by the challenge supervisor, Edalat Abbas. He created the challenge so he can analysis how properly SAT works when mixed with immersive know-how. This challenge will probably be utilized in his analysis to assist enhance the method of the remedy.

Therapists will use the applying with the HoloLens to assist clarify the method of SAT to their sufferers. Sufferers will be capable to learn important data concerning the remedy by way of holographic boards that comply with their line of sight. This can make it a lot simpler for therapists to manage the remedy because the affected person will have already got entry to all necessary data by way of the applying itself. Initially, SAT required sufferers to shut their eyes and picture a youthful model of themselves that embodies their imaginary inner-child was in entrance of them. Some sufferers will wrestle with constantly imagining a practical inner-child which can hinder their skill to kind a significant reference to them. This will probably be a giant problem for therapists who will discover it troublesome to exhibit how their affected person’s inner-child ought to look and the way they need to react throughout every stage of the remedy. Nevertheless, the HoloLens alleviates these considerations from the therapist and affected person by visually offering the affected person with a illustration of their inner-child. This makes it a lot simpler for the affected person to carry out the remedy with out having to continuously think about a toddler they must work together with. This can make the therapist’s work a lot simpler as they not must dictate the precise motion the affected person or inner-child has to carry out at every stage.

Future tasks

There may be loads of room for future extensions that may improve the affect of the remedy. The appliance may make use of the Web to permit a affected person to include content material they take pleasure in with the remedy. For instance, a part of the remedy has the affected person sing a soothing music to calm down their inner-child. The Web can be utilized to play an instrumental model of a music the consumer enjoys to assist them by way of the method. The remedy may additionally profit by way of using a extra complete spatial mapping course of. At the moment, the room is scanned as soon as earlier than the remedy begins. This may be up to date to permit the applying to scan the affected person’s surroundings in real-time offering the applying with a extra detailed illustration of the affected person’s environment. This could then be used to reinforce the consumer’s room additional by including holograms that work together with actual world objects. For instance, the affected person may obtain a photograph they like from the Web and switch it into a photograph body they will place on their wall. These extensions are supposed to make the expertise of performing the remedy with the HoloLens extra having fun with, thus enhancing the affected person’s motivation to hold out the remedy.



1: Self-attachment: A self-administrable intervention for power anxiousness and melancholy

Supply hyperlink

Add a Comment

Your email address will not be published. Required fields are marked *