Izzan Bacharrudin Soedarsono

User Experience and Games
Designer / Researcher







Have any feedbacks?

Izzan Bacharrudin  Soedarsono

Product, Experience,Games Designer
< Back to Works

Establishing Conversation Through Pictures

UI UX Design

Public Service Hackathon Course

2017 - 6 Week Project

Design Goal
How could new technology (e.g. AI and IoT) and Innovations be utilized to improve the independent living of disabled people?

Design a supporting communication tool based on picture for disabled people that easier to use and adaptable with each user personification.
Public Service Hackathon (Collaboration with Accenture's Health and Public Services division, Fjord's service designer, Aalto University, and the Finland National Defence University).

Timo Ristola , Henriikka Seittu, Anttoni Salo, Wilhelm Ala-Krekola, Izzan Bacharrudin Soedarsono

Goals - Improving Independent Living of Disabled 

This course is organized in by Fjord Accenture and Aalto University. With selected public sector organizations (Defence Forces, Disability, and Human Resource Management) as the main topic. The aim of this workshop is to solving real-life digitization challenges of key Finnish public sector organizations.

For this hackathon, I join with my team that come from different disciplinary to solve the problem about Disability. The design brief for this topic is how could new technology (e.g. AI and IoT) and innovations be utilized to improve the independent living of disabled people?

Discover - Ethnographic Research : Pictures as Language.

We went to nursing home for disabled people to finding more about the real situation in Rastilla, Helsinki. The summary is that our target customers have many different needs and problems in the three problem areas recognized. Some of the residents have more problems in daily routine communication while some have more problems in the access for services, especially in digital and online services. That is why all the solutions made for them needs to be specific and individual. On the other hand, in our observation we noticed that it’s is a difficult to build a solution that would fill all the different needs of the users.

Survey in Nursing Home in Rastila, where we get insight and inspiration to solve their issue in communication

Define - Findings

There are 3 main insight that we found from this research :
  • Most of the residents is that they can communicate through pictures and colours. Pictures although must be linked to a context that is familiar to them so that they are able to bring together the meaning and context behind the picture.

  • Combining more than one communication method (like voice and picture) helped most of the residents to communicate.

  • Communication needs to be “produced” with the help of  the workers because the workers have learned to communicate with the “own language” of the residents quite fluent.

Possibility of the help from the workers can be utilized and taken into consideration in planning the digital solution.

Discussion about features that we want working on for our concept

Develop - Prototyping

After we got insight from previous ethnographic research, we attend the 2 days hackathon for creating the prototype (led by Fjord by Accenture). What we had done in the workshop were persona creation, user experience journey, lean canvas, and design drivers. We thinking about how we can create a supporting communication tool for disabled people that easier to use and adaptable with each user personification. 

Survey in Nursing Home in Rastila, where we get insight and inspiration to solve their issue in communication
Storyboard that explains what user experience expectation we aiming for

The result of the hackathon become our brief / draft for creating the prototype. For this hackathon, I as designer create the apps prototype using Sketch (for visual assets) and Flinto (for animation / motion). The 2 day hackathon prototype will be our Minimum Viable Product (MVP) that can be used as test and references for next development.

User flow of our concept

Creating a user flow of the prototype is required in order to know the sequences of experience that user will be through when user want to create conversation. Our concept is by adapting the familiar way for user to communicate by using pictures, and enhance it with the capabilities of technology to translate it into a conversation.

Deliver - Confidence as core value of communication

As the final result, we create a prototype in apps that help disabled people communicate. Our main function in our concept apps is ability to translate pictures into a sentences.  

Also we consider about how the application looks and feels. Most of recent apps that help disabled people to communicate with pictures giving disabled people feel to handicapped for being using the apps. We want to giving confidence to them, to be proud for themself that even they are handicap, they are not different with others.

Landing page of Conpic, Conversation through Pictures

User choose what kind of conversation they want to make. This is important in order to help listener understand the context / goal of the conversation.

Conpic help user building conversation by let user choose pictures. This method is already being used for them before, so user will be familiar with it.

User able to confirm the message first before they show it to listener

Listener able to understand the message and let user know is the listener understand the messafe or not.

Check other related project