Interview with Xiaobi Pan & Junru Xu | Designers from HMW Design Studio

Xiaobi (Iris) Pan: I have been an interdisciplinary designer for over 15 years, with experience ranging from UX Design to Product Design, Interactive Installation Design, and Emerging Technology Design. As a globally recognized pioneer in the field of Emerging Technology Design, I have invented a series of trend-setting products and experiences that defy boundaries and combine the digital world with the physical one. Currently a Lead Designer at Amazon, I am dedicated to using technologies such as Augmented Reality and Artificial Intelligence to revolutionize the consumer experience for both business and social good.

Junru (Jennie) Xu: I am an exceptional global award-winning product designer and UX lead, boasting eight years of rich experience in product design, user experience, and human-computer interaction from Columbia University. As the co-founder and CEO of TA Design Studio, I am passionate about providing unparalleled mentorship for aspiring UX designers, helping them enhance both their soft and technical skills.

Xiaobi (Iris) Pan: My motivation to pursue innovation stems from my unique perspective on constraints. Rather than seeing them as obstacles, I view constraints as catalysts that fuel my creative problem-solving abilities. This mindset enables me to approach challenges with enthusiasm and determination, always seeking innovative solutions. I find great joy in the process of "connecting dots" between seemingly unrelated facts. My ability to see connections where others might not is a key aspect of my innovative thinking. By linking disparate pieces of information, I can consistently develop out-of-the-box solutions that address complex problems in new and effective ways. This approach not only drives my passion for innovation but also highlights my talent for synthesizing diverse elements into cohesive and impactful outcomes.


Junru (Jennie) Xu: My motivation to pursue innovation is deeply rooted in her belief that society must innovate to address many of its most pressing issues. I understand that to tackle challenges like climate change, healthcare accessibility, and economic inequality, innovative solutions are essential. For myself, the drive to innovate goes beyond personal or organizational gain; it's about creating scalable solutions that can have a profound impact on the world. This perspective fuels my passion and commitment to pushing the boundaries of what's possible, always striving to develop new ideas and technologies that can help solve significant societal problems. My experience as a seasoned UX design mentor has also reinforced my belief that innovation is not just an innate talent but a skill that can be cultivated and taught.

In 2024, we co-founded How Might We (HMW) Design Studio to harness the power of technology and interdisciplinary design in tackling pressing social issues and fostering positive change. Our studio is dedicated to addressing critical challenges such as climate change, poverty, women's health, disabilities, and children's developmental health. Our portfolio https://hmwdesign.studio/work showcases our commitment to these causes, presenting solutions that are not only technically feasible and commercially viable but also aesthetically compelling and socially impactful.

At HMW Design Studio, we go beyond creating innovative design solutions and conceptual designs. We also offer comprehensive design workshops and mentorship services tailored to both design professionals and industry clients. These programs aim to strengthen participants' "design muscle," empowering them to develop impactful, transformative designs. Our approach ensures that our clients and partners are equipped with the skills and knowledge to create meaningful, sustainable solutions that address the world's most urgent social challenges. Through collaboration and a user-centered design philosophy, we strive to make a lasting positive impact on society.

Innovation, to us, means creating connections between seemingly unrelated elements to bridge industry gaps and apply trends or technologies in novel ways. It's about looking at problems through a non-traditional lens, thinking outside the box, and applying a "bias-towards-action" approach. By doing so, we can develop unique solutions that not only address challenges but also open up new opportunities across various fields. Innovation is the art of transforming constraints into catalysts for progress and making impactful changes by connecting diverse ideas and perspectives.


Keeping an eye on the latest technologies, their capabilities, and their constraints is crucial for meaningful innovation. Understanding the potential and limitations of new technologies allows us to leverage them in smart and effective ways. By staying informed about technological advancements, we can identify opportunities to apply these tools to solve problems in innovative ways.

Using technology meaningfully involves more than just knowing what's new; it requires a deep understanding of how these technologies can be integrated into existing systems and processes to create value. It means thinking critically about how to use these advancements to address real-world challenges and improve people's lives. This approach ensures that we not only adopt new technologies but also harness their full potential to drive impactful and sustainable solutions.

HEAR ME is an innovative app that revolutionizes communication for the deaf and non-vocal community through AI technology and mindful design. It features real-time AI avatar interpretation for seamless translation between spoken and sign languages. The app also provides access to human interpreters for personalized support, ensuring flexibility and a human touch. With continuous mood tracking via wearable devices, HEAR ME monitors users' emotional states and offers AI-avatar personal assistance. This comprehensive approach addresses communication barriers and enhances mental well-being.

HEAR ME transforms lives by bridging communication gaps and empowering the deaf and non-vocal community to interact confidently. The app's real-time AI interpretation and human interpreter services reduce daily frustrations and enable easier access to conversations and content. Continuous mood tracking and AI-avatar personal assistance support users' mental health by providing timely interventions. HEAR ME fosters a sense of community, facilitating social interaction and building support networks. Overall, the app maximizes the potential of its users, improving their quality of life and creating opportunities for growth and integration.

This project stems from the real-life story of one of our studio members' deaf and non-vocal friends. People with hearing and speech disabilities are a largely underserved community. They experience a huge gap in their daily communication with the external world. Not every person understands or can use sign language, and not every video/audio content on the internet is paired with sign language and subtitles. Hence, the world is not "designed" for them.

Because of these communication gaps and corresponding life challenges, people with hearing loss experience a lot of frustrations in daily life and need more emotional support, logistic help as well as accessibility accommodations for them to truly thrive in the world. Therefore, as designers we want to use the insight gained from first-hand observation, interviews, and follow-up studies to help these individuals live an easier, happier, and more fulfilling life. And we believe AI is the way to go.

Our deep understanding of the capabilities of current AI technology was instrumental in the conception of the Hear Me project. Recognizing the advancements in natural language processing, machine learning, voice, and gesture recognition, we saw an opportunity to leverage these technologies to address real-world communication challenges for the deaf and non-vocal community.

Developing HEAR ME posed a significant challenge: integrating advanced AI-driven functionalities into a platform that prioritizes accessibility and inclusivity. This undertaking required extensive research to deeply understand the unique needs and preferences of the deaf and non-vocal community. It also involved creating pioneering solutions tailored to these specific requirements. The journey was fraught with obstacles, including overcoming historical stigmas attached to disabilities, keeping pace with rapidly evolving technology, and navigating complex legal standards.

Despite these challenges, our dedication to a user-first design philosophy and a multidisciplinary approach enabled us to surmount these barriers. Through relentless commitment and collaboration, we successfully created an innovative, inclusive platform that addresses the real needs of the community.

Winning the TITAN Award has a significant impact on our future goals and aspirations. It validates our efforts and demonstrates that our innovation is being recognized and appreciated by the industry. This acknowledgment strengthens our confidence in using design and technology to serve underserved populations. The award inspires us to continue pushing the boundaries of what's possible, reinforcing our commitment to creating solutions that address real-world challenges.

It motivates us to pursue even more ambitious projects, knowing that our work can make a tangible difference. Ultimately, the TITAN Award not only celebrates our achievements but also fuels our passion for leveraging innovation to create a more inclusive and equitable future.

Recently, we learned that a similar app is being developed and gaining traction with a large user base in Europe, securing significant VC funding.

This discovery has been quite affirming for us because it shows that multiple teams around the world have independently recognized the need for such a solution almost simultaneously. Rather than seeing this as competition, we are proud to be part of a global movement addressing a common societal challenge. It validates the importance and relevance of our idea, reinforcing our belief that we are on the right track.

The most significant resource and support for the innovation behind HEAR ME are the collaborative efforts and insights from the deaf and non-vocal community. Their firsthand experiences and feedback have been invaluable in shaping the app to truly meet their needs. This user-centered approach ensures that the solutions developed are relevant, effective, and empowering.

Additionally, cutting-edge AI technology plays a crucial role in enabling real-time interpretation and personal assistance features. Leveraging advancements in machine learning, natural language processing, and wearable technology allows HEAR ME to provide seamless and intuitive support to its users. Our multidisciplinary team, comprising experts in AI, design, healthcare, and accessibility, further drives innovation. Their diverse expertise and dedication to inclusivity ensure that the app remains at the forefront of technological and social advancements.

Lastly, partnerships with organizations and institutions that advocate for the deaf and non-vocal community provide essential support. These collaborations help us stay informed about the latest developments in accessibility standards and ensure that HEAR ME aligns with legal and ethical guidelines, ultimately making the app more robust and impactful.

I believe this innovation will significantly shape the future of our industry in two important ways:

1) Raising Awareness of Underserved Communities: By focusing on serving underserved communities, our innovation brings attention to their needs and challenges that may have been overlooked. This heightened awareness can lead to more inclusive practices and solutions across the industry, encouraging others to prioritize social impact and equity in their work.

2) There’s Tremendous Value in Using New Technologies like AI to Solve Existing Challenges. Our approach to using AI addresses existing societal challenges rather than creating new needs. By leveraging AI technologies such as natural language processing and voice recognition, we aim to enhance accessibility and improve the quality of life for individuals facing communication barriers. This application demonstrates the transformative potential of AI in solving real-world problems and demonstrates a responsible use of technology to benefit society. By advancing these principles, our innovation not only pioneers new solutions but also sets a precedent for ethical and impactful technology development within our industry. It encourages others to adopt a more empathetic and socially conscious approach to innovation, ultimately contributing to a more inclusive and equitable future.

We would love to give 10 bits of advice we learned from our innovative journey.

Empathize Deeply with Users: Truly understand the needs, challenges, and aspirations of the people you are designing for. Spend time with them, listen to their stories, and involve them in the design process. This user-centered approach ensures your solutions are relevant and impactful.

Embrace Multidisciplinary Collaboration: Bring together experts from various fields to collaborate on your projects. Diverse perspectives and skills lead to more innovative and comprehensive solutions. Encourage open communication and idea-sharing to foster creativity and problem-solving.

Leverage Cutting-Edge Technology: Stay informed about the latest technological advancements and explore how they can be applied to your projects. Innovative technologies can unlock new possibilities and enhance the effectiveness of your solutions.

Focus on Sustainability: Design with the future in mind. Ensure that your solutions are not only effective in the short term but also sustainable in the long run. Consider the environmental, social, and economic impacts of your innovations.

Be Agile and Adaptive: The world is constantly changing, and so should your approach. Be open to feedback, willing to iterate, and ready to pivot when necessary. An agile mindset allows you to respond to new challenges and opportunities effectively.

Advocate for Inclusivity and Accessibility: Strive to create solutions that are accessible to everyone, regardless of their abilities or backgrounds. Inclusivity should be a core principle in your design process, ensuring that your innovations benefit the widest possible audience.

Stay Committed to Your Vision: Innovation often involves overcoming significant challenges and setbacks. Stay passionate and committed to your vision, and keep pushing forward even when the path is difficult. Your dedication can inspire others and drive meaningful change.

Engage with the Community: Build strong relationships with the communities you aim to serve. Collaborate with local organizations, seek their input, and ensure that your innovations align with their needs and values. Community engagement fosters trust and enhances the impact of your work.

Promote Education and Awareness: Share your knowledge and insights with others. Educate the public about the importance of your work and the issues you are addressing. Raising awareness can mobilize support and inspire collective action.

Measure and Reflect on Impact: Regularly assess the impact of your innovations. Use data and feedback to understand what is working and what needs improvement. Reflecting on your successes and failures helps you learn and grow as an innovator.

Staying motivated and focused in the innovation process involves understanding and embracing the concept of iterative innovation. It's important to recognize that things are unlikely to be perfect at the beginning. Accepting that initial solutions may be quick and scrappy helps maintain momentum and encourages continuous improvement. Knowing what to expect in the innovation journey is key.

Innovation often involves multiple cycles of trial and error, learning from failures, and making incremental improvements. Trusting this process is crucial. It allows us to remain patient and persistent, knowing that each iteration brings us closer to a refined and effective solution. By setting realistic expectations and valuing progress over perfection, we can stay motivated and focused.

Celebrating small wins along the way and keeping the end goal in sight helps sustain our drive and enthusiasm throughout the innovation process.

Partnering with someone who has a strong team spirit is also a crucial element in staying motivated during the innovation process. Collaboration brings diverse perspectives and skills, enriching the creative process and fostering a supportive environment. When working with a like-minded partner, the shared enthusiasm and commitment can help maintain focus and drive, especially during challenging phases.

HEAR ME’s innovative design and technology aim to change the world and bring people a better life.

Enhanced Communication: HEAR ME bridges significant communication gaps for the deaf and non-vocal community through real-time AI avatar interpretation and human interpreter services. This enhancement allows users to engage more freely in conversations and access media content, reducing daily frustrations and fostering more inclusive interactions.

Improved Mental Well-Being: The app's continuous mood tracking and AI-avatar personal assistance provide timely emotional support, helping users manage stress and emotional challenges more effectively. This proactive approach contributes to better mental health and overall well-being for the deaf and non-vocal community.

Social Integration and Empowerment: By facilitating social connections and fostering a sense of community, HEAR ME helps users build meaningful relationships and support networks. This social integration empowers users to participate more actively in society, enhancing their quality of life and sense of belonging.

Maximized Potential: HEAR ME unlocks the full potential of deaf and non-vocal individuals by making communication more accessible and efficient. This empowerment leads to greater opportunities in education, employment, and personal growth, enabling users to achieve their goals and aspirations.

Global Inclusivity Awareness: HEAR ME raises awareness about the importance of inclusivity and accessibility, inspiring other innovators and organizations to consider the needs of marginalized communities. By setting an example of how technology can be used to address social challenges, HEAR ME contributes to a more inclusive and equitable world.

We think these key skills contribute significantly to innovation:

Ability to Connect Between Different Fields, Industries, and Facts: Innovators excel at connecting dots between seemingly unrelated fields, industries, or facts. This skill involves recognizing patterns, understanding diverse perspectives, and applying knowledge from one domain to solve problems in another. By integrating ideas and concepts across boundaries, innovators can generate novel solutions and approaches.

Ability to Disregard Rules and Boundaries: Innovation often thrives when individuals challenge conventional thinking and are willing to break rules or push boundaries. This mindset allows innovators to explore unconventional ideas, question established norms, and experiment with new approaches. By embracing a mindset of creative disruption, they can uncover opportunities that others may overlook.

Bias Towards Action: Innovators possess a bias towards action, meaning they are proactive in testing ideas, iterating quickly, and learning from failures. This mindset prioritizes progress over perfection and encourages continuous experimentation and improvement. By taking calculated risks and learning from outcomes, innovators can refine their ideas and bring them to fruition more effectively.


These skills complement each other to create a fertile ground for innovation. Connecting between different fields fosters cross-pollination of ideas while disregarding rules and boundaries and encourages thinking outside the box. Coupled with a bias towards action, these skills empower innovators to drive meaningful change, solve complex problems, and shape the future through creative and impactful solutions.

In the next 5-10 years, UX and AI design will see remarkable advancements, bringing about transformative changes in how we interact with technology. One of the most significant developments will be hyper-personalization, where AI leverages extensive data to create highly tailored and relevant user experiences. Users will enjoy seamless multimodal interactions, with interfaces that fluidly integrate voice, gesture, and facial recognition, making technology feel more natural and intuitive.

Emotionally intelligent interfaces will emerge, capable of detecting and responding to users' emotional states with empathy and contextually appropriate responses. This will enhance user satisfaction and deepen engagement. Additionally, AI-assisted design tools will revolutionize the creative process for designers, automating routine tasks and allowing them to focus on strategic and innovative aspects of their work.

Inclusivity and accessibility will become central to UX and AI design, with technologies developed to cater to diverse user groups, including those with disabilities. AI-driven insights will help identify and resolve accessibility issues more effectively, ensuring equitable experiences for all users. Ethical considerations will also be at the forefront, with a strong emphasis on creating transparent, fair, and accountable AI systems that respect user privacy and avoid bias.

The integration of augmented reality (AR) and virtual reality (VR) will offer immersive experiences, blending the physical and digital worlds in new and exciting ways. UX design will evolve to create engaging and intuitive interfaces for these environments, enhancing how users interact with virtual content. Predictive and proactive AI will anticipate user needs, offering timely suggestions and automation that make interactions more efficient and satisfying.

With the rise of edge computing, UX and AI design will adapt to environments where data processing happens closer to the user, enabling faster and more responsive interfaces, particularly in IoT and smart device ecosystems. Finally, there will be a strong push towards sustainable and ethical design practices. Designers will focus on creating energy-efficient interfaces and advocating for responsible AI practices that minimize ecological impacts, leading to more responsible and efficient digital products.

The message we want to deliver is clear: let's use technology responsibly and purposefully to solve pressing social problems and serve underserved communities. Technology holds immense potential to create positive change and improve lives, but we must apply it ethically and with empathy. By focusing on addressing real societal challenges—such as accessibility, healthcare disparities, education gaps, and environmental sustainability—we can harness the power of innovation to make a meaningful impact.

This means designing solutions that prioritize inclusivity, equity, and sustainability, ensuring that no one is left behind in the digital age. Let's collaborate across disciplines and industries, leveraging our collective skills and knowledge to innovate responsibly. By doing so, we can create a future where technology serves as a tool for social good, enriching lives, fostering equality, and creating a more just world for all.