Panorama AI Response Recap

Project Summary

Panorama Response Recap is the first mainstream AI feature in the Panorama Surveys product. It enables educators to quickly identify common themes in free-response questions. Additionally, Panorama AI tool assesses the emotional tone of each response, categorizing sentiments as positive, neutral, or negative. This feature significantly simplifies and speeds up the process of reading and analyzing numerous free responses, allowing educators to address critical issues and better support their students.

My Role

As the Design Lead, I closely collaborated with the product manager, lead engineer, academic research team, new foundations engineering team, and representatives from legal, sales, and product support to create an MVP of the first two Panorama AI features for the Surveys product.

Timeline and Key Responsibilities

Early October 2023

A cross-functional team of product, design, and engineering leads was tasked with assessing whether existing client feature improvement requests could be addressed using experimental Panorama AI tools. One of the top requests was a feature to quickly and accurately assess and analyze responses submitted via open-ended questions in Panorama surveys and check-in products.

Customers feedback deck

Late October 2023

Three candidates for Panorama AI betas were identified for expedited release. One of these was Panorama Signal for Surveys, which would enable administrators and educators to take immediate action for students in need by rapidly sorting and tagging responses containing sensitive content (e.g., bullying, self-harm, harassment).

Early Novemeber 2023

A task force for Panorama Signal was assembled, including a PM lead, an engineering lead, and myself as the Design Lead, in addition to my established roadmap work for the quarter.

Mid-Novemeber⸻December 2023

Ideation and development commenes. I facilitated brainstorming and pairing sessions to define the MVP of the beta solution and devise a quick go-to-beta plan. I also collaborated with research and legal teams to ensure the initial solution complied with recommended procedures and legislation.

Workshop boards

Final mockups for engineering hand-off

Panorama AI Signal Demo

Late December 2023

The Panorama Signal beta was released. Out of 100 eligible clients, 64 signed up within the first week. The new beta enabled the sales team to secure renewal contracts and upsell existing clients to include Panorama Surveys in their upcoming contracts.

Early Q1 2024

Encouraged by the success of Panorama Signal and empowered by leadership to continue exploring the potential of the Panorama AI tool, the product lead and I created a deck of opportunities to improve the readability and analysis of free responses in surveys. After presenting to Panorama, we decided on "Sentiment Analysis" as our first official AI tool feature for Panorama Surveys, to be released by the end of Q1.

Early explorations

Q1 2024

While developing the new sentiment analysis feature, I continued to advocate for Panorama Signal accuracy reviews, resulting in a month-long sprint for research, synthesis, and rapid improvement of the AI model and reporting UI. I championed ethical conduct and review protocols within Panorama for implementing new AI-backed features, resulting in new documentation and regularly scheduled legal and research reviews.

I designed and iterated on the initial vision of AI reporting in Panorama Surveys, going through a 30/60/90 iteration cycle to capture and address feedback from key stakeholders and users. I facilitated multiple stakeholder and leadership feature reviews to ensure the final solution met Panorama's business needs. Throughout the process, I collaborated continuously with the tech lead and PM to understand technical and business constraints, define high-level requirements and goals, and break down the project into three stages to ensure completion by the end of Q1.

30% design board

Solution Walkthrough