Olga Libby

Panorama AI Signal & Response

AI-powered insights that surface what matters across a district — helping leaders spot trends early and respond with confidence instead of guesswork.

Product
AI-powered analysis and response planning platform
Users
School and district administrators
Role
Lead Product Designer
Team
Product Manager, Engineers, Researchers, Education Stakeholders

AI-Powered Workflow

Panorama sentiment analysis summarizing free-response themes shown on a laptop screen
Faster decisions
40%
Less manual work
35%
Back to Work

Overview

The opportunity

School leaders were spending significant time manually reviewing large volumes of open-ended student feedback. Identifying meaningful themes, understanding sentiment, and determining next steps was difficult to scale and often delayed action.

My contribution

Led end-to-end product design from discovery through launch. Partnered closely with product, engineering, research, and education stakeholders to define AI-assisted workflows, establish trust and transparency patterns, and translate complex analysis into actionable insights.

Business impact

  • Reduced the burden of manual feedback analysis by transforming large volumes of open-ended responses into actionable insights.
  • Enabled administrators to identify themes, sentiment, and emerging concerns more efficiently.
  • Increased the accessibility of qualitative data through AI-assisted analysis.
  • Supported faster, more informed decision-making across schools and districts.

Discovery

October 2023

Early October 2023

A cross-functional team of product, design, and engineering leads was tasked with assessing whether existing client feature improvement requests could be addressed using experimental Panorama AI tools. One of the top requests was a feature to quickly and accurately assess and analyze responses submitted via open-ended questions in Panorama surveys and check-in products.

Slides summarizing customer feedback and feature requests
Customer feedback deck

Late October 2023

Three candidates for Panorama AI betas were identified for expedited release. One of these was Panorama Signal for Surveys, which would enable administrators and educators to take immediate action for students in need by rapidly sorting and tagging responses containing sensitive content (e.g., bullying, self-harm, harassment).

Signal Beta

November – December 2023

Early November 2023

A task force for Panorama Signal was assembled, including a PM lead, an engineering lead, and myself as the Design Lead, in addition to my established roadmap work for the quarter.

Mid-November – December 2023

Ideation and development commences. I facilitated brainstorming and pairing sessions to define the MVP of the beta solution and devise a quick go-to-beta plan. I also collaborated with research and legal teams to ensure the initial solution complied with recommended procedures and legislation.

Brainstorming workshop board for Panorama Signal
Workshop boards
Pairing session workshop board for Panorama Signal
Workshop boards
Final Panorama Signal mockups
Final mockups for engineering hand-off
Panorama AI Signal demo

Late December 2023

The Panorama Signal beta was released. Out of 100 eligible clients, 64 signed up within the first week. The new beta enabled the sales team to secure renewal contracts and upsell existing clients to include Panorama Surveys in their upcoming contracts.

Eligible clients signed up in the first week
64 / 100

Sentiment Analysis

Q1 2024

Early Q1 2024

Encouraged by the success of Panorama Signal and empowered by leadership to continue exploring the potential of the Panorama AI tool, the product lead and I created a deck of opportunities to improve the readability and analysis of free responses in surveys. After presenting to Panorama, we decided on "Sentiment Analysis" as our first official AI tool feature for Panorama Surveys, to be released by the end of Q1.

Early design explorations for AI-powered survey reporting
Early explorations

Q1 2024

While developing the new sentiment analysis feature, I continued to advocate for Panorama Signal accuracy reviews, resulting in a month-long sprint for research, synthesis, and rapid improvement of the AI model and reporting UI. I championed ethical conduct and review protocols within Panorama for implementing new AI-backed features, resulting in new documentation and regularly scheduled legal and research reviews.

I designed and iterated on the initial vision of AI reporting in Panorama Surveys, going through a 30/60/90 iteration cycle to capture and address feedback from key stakeholders and users. I facilitated multiple stakeholder and leadership feature reviews to ensure the final solution met Panorama's business needs. Throughout the process, I collaborated continuously with the tech lead and PM to understand technical and business constraints, define high-level requirements and goals, and break down the project into three stages to ensure completion by the end of Q1.

30% design board for AI reporting in Panorama Surveys
30% design board

Solution Walkthrough

Walkthrough of the AI reporting experience in Panorama Surveys