Multi-modal interface with manipulation of store front end

Technical Q&A
, , ,

Topic summary

A developer wants to build a dual-interface storefront combining conversational UI with a visual product catalog, similar to shop.app. The goal is seamless synchronization between both interfaces:

Key Requirements:

  • When users type queries (e.g., “I need new Nikes”), the catalog dynamically filters to show relevant products
  • When users click products in the catalog, the conversational agent responds contextually (e.g., “Great choice, Etta from NY also just bought these Nikes!”)
  • Each user’s experience must be personalized based on their conversation flow

Current Challenge:
The developer has conducted research but cannot determine the specific architecture and APIs needed to enable the conversational UI to dynamically manipulate Shopify’s front-end catalog elements.

Status: Open question seeking technical guidance on implementation approach and relevant Shopify APIs.

Note: A mockup image was included but the text appears corrupted/encoded in the original post.

Summarized with AI on November 10. AI used: claude-sonnet-4-5-20250929.
1

I want to create something similar to shop.app on my shopify store front end. It will be a conversational UI alongside the catalog (visual) UI. both these UIs are seamlessly connected, so if a user writes ‘I need new Nikes’ the catalog will update to show all Nikes. If a user then clicks a product, the catalog will update to show that product detail page AND the conversational agent will say ‘Great choice, Etta from NY also just bought these Nikes!’

I’ve added a mockup pic below.

I have been doing a lot of research but so far I’m unable to find out how exactly my conversational UI can manipulate the catalog UI. Note that this needs to happen in a unique way for each user, dynamically, based on the conversation.

I would much appreciate any guidance and tips on what architecture to use to achieve this, and what APIs I need to look at to make this dynamic manipulation of front end elements work.

Thanks a lot in advance!

mockup.png
mockup.png1920×1080 204 KB