The Moment of Confusion
You’re building your third test in Autonoma. You’ve clicked buttons directly on the canvas, typed prompts, and everything worked. Then you wonder: “Wait, why are there two ways to do the same thing?” It’s a fair question. Most tools give you one way to interact. Autonoma gives you two:- Direct canvas clicks - Point and click on elements
- Natural language prompts - Describe what you want to do
The Canvas: Your Precision Tool
When you click directly on the canvas, you’re being specific. You’re saying “click THIS button, the one I’m pointing at right now.” Think of it like pointing at a specific item in a store: “I want THAT one, right there on the shelf.” The canvas is perfect for static elements:- Navigation menus that never change (“Home”, “About”, “Contact”)
- Form labels and field names
- Standard buttons with fixed text (“Submit”, “Cancel”, “Save”)
- Static UI elements that always exist in the same place
The Prompt: Your Flexible Tool
Now imagine you’re testing search results. You search for “shoes” and get 50 products. Tomorrow, different shoes appear. Next week, some are out of stock. The specific products constantly change. You can’t click a specific product on the canvas—it might not exist tomorrow. This is where prompts shine. Instead of clicking a specific product, you describe what you want:- Search results (content varies)
- Product listings (inventory changes)
- User-generated content (posts, comments)
- Dynamic feeds (news, social media)
- Lists where order or content changes
The Rule That Changes Everything
Here’s the decision framework: “Will this element be exactly the same next time I run the test?”- Yes → Use canvas
- No → Use prompt
| Element | Static or Dynamic? | Use |
|---|---|---|
| ”Home” link in navigation | Static (never changes) | Canvas |
| First item in shopping cart | Dynamic (varies per user) | Prompt |
| ”Submit” button on form | Static (always says “Submit”) | Canvas |
| Product named “Blue Shirt” | Dynamic (might be removed) | Prompt |
| ”Email” field label | Static (always labeled “Email”) | Canvas |
| Top search result | Dynamic (results vary) | Prompt |
Real-World Example: The Checkout Flow
Let’s build a complete test that uses both approaches strategically:- Used prompts for the unpredictable part (which product appears first)
- Used canvas for all the reliable UI (buttons, forms, navigation)
- Result: Test works regardless of which products are in stock
When Canvas Clicks Break
Here’s what happens when you use canvas for dynamic content: Scenario: You click a specific product on the canvas during test creation.- Product gets renamed → Test fails (“Nike Air Max 2024” not found)
- Product goes out of stock → Test fails (product not visible)
- Product moves to page 2 → Test fails (not on first page)
The Hybrid Approach
The most robust tests use both methods strategically. Here’s a real example:Key Takeaways
- Two tools, different purposes - Canvas for static, prompts for dynamic
- The question to ask: “Will this be the same next time?”
- Canvas strengths: Fast, precise, predictable for static elements
- Prompt strengths: Flexible, adaptive, perfect for changing content
- Most tests use both - Apply each where it fits best
- When in doubt: Prompts are safer for unknown situations

