Product & Ad Testing Glossary
Testing methodologies across product, UX, engineering, and advertising — from usability testing and QA to creative testing, brand lift studies, and conversion optimization.
Accessibility Testing
The evaluation of a digital product against accessibility standards and guidelines, primarily the Web Content Accessibility Guidelines (WCAG), to ensure that people with disabilities can perceive, understand, navigate, and interact with the product effectively.
Alpha Testing
An early-stage internal testing phase conducted by the development team or a small group of trusted stakeholders to validate core functionality, identify critical defects, and assess whether the product meets basic acceptance criteria before external exposure.
Attention Metrics Testing
The measurement and optimization of how much cognitive attention users actually give to advertisements, going beyond viewability to quantify engagement depth through eye tracking, scroll behavior, interaction time, and predictive attention models.
Attribution Testing
The experimental evaluation of different attribution models and methodologies to determine which approach most accurately represents the contribution of marketing touchpoints to conversions, enabling more informed budget allocation and channel optimization decisions.
Audience Segmentation Test
An experiment that evaluates different methods of dividing users into segments based on behavior, demographics, psychographics, or predicted attributes, measuring which segmentation approach produces the most actionable and impactful differentiation for targeting, personalization, and messaging strategies.
Audience Testing
The experimental evaluation of different audience segments, targeting criteria, and lookalike configurations in paid advertising to identify which audiences produce the best results in terms of cost per acquisition, return on ad spend, and customer lifetime value.
Benchmark Study
A structured research effort that measures a product's current performance against established standards, competitor products, or its own historical data to create quantitative baselines for evaluating the impact of future changes.
Beta Testing
A pre-release testing phase in which a near-final version of a product or feature is distributed to a limited group of external users to uncover bugs, usability issues, and performance problems under real-world conditions before general availability.
Brand Lift Study
A measurement methodology that evaluates the impact of advertising on brand perception metrics like awareness, favorability, consideration, and purchase intent by surveying users exposed to the advertising and comparing their responses to a control group that was not exposed.
Brand Safety Testing
The verification and monitoring processes that ensure digital advertisements do not appear alongside content that could harm the advertiser's brand reputation, including extremist material, misinformation, adult content, and other categories deemed inappropriate by the brand.
Cannibalization Testing
The experimental measurement of whether a new product, feature, channel, or campaign reduces the performance of existing offerings rather than generating purely incremental growth, quantifying the degree to which new initiatives eat into rather than add to total business outcomes.
Card Sorting
A user research technique in which participants organize content items, features, or topics into groups and label those groups, revealing mental models that inform information architecture, navigation design, and content categorization decisions.
Channel Testing
The experimental evaluation of different marketing channels and platforms to determine which deliver the best performance in terms of customer acquisition cost, return on investment, audience reach, and contribution to overall business growth.
Checkout Optimization Test
A systematic experimentation program focused on reducing cart abandonment and increasing purchase completion rates by testing changes to the checkout flow including form design, payment options, trust signals, progress indicators, and friction-reducing interventions.
Cognitive Walkthrough
A task-based usability inspection method in which evaluators step through a sequence of actions required to complete a user goal, assessing at each step whether a new user would know what to do, understand the available options, and recognize that they are making progress.
Competitive Usability Testing
A comparative usability evaluation that tests your product and one or more competitor products using the same tasks, metrics, and participant pool to identify relative strengths and weaknesses and uncover competitive differentiation opportunities.
Concept Testing
A research method that evaluates user reactions to a product idea, feature concept, or value proposition before any development begins, using mockups, descriptions, or prototypes to gauge desirability, comprehension, and purchase intent.
Contextual Relevance Testing
The evaluation and optimization of ad placement relevance by analyzing the alignment between advertisement content and the surrounding editorial or page content, ensuring that ads appear in contexts that enhance rather than diminish their effectiveness.
Conversion Lift Study
An experimental measurement methodology that isolates the incremental conversions directly caused by advertising by comparing conversion rates between a group exposed to ads and a randomized holdout group that is prevented from seeing the ads.
Copy Testing
The systematic evaluation of written marketing content, including headlines, body copy, calls to action, and value propositions, to determine which messaging resonates most effectively with the target audience and drives the desired response.
Creative Rotation
The practice of systematically cycling through multiple ad creative variants within a campaign to combat creative fatigue, maintain audience engagement, and gather performance data that informs future creative development.
Diary Study
A longitudinal research method in which participants self-report their experiences, behaviors, and emotions related to a product or service over an extended period, capturing real-world usage patterns that cross-sectional studies miss.
Dynamic Creative Testing
An automated advertising optimization technique that combines multiple creative elements like headlines, images, descriptions, and calls to action into numerous ad variants, then uses platform algorithms to test and identify the highest-performing combinations for each audience segment.
Email Deliverability Testing
The process of evaluating whether marketing and transactional emails successfully reach recipients' inboxes rather than being filtered to spam folders, blocked by email providers, or bounced, using seed lists, authentication checks, and reputation monitoring.
Engagement Experiment
A controlled experiment designed to measure the causal impact of product changes, feature additions, or intervention strategies on user engagement metrics like session frequency, session duration, feature adoption, and content interaction depth.
First-Click Testing
A usability evaluation method that measures where users click first when attempting to complete a task on a page or screen, based on the finding that users who click correctly on their first attempt are significantly more likely to complete the task successfully.
Five-Second Test
A rapid usability testing method that shows participants a design for exactly five seconds and then asks them to recall what they saw, measuring whether the page communicates its core message, purpose, and brand impression within the critical first moments of exposure.
Frequency Capping Test
An experiment that evaluates the optimal number of times an individual user should be exposed to an advertisement or message within a defined time period, balancing reach and reinforcement against diminishing returns and user fatigue.
Funnel Testing
An experimentation methodology that tests changes across an entire conversion funnel rather than individual pages, measuring the cumulative impact of modifications to multiple steps in the user journey from entry to final conversion.
Geo-Lift Testing
An incrementality measurement technique that uses geographic regions as experimental units, running advertising in some regions while withholding it from matched control regions, to measure the causal impact of marketing spend on business outcomes without individual-level tracking.
Guerrilla Testing
A fast, informal usability testing method in which researchers approach people in public spaces like coffee shops, coworking areas, or company lobbies and ask them to complete short tasks on a prototype or live product in exchange for minimal or no compensation.
Heuristic Evaluation
An expert-based usability inspection method in which evaluators systematically assess a user interface against a set of established usability principles, known as heuristics, to identify design problems without user testing.
Landing Page Testing
The systematic evaluation of landing page variants through A/B or multivariate testing to identify which combination of headline, layout, imagery, copy, social proof, and call-to-action design produces the highest conversion rate for a specific traffic source and audience.
Load Testing
A performance testing method that simulates expected and peak user traffic volumes against a system to measure response times, throughput, and resource utilization under load, identifying performance bottlenecks before they impact real users.
Media Mix Testing
An analytical and experimental approach to evaluating how different allocations of marketing budget across channels and tactics affect overall business outcomes, used to determine the optimal distribution of spend that maximizes total marketing return.
Message Testing
The systematic evaluation of different messaging strategies, value propositions, and communication frameworks to determine which narrative approach most effectively communicates a product's benefits and motivates the target audience to take action.
Moderated Testing
A usability testing format in which a trained facilitator guides participants through tasks in real time, asking follow-up questions, probing for deeper understanding, and adapting the session based on observed behavior to gather rich qualitative insights.
Multipage Testing
An experimentation approach that applies consistent variant experiences across multiple pages or screens in a user journey, ensuring that users who enter a test see the same treatment throughout the entire flow rather than receiving inconsistent experiences at different steps.
Notification Experiment
A controlled experiment that tests the impact of push notifications, email alerts, or in-app messages on user behavior, optimizing notification content, timing, frequency, and targeting to maximize re-engagement while minimizing unsubscribes and user annoyance.
Offer Testing
The experimental evaluation of different promotional offers, incentives, and deal structures to determine which combination of value proposition, discount type, urgency mechanism, and terms drives the highest conversion rate or customer lifetime value.
Onboarding Flow Testing
The systematic experimentation with new user onboarding sequences, including signup forms, welcome screens, product tours, activation prompts, and initial configuration steps, to optimize the percentage of new users who reach their first meaningful value moment.
Personalization Testing
An experimentation methodology that evaluates whether serving tailored content, offers, or experiences to specific user segments outperforms a uniform experience, measuring the incremental lift of personalization against a one-size-fits-all control.
Preference Testing
A comparative research method that presents participants with two or more design alternatives and asks them to select which they prefer, optionally explaining their reasoning, to guide design decisions when multiple viable options exist.
Price Testing
The experimental evaluation of different price points, pricing structures, or pricing presentations to determine the optimal pricing strategy that maximizes revenue, conversion rate, or profit margin for a product or service.
Prototype Testing
A usability research method in which users interact with a working model of a product or feature, ranging from low-fidelity wireframes to high-fidelity interactive mockups, to evaluate task flows, information architecture, and interaction design before development.
Recommendation Experiment
A controlled experiment that tests changes to recommendation algorithms, including collaborative filtering, content-based filtering, and hybrid models, to optimize the relevance, diversity, and business impact of personalized content, product, or feature suggestions.
Regression Testing
A comprehensive testing approach that re-executes existing test cases after code changes to verify that previously working functionality has not been broken by new development, ensuring that bug fixes, features, and refactoring do not introduce unintended side effects.
Search Ranking Experiment
A controlled experiment that tests changes to search algorithms, ranking signals, and result presentation within a product's internal search system to optimize relevance, user satisfaction, and downstream engagement or conversion metrics.
Send-Time Optimization
The use of data analysis and machine learning to determine the optimal time to send emails, push notifications, or other messages to each individual recipient, maximizing open rates, click rates, and engagement by delivering messages when recipients are most likely to act.
Server-Side Testing
An experimentation approach where variant assignment and experience delivery happen on the server before the page is rendered, eliminating the visual flicker, SEO complications, and client-side performance overhead associated with JavaScript-based client-side testing.
Signup Flow Testing
The experimental optimization of the user registration process, including form fields, authentication methods, value propositions, and progressive profiling strategies, to maximize the percentage of interested visitors who successfully create an account and begin using the product.
Smoke Testing
A preliminary testing technique that executes a minimal set of tests to verify that the most critical functions of a build work correctly, serving as a quick pass-or-fail gate before investing time in more comprehensive testing.
Staged Rollout
A deployment strategy that gradually exposes a new feature, update, or version to increasing percentages of the user base over time, allowing teams to monitor performance, catch issues early, and roll back if problems arise before full deployment.
Stress Testing
A performance testing method that pushes a system beyond its expected maximum capacity to determine its breaking point, observe failure behavior, and validate recovery mechanisms, ensuring graceful degradation under extreme conditions.
Subject-Line Testing
The practice of testing multiple email subject line variants against a sample of the recipient list before sending the winning version to the remainder, optimizing open rates through data-driven subject line selection.
Tree Testing
A usability research method that evaluates the findability and organization of content within a site or application by presenting users with a text-only hierarchical structure and asking them to locate specific items, isolating navigation architecture from visual design.
Unmoderated Testing
A usability testing format in which participants complete tasks independently without a live facilitator, following pre-written instructions and recording their screen and voice, enabling large-scale data collection with faster turnaround and lower cost than moderated sessions.
User Acceptance Testing
The final testing phase before release in which actual end users or their proxies verify that the product meets specified business requirements and real-world workflow needs, serving as the formal sign-off gate for deployment.
Video Completion Testing
The analysis and optimization of video ad completion rates through systematic testing of video length, content structure, opening hooks, call-to-action placement, and creative approaches to maximize the percentage of viewers who watch to the end.
Viewability Testing
The measurement and verification of whether digital advertisements were actually visible to users according to industry standards, typically requiring that at least 50 percent of the ad's pixels were in the viewable area of the browser for at least one second for display ads or two seconds for video ads.