Research Playbook

Best Concept Testing Providers for Indonesia Compared: How to Score Proposals Side by Side

Written by Vase.ai | Nov 10, 2026, 1:00:00 AM
Quick answer

Quick answer: The best way to compare concept testing providers for Indonesia is to send every shortlisted provider the same brief, then score their proposals on the same criteria. Weigh audience definition, test design, language handling, data quality, outputs and support, not just headline speed. A one-page scorecard turns a pile of very different proposals into a decision you can defend.

Indonesian brand teams rarely struggle to find concept testing providers. The struggle starts when proposals arrive. One agency sends a long methodology deck, a platform sends a feature list, and a panel provider sends a feasibility table. None of them answer the same questions, so comparing them becomes guesswork.

This guide gives you a practical way to compare providers side by side, so the choice rests on what each proposal will actually deliver for your concept.

Why do concept testing proposals look so different?

Providers in Indonesia come from different models. Full-service agencies such as Ipsos, Kantar or NielsenIQ lead with methodology and analyst teams. Regional platforms such as Milieu Insight or Vase.ai lead with speed and self-serve tools. Sample providers such as Cint or Dynata lead with reach. Each proposal emphasises its own strengths, which is natural but unhelpful when you need a like-for-like comparison.

If you want a primer on the provider models themselves, our comparison of agencies, panel providers and platforms in Indonesia covers that ground. This article focuses on the scoring step.

What should your brief include so proposals are comparable?

  • The business decision the test supports, such as which of three concepts to develop.
  • The target audience in plain terms: category users, age band, gender, regions, and any purchase or usage condition.
  • Whether results must be read by region, for example Greater Jakarta versus the rest of Java versus outer islands.
  • The concept materials you will supply and their format: statements, visuals, packs or video.
  • The measures you care about, such as appeal, uniqueness, believability, purchase intent and diagnostics.
  • The date you need results and the format leadership expects.

Ask every provider to respond in the same structure. If one cannot answer a section, that is useful information too.

How should you score each proposal?

CriterionWhat good looks likeSuggested weight
Audience fitClear screener that matches your brief, with feasibility confirmed for each region you needHigh
Test designMonadic or sequential monadic chosen for a stated reason, with fair concept rotationHigh
Language handlingQuestionnaire in Bahasa Indonesia, with a plan for checking translated concept wordingHigh
Data qualityNamed checks for speeders, straight-liners, duplicates and poor open-endsHigh
OutputsResults readable by segment, with significance flagged and raw data availableMedium
SpeedRealistic timeline from approved questionnaire to resultsMedium
SupportWho reviews your questionnaire and who explains the resultsMedium
FlexibilityAbility to add a quick follow-up wave without a new contractLow to medium

Score each criterion from one to five, multiply by the weight you agree internally, and add the totals. Keep the scoring sheet with the final decision so procurement and leadership can see why one provider won.

Agree the weights before any proposal arrives. If the team sets weights after reading the proposals, it is easy to tilt them towards a favourite. Two or three people scoring independently, then comparing notes, also helps. Where scores differ by more than a point, that usually signals an unclear section of the proposal worth a follow-up question to the provider.

Which red flags should lower a score?

  • Feasibility stated only nationally, when your brief needs regional reads.
  • No mention of how concept wording will be translated and checked.
  • Purchase intent as the only measure, with no diagnostics to explain why a concept wins or loses.
  • Vague data quality language such as "industry-standard checks" with nothing specific behind it.
  • Outputs available only as a final deck, with no access to data during or after fieldwork.

What does a scored comparison look like in practice?

Imagine a snack brand testing three new flavour concepts among young adult snackers in Java and Sumatra. Three providers respond. The agency proposal scores highest on test design and support but has the longest timeline. The sample provider scores well on reach but leaves scripting and analysis to the brand team, which has no spare analyst. The platform proposal scores well on speed, outputs and language handling, and includes questionnaire review by a research specialist.

Because the team weighted audience fit, test design and language highest, two proposals end up close. The deciding factor becomes whether they need results before a sales conference, which favours the faster option. The scorecard makes that trade-off visible instead of leaving it to whoever argued loudest in the meeting.

Should you run a pilot before committing?

If the decision is large or you plan to test concepts regularly, a small pilot study with your top-scored provider is worth it. Use a real but lower-risk concept, check how the questionnaire review works, and see how easy the results are to share internally. Our guide on matching providers to your concept stage can help you decide which concept to pilot with.

Where does Vase.ai fit?

We build Vase.ai for Indonesian and regional brand teams that want quantitative concept tests with a verified panel of Southeast Asian consumers, AI-validated responses and a real-time dashboard, run on the platform yourself or with our research experts.

If you are comparing providers now, send us your research question, target audience and the date you need results. We will reply with a suggested test design and sample plan you can score alongside the other proposals on your list.

Frequently asked questions

How many concepts can I test in one study?

It depends on the design. Monadic tests show each respondent one concept and need a separate cell per concept, while sequential monadic designs show several concepts per person. Ask each provider to explain the trade-off for your number of concepts.

Do I need separate results for different islands in Indonesia?

If your distribution, pricing or communication differs by region, yes. Ask for feasibility by region and plan sample sizes so each region you will act on can be read on its own.

What should a concept testing proposal include?

A clear screener, the test design and rotation, the measures and diagnostics, language handling, data quality checks, outputs, timeline and who supports you. If any of these are missing, ask before you score it.