Method
The panel
On the panel today: ChatGPT (OpenAI), Claude (Anthropic) and Gemini (Google). Each model is called through its lab’s official API. We do not paste prompts into chat apps and we do not publish screenshots.
First run on the panel: ChatGPT 30 Sep 2026, Claude 30 Sep 2026 and Gemini 3 Oct 2026. A model counts from its first dated run; earlier runs keep the models they had and are never filled in later.
The panel grows over time. Grok and Perplexity are not on it yet.
Each page names the models that answered that run, and each tape names the exact API model. Every run so far:
- 26 Oct 2026 · 43 questions · prompt v2 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-opus-5-5, default temperature), Gemini (gemini-3.8-flash, temperature 0.2) - 13 Oct 2026 · 1 question · prompt v2 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-opus-5-5, default temperature), Gemini (gemini-3.8-flash, temperature 0.2) - 12 Oct 2026 · 9 questions · prompt v2 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-opus-5-5, default temperature), Gemini (gemini-3.8-flash, temperature 0.2) - 3 Oct 2026 · 40 questions · prompt v2 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-opus-5-5, default temperature), Gemini (gemini-3.8-flash, temperature 0.2) - 2 Oct 2026 · 37 questions · prompt v1 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-sonnet-5-5, default temperature) - 30 Sep 2026 · 1 question · prompt v1 · ChatGPT (
gpt-6.1-sol, default temperature), Claude (claude-sonnet-5-5, default temperature)
Each lab is asked through the model it lists as its app’s default on the run date (ChatGPT, Claude and Gemini), through the lab’s API. When a lab changes its default, the panel moves to the new model from the next run. Earlier runs keep the model that answered them, and the panel page lists every model version each lab has had on the panel.
The question
44 fixed electronics and gear questions. Every model on a run gets the same text, word for word: one short instruction, a required answer format, and the question. Prices in questions are US dollars. The current wording is prompt v2. If the wording changes, the version changes, and the page says which version a run used. Each verdict page opens its tape with the exact text the models received.
The questions are common electronics and gear purchases, most with a US price cap. The list is fixed and changes rarely, always with a date: on 3 Oct 2026 two questions were retired and two added. On 26 Oct 2026 three were added: noise-cancelling headphones under $100, wireless earbuds under $40, and bookshelf speakers under $200. The wider bands were already on the list. These are the narrower purchases those bands were not asking about. The same day a laptop for AI/ML students under $1500 was added, in Computers, beside the other laptop questions.
Models answer from their own knowledge, without web search, so a pick can trail the newest products. Each tape shows the knowledge date the model gives. From prompt v2 (3 Oct 2026) we also ask each model to judge its picks on specifications and measured results rather than copy a review site’s ranking, and to name what decided each pick.
We ask for a low temperature (0.2). Models whose API does not accept one answer at their default; the list above shows which. We keep each model’s raw answer exactly as returned, even when we cannot read a pick out of it.
Sampled runs
From 12 Oct 2026 (method v3), a run can be sampled: each model answers the question 20 times on that run, and the page counts how often each product came first: “first in 14 of 20 answers”. One answer from a model is one draw; asked again, it can name something else, so a single answer is a weak signal. Sampled runs are marked “20 calls per model”. Other runs, including every run before 12 Oct 2026, are one answer per model, marked “one answer per model”. Each page says which.
Every answer is published with the run. If a lab’s API is busy or returns a server error, that call is sent again, up to three times. Calls that still fail are kept as errors, are not counted, and the page says how many failed and why. Every answer is kept; none is re-asked to get a different one. On a sampled run, a model counts only when at least half its answers give a readable pick. When two products come first equally often in one model’s answers, the page says so, and that model counts toward no product in the label.
When a model does not answer
A run is published only when at least two models count. A model counts only with a readable first pick; on a sampled run, with a readable pick in at least half its answers. A model that errors or does not count does not appear in the tally. Its error or raw text stays on the tape, and on a sampled run every answer stays in the run’s raw answers. We never write a pick for a model that did not give one.
How to read a page
The label counts first places from the models that answered. Picks that name the same product in different words count as one. “3 of 3 agree” and “2 of 3 agree” mean a majority named the same product first; “No agreement” means no majority did. With two answers, the labels are “2 of 2 agree” and “No agreement”. The tape is the evidence: if the tape and the label ever disagree, believe the tape and email us.
Two names count as one product when only the wording differs. When both names state a generation, chip, screen size or year and those differ, they are different products: a 13-inch MacBook Air (M3) and a 13-inch MacBook Air (M4) count apart, so three MacBook Airs can still be a split. A name that states no generation matches the same name with one. A generation written into the name matches the same generation in brackets: “AirPods Pro 2” and “AirPods Pro (2nd generation)” are one product, and “AirPods Pro 3” is another.
Notes
When a model gets a checkable fact wrong, such as who makes a product, we add a dated note under that pick. The model’s words stay as it gave them, and the tally counts what it said. We do not add notes on prices, opinions or rankings.
After each run date we check every first pick’s maker and that the product exists. Checked through the 12 Oct 2026 runs; none needed a note. Runs after that date are not checked yet.
New questions
A question with no live run yet shows “Awaiting first run” and no answers. Its page fills in when the panel answers it.
Re-runs
We re-run questions over time to see whether the answers move. A re-run is a new dated run with its own tape, and it can bring a new model, model version or prompt version; the page names each. The question page shows the latest run first, with every earlier run and its tape below it, and the archive lists every run. We do not edit an old run.
A job re-runs the list on the first day of each month. A question that was sampled stays at 20 calls per model. The others stay one answer per model. The new run has its own date, and the previous tape stays.
What we do not do
- Scrape consumer chat apps.
- Rewrite answers or product names. A wrong fact gets a note, not an edit.
- Drop a model because we dislike its pick.
- Test products or write reviews.
- Take payment to include or exclude a product.
SwynQ Labs sells reports to brands built on this record (for brands). A report never changes a run, a tally or a page.
Limits
A run is one day’s answers: up to 20 from each model on a sampled run (20 calls; a failed call is stated on the page), one on any other. Models change between runs, which is why every run is dated and kept.
Models answer from memory, so the figures in their reasons (brightness, battery life, noise reduction) are theirs, not measurements we made or checked.
Models change. Prices change. Stock changes. A page is what the models said on that date, not a buying order and not advice.