Skip to main content

Market edition · ja-JP · Asia/Tokyo

Japan — 日本

The most form-heavy market in the index. Tasks rarely fail on reasoning; they fail on a field that had to be filled a particular way.

Preview 0.1

6 markets · 10 task families · 3 separate outcome axes.

What will be measured here

Task families defined for Japan

Each family is written against this market specifically. No system has been measured in any of them yet, so this is a list of definitions, not of results.

Operational hazards

Why Japan is hard for an agent

Each hazard is tied to the diagnostic axis it loads onto, so a failure can be traced to a capability rather than to a vague sense of difficulty.

Kana name fields
LocalizationBooking and delivery forms commonly require a separate phonetic reading of the customer name. Systems that mirror the kanji into the kana field produce a rejected form.
Postal-code driven addressing
Tool / API UseThe postal code auto-populates prefecture and ward; typing them manually as well is a frequent duplicate-field error.
Convenience-store fulfilment
OrchestrationA large share of orders complete at a konbini pickup or payment step, which extends the task well past the checkout screen.
Register and refusal etiquette
LocalizationDeclining or rescheduling carries strong conventional phrasing. A blunt but accurate message is scored down on localization.

Market integration profile

Representative local execution conditions

How everyday journeys in this market are actually reached, authorised, completed and evidenced. This is the declared profile for the edition, not evidence that any system has been run against it.

Declared integration conditions for the Japanese edition. Most of them decide whether a form is accepted at all, and the rest decide whether an accepted order is actually finished. None has been exercised against a system.

These are fixed execution conditions held equal across systems. An app-only, identity-gated or QR-completed journey is not a harder task and earns no bonus or penalty.

  • Form completion and local text entry

    Separate phonetic reading fields on booking forms

    Forms commonly ask for the customer name twice, once in characters and once as a phonetic reading. Mirroring one field into the other produces a rejected submission rather than a warning.

    Surface
    Open web · Signed-in app
    Authorisation
    None or session
    Completion
    Confirmed synchronously
    Recovery
    Whole-form invalidation · Partial success
    Evidence
    Locale-formatted artifact · Post-action state readback
  • Address entry

    Postal-code auto-fill and duplicated address fields

    The postal code populates the region and ward fields itself. Typing them again duplicates the address, and the failure appears at submission rather than at the field.

    Surface
    Open web
    Authorisation
    None or session
    Completion
    Confirmed synchronously
    Recovery
    Duplicate or retry risk · Whole-form invalidation
    Evidence
    Request and tool-call lineage · Post-action state readback
  • Fulfilment and payment outside the agent's surface

    Convenience-store payment or pickup completes the order

    The order is only finished when the user pays or collects at a store, so a checkout confirmation is a pending state and the deadline for that step is part of the task.

    Surface
    Open web · Phone, in person or human handoff
    Authorisation
    Payment approval
    Completion
    Completed off the agent's surface
    Recovery
    Stale inventory or late fee · Partial success
    Evidence
    Authoritative response or receipt · Handoff checkpoint · Locale-formatted artifact
  • Reservation confirmation

    Reservation confirmed by a code sent to the user's phone

    Booking flows frequently send a one-time code to the user's number, which moves the confirmation boundary onto the user's device and puts the step under a timeout.

    Surface
    Phone, in person or human handoff · Signed-in app
    Authorisation
    One-time code
    Completion
    Confirmed by the user
    Recovery
    Identity handoff timeout · Channel unavailable
    Evidence
    Handoff checkpoint · Request and tool-call lineage
  • Recovery and retry discipline

    Retry invalidates the whole submission

    Many flows discard the entire form on a validation error or a held reservation slot, so a retry is a fresh non-idempotent submission and has to be recorded as one.

    Surface
    Open web · Official API or tool
    Authorisation
    None or session
    Completion
    Pending, resolves later
    Recovery
    Whole-form invalidation · Duplicate or retry risk
    Evidence
    Retry and idempotency record · Request and tool-call lineage

Declared, not exercised. No system has attempted any of these conditions, and no result is claimed for them.

Localisation

What changes when the task is local

These are the concrete differences an agent has to absorb before it can finish an everyday task here.

  • Reservation flows frequently need a phone number that receives a confirmation code, moving the confirmation boundary to the user's device.
  • Seat and room inventory is released on fixed calendar rules, so travel tasks depend on knowing the release date, not on search skill.
  • Cost per success rises with retries because many forms invalidate the whole submission rather than a single field.
  • Public holiday clusters compress delivery capacity and change what a reasonable ETA looks like.

Hero missions

What we actually asked for

A hero mission is the human-readable version of a canonical task: a persona, a prompt, a declared final state, and the line the system must not cross alone.

Email & Calendar

Decline and rebook without losing the relationship

Synthetic persona JP-01, a project manager in Tokyo.

I can't make Tuesday's review. Decline properly and propose two alternatives next week.

Final stateA drafted decline in appropriate keigo, two proposed slots valid in Asia/Tokyo, and a held tentative event.

Confirmation boundaryThe decline is drafted, not sent.

Shopping & Delivery

Konbini pickup with a kana name field

Synthetic persona JP-04, ordering to a Shibuya-ward address.

Order this replacement part for convenience-store pickup near my office.

Final stateA prepared order with a correct phonetic name reading, a postal-code-derived address, and a named pickup branch.

Confirmation boundaryPayment occurs at the store; nothing is paid online.

Travel Planning & Accommodation

Rail plus stay inside a release window

Synthetic persona JP-01, travelling with one colleague.

Two of us to Osaka next month, reserved seats, twin room near the station, under ¥60,000 each.

Final stateBookable rail options honouring the reservation release date, plus one twin room, with a stated per-person total.

Confirmation boundarySeats are identified, not reserved.

Dining & Reservations

Reservation requiring a phone confirmation code

Synthetic persona JP-04, booking dinner for four.

Book four for Saturday evening, quiet enough to talk.

Final stateA prepared reservation, or an explicit stop naming the phone-verification step the user must complete.

Confirmation boundaryThe agent does not attempt to receive or enter a verification code.