Performance Console
Welcome to the scientific evaluation center for foundation models and logical reasoning auditing.
● System Live & Ready
Recent Evaluations
Loading…
🏆 Official Benchmark
Standard prompt — no injections allowed. Results enter the official leaderboard.
A Participation Mode
B LLM Model
Custom model — results saved but marked as unverified in the leaderboard.
C Board Size
✓ Session ready. Run in your terminal:
Loading leaderboard…
Loading metrics…
iXentBench: Neuro-Symbolic Validation Framework
iXentBench and its multiplayer Arena version form a neuro-symbolic validation framework designed to measure spatial intelligence, causal reasoning, and long-term planning in LLMs. In Arena mode, it also evaluates Theory of Mind and Game Theory. It isolates the AI within a closed, deterministic physical environment (the game Caps i Caps), forcing it to interact with an immutable rule engine.
Core Features
Active Entropy and Memorization Prevention: Controlled entropy is injected through events that alter the board's physical state. The inclusion of the orb forces agents to constantly re-evaluate the environment, eradicating overfitting and memorization.
Transparent Cognitive Auditing: The system demands decision justification (Chain of Thought) before acting, extracting Thinking Tokens and inference speed (TPS) from official APIs to correlate success and cognitive effort.
Cognitive Reasoning Radar: As a qualitative reinforcement value, we incorporate this tool which does use an LLM. Its function is strictly analytical: it evaluates the agent's reasoning to help researchers understand its internal logic, but without any capacity to alter the mathematical and deterministic score of the match.
Visualizer and Replayability: Immutable files (.jsonl) are generated with the record of each match. A dynamic web visualizer allows observing the level's resolution and reading the AI's reasoning step by step.
Computational Complexity: As reflected in the 8x8 board metric, the environment presents extreme "Gear chain causality". With a state space of ~4.02×10⁸⁵ and a branching factor of 512 legal decisions per turn, it demands true long-term planning and invalidates brute force.
"Secure by Design" Architecture (Reliability Validation)
Our infrastructure is designed to ensure that every point earned is the product of genuine mathematical reasoning, ensuring robust evaluation:
Structural Isolation: The architecture separates the agent from the evaluator. Wherever inference happens — a cloud API, a model running locally on your own hardware, or a pure-code agent with no LLM at all — the evaluator runs server-side and independently. The agent's only channel is submitting a move; it never computes its own score.
Real-Time Dynamic Evaluation: Functioning as a live physics engine, there are no predefined solution files. Scoring is calculated mathematically in real-time based on the physical position of elements.
Strict Input Filters: The server never executes arbitrary text. All communication passes through a rigid regular expression (Regex) filter that automatically rejects any syntax that is not an exact mechanical movement.
Deterministic Validation: Evaluation is performed using strict modular arithmetic and spatial coordinates via a deterministic engine, rather than using an LLM as a judge. No LLM sits anywhere in the scoring path, so the ranking is not produced by text that could be manipulated. In the Official Benchmark every model receives the same fixed system prompt; custom prompts and strategy files are discarded by the server.
Internal State Checking: Success is verified by checking internal state variables directly within the server's memory. The validation of text strings generated by the agent is not used.
Unbreakable Logic Loop: The evaluation code executes a cohesive and uninterrupted process every turn (Syntax Validation, Adjacency, Entropy, Rotations, Points), ensuring sequential evaluation without skips.
Result Integrity: The final result and replay files are built, cryptographically signed and stored exclusively by iXentLabs' backend infrastructure. The evaluated agent has no path to edit these records.
🧪 Laboratory
Free experimentation — BYOK, prompt injection, custom agents. Results are not ranked.
⚠ Lab results are saved to your Replay Auditor but do not count toward the official leaderboard.
A Participation Mode
B LLM Model
Free text — use any model string configured in your local environment.
D Advanced
Place file in ~/ixentbench/prompts/
Place file in ~/ixentbench/strategies/
The complete guide to understanding the game engine, scoring and strategy. For players, researchers and Custom Agent (Option C) developers.
Board Quick Reference
VISUALLevel 1 — 3×3 Grid
Orientation (b values)
Jump Rule
Part 1: Game Physics (Caps i Caps)
PHYSICSThe Board (R/L Rule)
The board consists of X Columns and Y Rows. The first tile P11 is the bottom-left corner. X increases to the right, Y increases upwards.
Gear Types and Inventory
| Type | Bases | Orientations | Initial Code |
|---|---|---|---|
G1 | 1 Base | 0° | B0222 |
G2 | 2 Opposite | 0°, 180° | B0202 |
G3 | 3 "T" shape | 90°, 180°, 270° | B2000 |
G4 | 4 Full Cross | 0°, 90°, 180°, 270° | B0000 |
0 = base exists and is EMPTY |
1 = base occupied by a MOUSE |
2 = NO base at this orientation
Placement Rules and Game Phases
Mice Physics and Scoring
Efficiency Score
Part 2: Reading the Board State
BOARD READINGThe AI does not see the board visually — it reads a symbolic JSON representation. If you are building a Custom Agent (Option C), this is what your script receives.
Board Encoding — How to read a tile
Mice States
| Status | Meaning | on_base value |
|---|---|---|
WAITING | Not yet on board | null |
IN_PLAY | On the board | 0=Up | 1=Left | 2=Down | 3=Right |
ESCAPED | Rescued — game objective | null |
Part 3: Entropy Protocol (Anti-Memorization)
ANTI-OVERFITTINGPart 4: Strategic Reasoning Principles
STRATEGYHierarchical Decision Tree — apply in strict order
| Priority | Name | What to look for |
|---|---|---|
| 1 | Win NOW? | Move that makes a mouse leave the board immediately (+10 pts exit). |
| 2 | Reach Exit? | Place a mouse in the last row (exit row) this turn. |
| 3 | Clear Advance? | Move a mouse to a higher row (y+1) or bring a new mouse onto the board. |
| 4 | Strategic Maneuver? | No direct advance possible — prepare terrain, break a block, improve position. |
| 5 | Pre-Move (Full Board)? | Inventory = 0 only. Modify 'b' of a gear before rotating to set up multi-turn combos. |
| 6 | Local Maxima? | Before confirming: could a different move save 2 mice instead of 1? |
| 7 | Placement Strategy? | Phase 1 only: think about future rotations when placing each gear. |
Placement Patterns (Vectors) — Priority 7 Reference
Part 5: Command Syntax Reference
COMMANDSCommand formats — used by the CLI and Custom Agents
Validation Rules
stdin (JSON) and must return {"command": "...", "reasoning": "..."} via stdout. See agent_template.py in your ~/ixentbench/ folder.
Complete prompt architecture for the iXentBench Agent API — Solo and Arena modes. For players, researchers, auditors and Custom Agent (Option C) developers.
Architecture
DESIGNThe system prompt is assembled at runtime by build_system_prompt(mode, player_id, ally_id). It concatenates a shared CORE_PROMPT with small differential modules injected based on mode and player ID.
Physics · State · Strategy · Protocol
solo | arena
solo | P1..P4
solo | P1..P4
ffa | team_a | team_b
solo | arena
solo only
always last
CORE_PROMPT
Board physics, gear types, scoring vectors, jump rules, data structures, priority tree, command syntax. Common to all agents.
MODULE_START_RULE
Which edge the agent must place their first gear on. Varies by player_id.
MODULE_SCORING
Direction-specific scoring examples. What counts as "forward" differs per player_id.
MODULE_ALLIANCE
FFA vs Team A vs Team B. Defines ally and enemy relationships. Arena only.
MODULE_ENTROPY
Full entropy protocol for Solo. One-line note for Arena (no entropy events).
MODULE_ORB
Dynamic decoy agent (Orb_1) protocol to prevent route memorization. Solo only — not injected in Arena mode at all.
get_identity_module()
Final IDENTITY LOCK — always injected last. Prevents perspective confusion.
Assembly order
Prompt Injection Guide
OPTIMIZATIONYour Prompt Injection (Option A, --prompt-file) is prepended to the system prompt. The agent already knows everything in this document. Do not repeat what is already in the CORE_PROMPT.
High-value injection targets:
CORE_PROMPT — Full Text
VERBATIMInjected for ALL agents in ALL modes. This is what every agent already knows before your Prompt Injection is applied.
CORE — Introduction & State DisciplineDifferential Modules — Full Text
VERBATIMMode Reference
USAGE| Call | Modules injected | Use case |
|---|---|---|
build_system_prompt("solo", "solo") | CORE + levels_solo + start_solo + scoring_solo + entropy_full protocol + orb_full protocol + identity | Solo mode |
build_system_prompt("ffa", "P1") | CORE + levels_arena + arena_strategies + start_P1 + scoring_P1 + alliance_ffa + entropy_note only + identity_P1 | Arena 1v1 or 4-FFA, P1 slot |
build_system_prompt("team_a", "P1", "P2") | CORE + levels_arena + arena_strategies + start_P1 + scoring_P1 + alliance_team_a + entropy_note only + identity_P1+ally_P2 | 2v2 Team A, P1 with P2 as ally |
build_system_prompt("team_b", "P3", "P4") | CORE + levels_arena + arena_strategies + start_P3 + scoring_P3 + alliance_team_b + entropy_note only + identity_P3+ally_P4 | 2v2 Team B, P3 with P4 as ally |
⚠️ entropy_note only (Arena): only one line injected — "There are no entropy events in Arena mode." No protocol, no [EVENT] tag.
⚠️ orb_full protocol (Solo): complete anti-memorization decoy protocol injected — agent must re-read board after [EVENT] 🔮.
⚠️ Arena (all rows above): no MODULE_ORB text is injected at all — the module call is skipped entirely, not even a one-line note.
--prompt-file flag in the CLI, your custom instructions will be appended directly after the IDENTITY LOCK block.
iXentBench™ — © 2026 iXentLabs (iXent Games S.L.)
✓ Session configured. Run this in your terminal:
iXentBench™ — The AI Reasoning Benchmark Platform
Causal spatial reasoning at 4×10⁸⁵ scale, powered by Caps i Caps© — the game that makes memorization impossible. Developed by iXentLabs (iXent Games S.L.)
Installation & Setup
Quickstart
(Note for Windows users: The && operator requires PowerShell 7+ or cmd.exe. If you are using default PowerShell 5.1, please run the two commands separately).
Standard Installation
1. Install the engine:
2. Initialize your local folder:
You will see this welcome message confirming your folder is ready:
Quick Start
1. Configure your session at ixentlabs.com
Login with Google, select benchmark type, level and AI model.
Add your API Key to the .env file.
2. Run your session:
2.1 For AI evaluation with iXentBench, without Prompt Injection & Strategy
2.2 For AI testing with iXentBench, optional Prompt Injection & Strategy
The visualizer opens automatically in your browser.
Benchmark vs. Lab — What's the Difference?
| Benchmark (Official) | Lab (Sandbox) | |
|---|---|---|
| Prompt Injection & Strategy | Discarded by the server — never applied | Applied to the AI's system prompt |
| Results | Saved to the SQL Official Leaderboard (is_official = true) | Saved privately — never ranked publicly |
| Purpose | Consistent, comparable AI evaluation | Free experimentation and testing |
Both modes are eligible for certification — Lab results are not excluded from Trust & Verify certificates, they simply don't count toward the public leaderboard.
Play Modes
There are four ways to play iXentBench, designed for every type of participant — from AI engineers to pure mathematicians and AI enthusiasts.
| Flag | A — BYOK | B — Local Model | C — Custom Agent | D — Sponsored |
|---|---|---|---|---|
| Uses LLM | ✅ Cloud API | ✅ Local | ❌ Pure code | ✅ iXentLabs |
| API Key needed | ✅ Yours | ❌ No | ❌ No | ❌ No |
--prompt-file (optional --mode lab) (optional) | ✅ Yes | ✅ Yes | ❌ No | ✅ Yes |
--strategy-file (optional --mode lab) (optional) | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes |
A — BYOK (Bring Your Own Key)
Use your own API Key from Gemini, Claude, GPT, ...
Your key never leaves your machine — it is read locally and never sent to our servers.
.env file:
B — Local Open Source Model
Run any open source model (Llama, Mistral, Qwen...) locally using Ollama, LM Studio or llama.cpp.
No API Key required. Full privacy — no data leaves your machine.
⚠️ Inference speed metrics are excluded from global leaderboards (hardware-dependent).
C — Custom Agent Script
For engineers and researchers who want to solve iXentBench using pure code — no LLM required.
Write your own Python script using any algorithm you choose: Minimax, MCTS, A*, heuristics, neural networks trained from scratch — anything goes.
Your script receives the full board state via stdin (JSON) and must return a move via stdout (JSON). It runs entirely on your machine.
Your script must output:
--strategy-file to explain your approach. Top results are presented to AI companies for talent opportunities (see Talent Hub below).D — iXentLabs Sponsored
Select "Use iXentLabs credits" on the web — we provide the API Key.
No .env file needed. The cloud handles everything.
Arena Mode (Multiplayer)
# Create a room (you become the host)
ixentbench arena create --mode 1v1 --level 1 --model gemini-2.5-flash
# Join an existing room
ixentbench arena join --room IXENT-A7B9M2
# Join with a specific model
ixentbench arena join --room IXENT-A7B9M2 --model claude-sonnet-5
# Play as Human (manual via visualizer)
ixentbench arena create --mode human --level 1 --model Human
ixentbench arena join --room IXENT-A7B9M2 --model Human
Supported modes: 1v1, 2v2, 4v4 (4-player FFA), human (Human vs AI).
If --model is omitted: defaults to gemini-2.5-flash (AI modes) or Human (human mode).
⚠️ There's no manual "start" command — the match begins automatically the moment the last slot fills. See the Arena Rules (ℹ️) for the full lobby mechanics.
Prompt Injection & Strategy Files
Prompt Injection (--prompt-file) — Optional
Inject your own strategic prompt directly into the AI's System Prompt before the game starts.
Applies to modes A, B and D (LLM-based). Not applicable to mode C.
Place your file inside ~/ixentbench/prompts/ and simply pass the filename:
SYSTEM_PROMPT_vREFERENCE.html in your player folder.Strategy File (--strategy-file) — Optional
A written description of your approach — how you designed your agent, what techniques you used, what insights guided your decisions.
It is never sent to the AI. It is stored securely and linked to your results for the Talent Hub.
Applies to all modes (A, B, C and D).
Place your file inside ~/ixentbench/strategies/ and simply pass the filename:
🏆 iXentLabs Talent Hub
iXentBench is more than a benchmark — it is a talent discovery platform.
With your explicit prior consent, iXentLabs will present the top results of each benchmark category to leading AI companies and research labs. This includes your performance metrics, your Prompt Injection (if any), and your Strategy File — giving organizations a rare window into the reasoning and engineering skills behind the results.
Only anonymized benchmark data is presented, identified solely by your chosen nickname and avatar, unless you opt in to full visibility.
If you achieve an exceptional result and want your work to be seen by the teams building the future of AI — iXentBench is your stage.
Utility Commands
ixentbench login # Force Google re-authentication
ixentbench status # Show credentials and session status
ixentbench prompts list # List your locally saved prompt files
ixentbench strategies list # List your locally saved strategy files
ixentbench --version # Show version
🔄 How to Update
When iXentLabs releases a new version of the engine or adds new benchmarks, you can update your SDK without losing your API Keys or your login session.
Your configuration files in the ~/ixentbench/ folder will remain intact.
Uninstall
License
Proprietary — © 2026 iXentLabs (iXent Games S.L.)
Contact: contact@ixentlabs.com
Match results — coming next step
No STAR-XAI audit available for this match.
Enable the auditor in the Admin panel to generate cognitive scores.
⚔️ Arena
Multiplayer — 1v1, 2v2, 4P FFA, and Human vs AI. Play with friends or other AI models.
A Participation Mode
B LLM Model
C Board Size
D Advanced
Place file in ~/ixentbench/prompts/
Place file in ~/ixentbench/strategies/
A Room Code
B LLM Model
D Advanced
Place file in ~/ixentbench/prompts/
Place file in ~/ixentbench/strategies/
The complete guide to multiplayer Arena mode: physics, scoring, game theory and commands. For players, researchers and Custom Agent (Option C) developers.
Board Quick Reference
VISUALLevel 1 — 4×4 Grid
Arena Levels
Block / Island Concept
Players, Roles & Starting Zones
ROLESEach player starts from a different edge of the board and must move their mice to the opposite edge. All four players share the same board simultaneously.
🟣 P1 — South → North
Starts: Row 1 (y=1) — South edge.
Target: Row max-Y — North edge.
Forward direction: 0° (Up)
Exit: last row on North side. +10 pts.
🔴 P2 — North → South
Starts: Row max-Y — North edge.
Target: Row 1 (y=1) — South edge.
Forward direction: 180° (Down)
Exit: row 1 on South side. +10 pts.
🟢 P3 — East → West
Starts: Column max-X — East edge.
Target: Column 1 (x=1) — West edge.
Forward direction: 90° (Left)
Exit: column 1 on West side. +10 pts.
🟤 P4 — West → East
Starts: Column 1 (x=1) — West edge.
Target: Column max-X — East edge.
Forward direction: 270° (Right)
Exit: last column on East side. +10 pts.
Part 1: Game Physics
PHYSICSBlocks and Independent Networks
This is the key difference between Solo and Arena. In Solo, all gears eventually form one connected network. In Arena, players can maintain isolated blocks — physically disconnected gear networks. Rotating a gear only propagates to gears in the same block.
Gear Types and Inventory
| Type | Bases | Orientations | Initial Code |
|---|---|---|---|
G1 | 1 Base | 0° | B0222 |
G2 | 2 Opposite | 0°, 180° | B0202 |
G3 | 3 "T" shape | 90°, 180°, 270° | B2000 |
G4 | 4 Full Cross | 0°, 90°, 180°, 270° | B0000 |
0 = base exists and is EMPTY | 1 = base occupied by a MOUSE | 2 = NO base at this orientationPlacement Rules and Game Phases
Mice Physics and Scoring
Part 2: Reading the Board State
BOARD READINGIn Arena, the board state contains mice and gears from all players simultaneously. Each mouse is tagged with its owner. Use owner and status to distinguish your mice from opponents'.
Board Encoding — How to read a tile
Mice States — Multi-player format
| Field | Meaning | Example |
|---|---|---|
owner | Which player owns this mouse | "P1", "P2", "P3", "P4" |
status | Current state of the mouse | WAITING | IN_PLAY | ESCAPED |
pos | Current tile coordinate | "P21" or "OUT" if escaped |
on_base | Which base the mouse occupies (P1-centric) | 0=Up | 1=Left | 2=Down | 3=Right | null |
Part 3: Game Modes
MODESFree For All (FFA)
Every player competes independently. 1v1 (2 players) or 4-player FFA. The player with the highest score at the end wins. No alliances — optimize exclusively for your own score.
2v2 Team Mode
Players are split into two teams. Team A: P1 + P2. Team B: P3 + P4. The team with the higher Team Efficiency wins — not the simple sum of both scores (see formula below). Allies share a connected block strategy — coordinate rotations to advance both players' mice.
Human vs AI
One or more human players compete against AI agents on the same board. Humans input their commands manually via the web interface; AI agents run their game loop automatically.
Room Lobby & Matchmaking
Every Arena match starts as a room with a shareable invite code — no separate "Start" step. The room fills up and the match begins automatically.
Part 4: Strategic Reasoning
STRATEGYGame Theory — The Prisoner's Dilemma
Arena is not just a puzzle — it is a dynamic game theory problem. Every move you make affects all players on the board. Evaluate dynamically whether a selfish, cooperative, or aggressive strategy maximizes your score.
⚔️ ADVANCE (Selfish)
Focus purely on routing your own mice. Keep your block isolated. Predictable and safe, but limits spatial options as the board fills.
🤝 COLLABORATE (Coop)
Team mode only. Merge with ally's block and execute rotations that advance both players' mice simultaneously. Requires coordination.
🛡️ ISOLATE (Defensive)
Keep your network disconnected from opponents at all times. Protects your mice from manipulation but reduces board coverage.
🔗 MERGE (Aggressive)
Intentionally connect to an opponent's isolated block. You gain kinetic control — their gears enter your rotation network.
💥 SABOTAGE (Hostile)
Rotate a merged block to push an opponent's mouse backward (-10 pts for them). High-risk, high-reward. Use when opponent is close to winning.
🎯 DUAL-PURPOSE
Find a rotation that advances your mice AND harms opponents simultaneously. The highest-value move in any turn — always check before deciding.
Priority Tree — Apply in strict order each turn
| Priority | Name | What to look for |
|---|---|---|
| 1 | Win NOW? | Move that makes your mouse exit the board immediately (+10 pts exit). |
| 2 | Reach Exit? | Place a mouse in the exit row/column this turn. |
| 3 | Clear Advance? | Move a mouse one step forward, or bring a new mouse onto the board. |
| 4 | Strategic Maneuver? | No direct advance — prepare terrain, merge/isolate, or set up a multi-turn combo. |
| 5 | Pre-Move (Full Board)? | Inventory = 0 only. Adjust 'b' before rotating to unlock a jump not otherwise possible. |
| 6 | Local Maxima? | Before confirming: could a different move rescue 2 mice instead of 1, or sabotage an opponent? |
| 7 | Placement Strategy? | Phase 1 only: place gears thinking about future rotations AND future block merges/isolation. |
Placement Patterns (Vectors) — Priority 7 Reference
Part 5: Command Syntax Reference
COMMANDSCommand format — identical to Solo mode
Validation Rules
stdin (JSON) and must return {"command": "...", "reasoning": "..."} via stdout. The state includes all players' mice and gears. See agent_template.py in your ~/ixentbench/ folder.iXentBench™ — © 2026 iXentLabs (iXent Games S.L.)
Create a room or join one to see the lobby here.
Room slots
Replay Auditor
Review and audit your past evaluations.
Select filters and click 'Filter' to load matches.
Playroom NEW
Pick a room, pay your ticket, and play — no SDK & API KEY required.
The Solo Trial
Train alone. Master the mechanics before facing any opponent.
The Duel
Challenge a friend in a pure human duel. No AI. Just wit.
The Alliance
Two teams of two humans battle it out. Strategy meets teamwork.
The Summit
Four players. One giant board. Pure chaos and strategy.
David vs Goliath
Face Gemini 2.5 Flash. Fast and ruthless. Can you out-think it?
The Challenger
Gemini 2.5 Pro thinks deep. Every move matters on this board.
The Oracle
You and a partner vs two Gemini 2.5 Pro instances. Cooperate or fall.
The Colosseum
Alone against three Gemini 2.5 Pro. The ultimate human challenge.
The Arena
Control Gemini 2.5 Pro with prompt injections. Every move is data.
The Titans
Gemini 3.1 Pro vs Gemini 3.1 Pro. Inject strategy and watch them clash.
The Laboratory
Two teams of Gemini 3.1 Pro. Inject conflicting strategies. Watch chaos unfold.
The Pinnacle
Four Gemini 3.1 Pro, four players controlling them. The peak of AI data generation.
Room coming soon
We are polishing the details of every room.
You'll be able to select your preferred AI as an opponent or ally.
We'll notify you when they're ready.
Leagues
Compete globally. ELO-ranked. Quarterly playoffs.
League system — post-Arena migration.
Certificates
Signed evaluation certificates with immutable UUID.
Available from PRO plan onwards.
| Date | Format | Agent/s | Outcome | Action |
|---|
Subscription
Manage your plan and billing.
Subscription management — coming soon.
Settings
Account, API Keys (BYOK) and preferences.
Settings panel — coming soon.
Certify this evaluation?
This will permanently cryptographically sign this evaluation with Cloud KMS and store it in immutable, long-term retention storage. This action cannot be undone.
A signed, permanent and publicly verifiable record of this evaluation
will be published at verify.ixentlabs.com. Anyone holding
the certificate ID will be able to independently verify its
cryptographic signature and view the evaluation results.
Published data includes the model evaluated, level, score, token metrics and STAR-XAI dimensions. It does not include your name, email or any contact details.