project Overview & Details src Code Repositories publications See Our Papers

Source Code

Source code, demos, and implementation materials from the Metacognition Research Project. Each entry below contains code repositories, documentation, and related resources for our published work.

Principled Role Assignment for Multi-Agent LLMs

IJCAI-ECAI 2026 — Demonstrations Track — Bremen, Germany

Extends the MSV framework with a principled five-role architecture grounded in team-role taxonomies, dialectical reasoning, and metacognitive monitoring theory. Features Hungarian-algorithm optimal role assignment, a four-stage dialectical pipeline, and real-time fitness-matrix visualization.

Repository & Demo

Key Features

  • Five Principled Roles: Domain Expert (Thesis), Critic (Antithesis), Evaluator (Resolution), Synthesizer (Synthesis), and Generalist (Orchestrating Observer)
  • Hungarian Algorithm Assignment: Globally optimal agent-to-role mapping via heterogeneous fitness matrices
  • Dialectical Pipeline: Expert → Critic → Evaluator → Synthesizer with MSV evolution tracking
  • Fully Offline: Local LLMs via Ollama (Llama 3.2 + Qwen variants), no API dependencies
  • Video Walkthrough: Narrated demo of routing, pipeline stages, and MSV dynamics

Materials

Related Papers

  • Sethi, Courchaine, and Qiu, “Principled Role Assignment for Deliberative Reasoning with Multi-Agent LLMs in a Metacognitive Architecture,” IJCAI-ECAI 2026, Demonstrations Track. [PDF]

Funding: Supported in part by a Google Cloud Research Grant (November 2025).

Proof-of-Concept (PoC) Implementation

TheWebConf 2026 & CIKM 2025

The original MSV framework demo—a dual-process chat system that computes a five-dimensional Metacognitive State Vector in real time and dynamically routes queries between System 1 (fast) and System 2 (deliberative) processing with interactive radar-chart visualization.

Repository

Key Features

  • Interactive UI: Live prompt/response with an Ollama-based local LLM backend
  • Real-time MSV Computation: Calculates metacognitive state across five dimensions (Emotional Response, Correctness Evaluation, Experiential Match, Conflicting Information, Problem Importance)
  • System 1 / System 2 Transitions: MSV thresholds trigger different processing modes automatically
  • Role Assignment: Ensemble nodes take on specialized roles (Expert, Critic, Evaluator, Synthesizer)
  • Radar Chart Visualization: Interactive display of MSV dimensions and threshold indicators

Related Papers

  • Courchaine*, Sethi*, and Qiu, “Implementation of a Metacognition Framework for Self-Awareness and Self-Regulation in Ensembles of LLMs,” TheWebConf 2026. [PDF]
  • Sethi, Qiu, Courchaine, and Iacoboni, “Do LLMs Dream of Electric Emotions?” CIKM 2025. [ACM DL] [PDF]


← Back to Metacognition Research home