Foundational Human Modeling: A roadmap for brain-grounded multi-modal AI
Richard Csaky
No artifacts found in the Drive folder yet.
Foundation agents excel at language, perception, and tool-use, yet remain brittle across domains and time: their success rates can exhibit ``half-lives'' under distribution shift, and their reasoning is often forced through language tokens \citep{foundationagents2025,jagged_frontier_2023,agent_success_half_life_2025,embers_autoregression_2024}. This roadmap argues for \emph{Foundational Human Modeling (FHM)}: scaling generative brain models (EEG/MEG/ECoG/sEEG/fMRI) and integrating \emph{brain tokens} into multimodal token streams to provide privileged internal signals for grounding, regularization, and human-like cognition. We propose: (i) scaling next-brain-token prediction toward stable long-horizon neural rollouts \citep{csaky2026scalingnextbraintoken,csaky2024gpt2meg,meg_gpt_2025}; (ii) unifying heterogeneous brain modalities via shared geometry and adapters \citep{xiao2025brainomni,scaling_laws_neural_data_2024}; and (iii) treating cognition as an interleaved typed token stream in which brain, vision, language, and action tokens can be produced in a dynamic ordering
python -m agent.pipelines.summarize for an LLM version.- WP ID
- WP0065
- Lifecycle
- prospect
- Visibility
- internal
- Access level
- —
- Embargo until
- —
- Priority
- —
- Collab
- open
- Venue
- —
- DOI
- —
- Deadline
- —
- Owner
- —
- Source
- drive_legacy
- Repo path
- WP0065 - Foundational Human Modeling - A roadmap for brain-grounded...
No versions cut.
