Skip to content

Latest commit

 

History

History
76 lines (47 loc) · 9.71 KB

research-workflows.md

File metadata and controls

76 lines (47 loc) · 9.71 KB

Research workflows, dual loops, and method sources

English | 简体中文 | ← Back to README

This guide explains Main / Worker roles, dual loops, Web / SDK boundaries, and original sources. Use the collapsed Web tutorials for operations and setup and configuration for parameters.

Choose your interface

Web / Server (main) provides visual orchestration, project management, execution traces, and artifact browsing. Examples are static repository Workflow files that users can reuse manually through the existing generic importer.

SDK / CLI runs corresponding workflows through TypeScript or the command line. See the detailed main / SDK parity and host boundaries.

Main and Workers

Every project contains exactly one required main Agent. It interprets requirements, schedules work, handles user input and recovery, and verifies delivery under the termination protocol. Workers perform research, experiments, writing, review, and custom tasks. A method may authorize a terminal Worker to verify completion directly. An edge to finish alone is insufficient.

Each Agent can select Codex, Claude Code, DSH, or pi, with its own model, prompt, Skills, MCP services, reasoning options, and execution permissions. Gateways support OpenAI Responses, OpenAI Chat Completions, and Anthropic Messages. See gateways and Agent settings.

Git collaboration organizes parallel paths through internal workflows and nested groups. References to the same Agent share configuration and sessions. Leaders coordinate within group scope, with PR integration at each level. See scoped collaboration workflows (v3).

Dual loops

The task loop uses execution feedback to improve methods. The process loop uses research results to improve the workflow. Task iteration can operate in a fixed graph; process evolution requires dynamic-reconfiguration authorization.

Task, research workflow, and Evolver form task and process feedback loops

Evolver within the research workflow

Evolver lives inside the workflow and updates its configuration using feedback

The current Evolver is an authorized Main. Enable orchestration.allowMainReconfiguration before creation. Permitted autonomous Main turns can edit the generated workflow.json proposal and call apply_workflow. Server validates the entire document, graph, references, runtime capabilities, and base version before accepting it atomically. Failed validation preserves the previous state.

Main can change its own and other Agents' editable settings. Credentials, permissions, session/reasoning policies, and authorization remain managed by the host. Accepted Project Skill/MCP content cannot be overwritten under the same name; add a definition and update references for a new version. See the Workflow scope. Actual task evaluation determines whether the change improves research.

Research papers and method examples

The main branch's example index presents 21 workflow examples: three starters and 18 workflows from papers or open-source projects. Inspect source files and real canvas screenshots, then manually export and import a copy; the application does not load them automatically. The SDK source commit is 4160a2cf0259b2a1ed9dc4eb36bc0484d2527a42; catalog.json records their status.

Papers, official projects, and implementations

The links below attribute the original work. We adapt public processes as ScienceEvolve Workflows. Each example retains source pins, licenses, capability mappings, and execution protocols.

Method and local implementation Original paper Official code / project
ARIS · Workflow ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration Auto-claude-code-research-in-sleep
Meta-Harness · Workflow Meta-Harness: End-to-End Optimization of Model Harnesses meta-harness
autoresearch · Workflow Official project is the source autoresearch
FunSearch · Workflow Mathematical discoveries from program search with large language models funsearch
Agent Laboratory · Workflow Agent Laboratory: Using LLM Agents as Research Assistants AgentLaboratory
SciAgents · Workflow SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning SciAgentsDiscovery
Robin · Workflow Robin: A multi-agent system for automating scientific discovery robin
Google AI co-scientist · Workflow Towards an AI co-scientist — †
Biomni A1 / E1 · Workflow Biomni: A General-Purpose Biomedical AI Agent Biomni
AgentRxiv · Workflow AgentRxiv: Towards Collaborative Autonomous Research AgentLaboratory
RRSI · Workflow RRSI: Regularized Recursive Self-Improvement of Agent Harnesses rrsi
DrugEvolve · Workflow An AI System for Autonomous Algorithm Evolution in Drug Development DrugEvolve
ScientistTwo · Workflow ScientistTwo: Pioneering the Human Knowledge Frontier with Autonomous AI — †

† The pinned sources for Google AI co-scientist and ScientistTwo do not provide the complete official systems. Their implementations use published papers and available components; independent parameters and assumptions are documented per example. Components such as PaperOrchestra are not the complete ScientistTwo codebase. autoresearch uses the official project as its source; AgentRxiv reference code is in Agent Laboratory. Compact reference metadata is in method-sources.json.

Use manually in the Web UI

  1. Choose an original Workflow, requirement, and reference assets from example/. Canvas screenshots show their layout.
  2. Run the optional exporter on the Server host, then select the generated copy with “导入 SDK workflow.json” on the homepage. The original stays read-only; select it in quick launch to load an editable copy.
  3. Paste requirements separately, prepare real inputs/data, and configure each Agent's Web gateway, Harness, model, and reasoning option. Preserve required cross-family review, fixed evaluation targets, and mandatory stages.
  4. Check Git mode, Skill paths, and external tools before starting; inspect actual traces, commands, raw outputs, and final deliverables.

See manual usage. SDK profiles, bindings, --workspace, and state-directory arguments do not automatically configure Web gateways. Use the SDK branch guide for SDK execution and Workflow configuration for the generic importer.

Validation and attribution boundaries

Workflow implementation, offline protocol checks, real end-to-end execution, and paper-metric reproduction require different evidence. The examples record their configuration, algorithm/tool-contract, and source-check scope. Such checks do not establish successful model runs, GPU experiments, or wet-lab execution.

For each research run, retain input/data versions, actual models/Harnesses, tools and compute, parameters, baselines, all candidates and failure branches, raw measurements, and final artifacts. Compare evaluation against the original paper's protocol. Record missing resources or environment blocks as unfinished work; do not omit stages and claim complete reproduction.

Additional imported designs are included as workflow configuration adaptations. Per-example notes and the pinned SDK source retain the implementation details and scope.