-
Notifications
You must be signed in to change notification settings - Fork 0
sequence primitives
Every neuron stage can now choose its own kind, params, and surrogate. The
presets accept additive neurons (per-stage kind) and stage_params
(per-stage beta/threshold/reset/surrogate) maps, and TrainConfig gains
additive stage_neurons/stage_params. A default build is byte-identical to
before, and fc_legacy keeps its _fc1/_lif1/_fc2/_lif2 contract.
topology/kinds.py grows conv1d,
maxpool1d, maxpool2d, embedding, layer_norm, batch_norm, dropout,
positional_encoding, attention, and multihead_attention, each with a
module factory and an explicit NIR contract — mapped, passthrough
(dropout is identity at inference), or unexportable.
-
sequence_mlpis built only from NIR-mappable kinds over a[T, B, L, D]sequence and validates end to end. Its neurons default toreset="zero", rendering a singlenir.LIFwith noDelay, so it is runnable by the Norse target too. -
sequence_attnis the spiking-transformer-shaped demo (embedding→positional_encoding→multihead_attention→layer_norm→linear→ neuron). The installednirhas no embedding, attention, or normalisation primitive, so export raises the typedUnsupportedStageErrornaming the first unexportable stage. It stays available for simulation and introspection — the honestalphaprecedent, applied to stages.
The toy token task
(data/sequence_source.py)
supplies [T, B, L, D] frames, and the client
StageNeuronEditor edits the
per-stage configuration. This enables sequence/attention experimentation, not
production LLM training.
- Home
- Architecture
- Backend Execution
- Benchmarks
- Dashboard
- Development
- Event Datasets
- Event Runtime And Energy
- Features
- Implications And Boundaries
- Interop Foldins
- Interpreter Spine
- Introspection
- Model Deployment
- Model Hub
- Notes
- Operational Maturity
- Production Workflows
- Project Layout
- Quickstart
- Requirements
- Sequence Primitives
- Streaming Timeseries
- Targets And Interop
- Usage
- Arch 0001 Adr Repo Topology
- Arch 0001 Core Boundary
- Arch 0001 Decision Metrics
- Arch 0001 Migration Plan
- Arch 0001 Packaging Versioning
- Arch 0001 Protocol Contract
- Arch 0001 Risk Register
- Arch 0001 Target Topology
- Backend Execution Plan
- Ecosystem Listings
- Ecosystem Roadmap
- Event Runtime Plan
- Hub Expansion Plan
- Plans
- Interop Foldins Plan
- Interpreter Spine Plan
- Memory System Research
- Model Hub Plan
- Operations Plan
- Production Toolkit Plan
- Production Use Cases
- Professional Roadmap
- Repo Topology Plan
- Sequence Primitives Plan
- Use Case Audio Keyword Spotting
- Use Case Biosignal Medical Monitoring
- Use Case Computational Neuroscience
- Use Case Edge Power Budgets
- Use Case Event Camera Vision
- Use Case Intrusion Anomaly Detection
- Use Case Low Latency Sensor Stream
- Use Case Rl Control Robotics
- Use Case Spiking Transformers
- Use Case Streaming Timeseries