From cc9f9b1135fad36ee031cc2faa6378fbd063de82 Mon Sep 17 00:00:00 2001 From: shinyobjectz Date: Wed, 18 Nov 2026 18:11:38 -0800 Subject: [PATCH] What's new for 0.1.5, 0.1.6, 0.1.7 and 0.1.8 The manual's What's new stopped at 0.1.4, and GitHub's release notes for 0.1.5 to 0.1.7 say only "notes follow". - 0.1.5 and 0.1.6 are the notes written for them (the Studio release folders' notes.md), with the internal comments that backed each line taken out. - 0.1.7 is written from what it shipped: the Windows release (#169's paths and the workspaces they broke repaired, sign-in and keys kept on Windows, this PC and Ctrl, Use another account on raea.io's link page). - 0.1.8 is written from its launch thread and the PRs since 0.1.7: Windows (agents, the installer's folder, DX12 for Intel and AMD, phone video through a fetched FFmpeg), local models with nothing installed, layers (thanks to wackyza), labels, the window's memory and feed speed, live 3D, Linux 3D, and for builders: controls, @shared imports, raea check without FFmpeg, raea gen's fal fixes, WGPU_BACKEND and video-decompiler. Its Known list carries forward what's still open and adds DX12's slower shader compile and TokenSynth on Windows. Dates are Pacific, as 0.1.3's and 0.1.4's are; 0.1.8's is the day it's staged. --- docs/manual/whats-new/0.1.5.md | 87 +++++++++++++++++++++++++++ docs/manual/whats-new/0.1.6.md | 98 ++++++++++++++++++++++++++++++ docs/manual/whats-new/0.1.7.md | 47 +++++++++++++++ docs/manual/whats-new/0.1.8.md | 106 +++++++++++++++++++++++++++++++++ 4 files changed, 338 insertions(+) create mode 100644 docs/manual/whats-new/0.1.5.md create mode 100644 docs/manual/whats-new/0.1.6.md create mode 100644 docs/manual/whats-new/0.1.7.md create mode 100644 docs/manual/whats-new/0.1.8.md diff --git a/docs/manual/whats-new/0.1.5.md b/docs/manual/whats-new/0.1.5.md new file mode 100644 index 00000000..90f74d6d --- /dev/null +++ b/docs/manual/whats-new/0.1.5.md @@ -0,0 +1,87 @@ +--- +title: "raea 0.1.5" +version: "0.1.5" +date: "2026-11-15" +summary: "The Index release: every picture and video you have, searchable by what's in it, a new app with the chat first, `/goal`, and three.js and React Three Fiber running on raea's GPU." +sources: ["https://github.com/shinyobjectz/raea/releases/tag/v0.1.5"] +--- + +raea 0.1.5 is the Index release. Add your folders, your drives and Apple Photos, and every picture and video in them becomes searchable by what's in it, on your Mac, while you watch the count climb. On Pro and Team your other Macs search it too. It also brings a new app that puts the chat first, with your projects in a rail and less on every screen. You also get `/goal` for an agent that keeps going until the job is done, a menu on every picture and video, and replies that reach the agent working in your terminal. + +**Get the app at [raea.io](https://raea.io)** (a Mac with Apple silicon, Windows 10 or 11, or Linux on x86_64). + +The engine alone: + +```sh +curl -fsSL https://raea.io/install | sh +``` + +On Windows, in PowerShell: `irm https://raea.io/install.ps1 | iex`. + +## What changed since 0.1.4 + +**Index: everything you've shot, searchable by words.** Search, under Everything in the rail, lists the places your pictures live, and Connect brings in another: +- the usual folders in your home (Pictures, Desktop and the rest), iCloud Drive, any drive you plug in, or any folder you pick; +- Apple Photos, which means your iCloud Photos and your iPhone's camera roll too. macOS asks you once. + +Each picture goes in from the small copy the file or Photos already keeps, embedded by SigLIP 2 on your Mac's Neural Engine. On an M5 Pro, 10,000 pictures were searchable less than a minute after the Index started, about 180 a second, and the first ones in under half a second. The page shows the live count, the rate and the pictures as they go in. Search works while a folder is still going in: type "a red car at night" and the matches come back in under 20 milliseconds. A picture can be the search too: press the corner of any picture for more like it. + +A video goes in as a few of its frames: one for every 4 seconds, at most 16, taken from the keyframes it already has, so search finds the moment and not just the file. 47 half-minute clips (23 minutes of video) went in as 371 frames in 2.2 seconds. + +On Free nothing leaves your Mac, and nothing is downloaded. Photos is read from the small copies it keeps here, so a library whose originals live in iCloud goes in as it is. A file in iCloud Drive that's only in the cloud goes in from the thumbnail macOS already makes for it (Quick Look), after the folder's local files: about two a second, and the file stays in the cloud. + +On Pro and Team, the Index also keeps each picture's small thumbnail and its vector in raea's cloud, never the file, so a search on any of your Macs finds what's on the others too. Each match says which Mac it's on, and a picture that's on both, like one from iCloud Photos, shows once. The thumbnails count toward your storage, about 20 KB each. Take a folder out of the Index and its pictures leave the cloud too. + +Google Drive works without its app too. Under Connect, pick files in Google's own picker and they go in from the thumbnails Drive already makes for them, each one searchable about a second after you press Select. Nothing is downloaded, no picture passes through raea's servers, and a match opens the file in Drive. It works on the Free plan. + +Google Drive, Dropbox, OneDrive and Box are places of their own under Connect when their app is on your Mac. The files that app keeps here go in at full speed; the ones kept online only are counted on the row and left out for now. + +**Tell your agents what each library is for.** Each place on the Search page takes one sentence in your words, like "Client footage. Read only: never edit or move it." Pick where agents save finished work, too. Every chat starts with those words, and What agents read shows you exactly what they get. + +From the terminal, and for your agents: `raea index add FOLDER` (or `photos:`), `raea index search WORDS`, `raea index status` and `raea index remove`. The skill teaches agents to reach for `raea index search` when you say "that photo of…" or "the clip where…". + +**A new app: the chat first.** +- Your projects are in a rail down the left. Each one wears a 3D emoji, picked from all 4,007 of Noto's emoji and tinted the project's colour or any colour you pick, and it turns toward your pointer. Drag one project onto another to put it inside. +- A project opens to its chat, with its feed beside it. Source, Tasks and Controllers are tabs in the same panel, and each has a search. Source shows the project's files as cards. +- An item opens full size, and Back takes you to where you were. +- Every screen has less on it. A film has one row under the picture and the timeline is its transport. The timeline only shows the tools you can use right now. +- Search sits under Everything in the rail. One field finds a project, a piece of work, or any picture or video by what's in it. +- Publish is one page: your posts and your review links together, the last 30 days' numbers at the top, what needs you (a post to retry, notes to answer, a post ready to schedule) first, and one search across all of it. Share a piece from wherever you find it. +- An agent wears its AI's icon, or an emoji you give it. The shells and monitors a chat has running sit over its box, so you can see what's still going. +- A workspace can be renamed or deleted: Edit workspace, in the workspace's menu at the top of the rail. Its folder is renamed to match, and a deleted one goes to the Trash, where you can put it back. + +**`/goal`.** Type `/goal` and a condition in any chat, and raea asks the agent to check it each time it stops, up to 40 times, until the agent answers that the goal is met. `/goal clear` drops it and `/goal resume` picks it back up. The goal sits over the composer while it's open. + +**Notes become a plan.** A round of notes on an item is one to-do until the agent plans it. Then the agent's own tasks take its place, each pointing back at the note it answers. + +**A menu on every picture and video.** Right-click any picture or video in the app: Show in Finder, Share…, Export… or Copy. Copy works the way Finder's Copy does, and Share opens macOS's share menu. + +**Replies reach the agent in your terminal.** When a Claude Code session is working on a project in its terminal, a message you send from the feed goes to that session instead of starting a copy of it. Two agents no longer edit the same project at once. The message reads "Sent", then "Read" once the session has it, and the answer comes back in its own bubble. + +**For builders.** +- The raea skill teaches three.js and React Three Fiber. An R3F scene goes in ``, where useFrame, refs and drei work, and a plain three.js page goes in ``. The skill's 3d/r3f.md lists what draws and what doesn't yet. +- A plain three.js program runs as it is. `` runs a single-file demo, and the demo's own `new THREE.WebGLRenderer()` (or three/webgpu's renderer) is raea's, with no raea import. Frames are stepped and seeded, so a frame comes out the same played or rendered alone. Against three.js in Chrome it scores SSIM 0.9921. +- Three.js scenes run faster on raea's GPU. An InstancedMesh's moving copies are drawn as one set, each copy's colour included: 2,000 moving copies take 25.5 ms a frame (0.1.4: 94 ms) and 20,000 take 41.9 ms (0.1.4: 1,220 ms). +- Three's TSL node materials are lit by the scene's lights, and TSL compute and storage buffers run in the engine, so a particle system written for three/webgpu runs as it is. Against three.js itself, a lit TSL material scores SSIM 0.9906 and TSL particles 0.9799. +- Render targets an app draws itself, like a useFBO or GPUComputationRenderer's ping-pong, are drawn on raea's GPU and read back by the materials that use them. Both score above 0.99 SSIM against three.js (in-fbo 0.9941, in-pingpong 0.9949), and drei's MeshReflectorMaterial reflects on raea's GPU (0.9256). +- Materials patched through onBeforeCompile draw. drei's MeshWobbleMaterial, MeshDistortMaterial and MeshReflectorMaterial, and an app's own vertex displacement, run three's own program with the patch applied, lit by raea: SSIM 0.9717 against three.js. +- three/webgpu's PostProcessing is drawn as raea's own effects: bloom, GTAO, depth of field, FXAA, SMAA and TRAA, pixelation, film, dot screen, RGB shift, chromatic aberration, LUT, sepia and bleach, with the output's tone mapping and exposure. Against three.js, a bloom chain scores SSIM 0.9737, and sepia with chromatic aberration 0.9233. raea's own `` gains `additive`: three's glow added on top, in place of Bevy's energy-conserving mix. +- A three.js ShaderMaterial under a postprocessing composer matches three's colour. raea drew it darker and more saturated, outside the composer's tone mapping: a test ball's mean colour went from 133,66,33 to 186,135,96, against three's 194,145,110 (SSIM 0.9758 to 0.9848). A composer that raea draws as its own effects no longer draws the scene again either: one bloom added 17 hidden GPU passes, and now adds none. +- An ``, or raea's own camera, in a box smaller than the page is framed by its own box, as R3F's `` is in a browser. 0.1.4 drew the page's view cropped to the box (#130). A plane meant to be 80 px in its box now measures 80 px at 600x600 (0.1.4: 120 px) and at 1080x1920 (0.1.4: missing). The new `` gives R3F its size, and an orthographic camera the box's. +- In a live play, an `` gets R3F's pointer events (onClick, onPointerOver and Out, Move, Down, Up, onWheel and onPointerMissed), and drei's `` turn and zoom the camera. They're read from the play's input frame by frame, so `raea render --input` with the play's log draws the same frames. An `` in a box takes the pointer in its own box when it's given `width` and `height`. +- An edit that uses React Three Fiber now plays live. 0.1.4 couldn't play one at all, and an exported game that uses it plays too. +- A render no longer waits forever on a frame that never arrives. If one of its runtimes drops a frame, the render asks for it again and says so. If the frame still never comes, the render fails with an error that names the frame and says what the runtime was doing. Thanks @Ragulsundaram (#158). + +**Known** +- Google Drive goes in by the files you pick (up to 200 at a time; a picked folder isn't opened, so pick the files in it) or through Google Drive for desktop's folder. Reading a whole Drive without picking isn't built. +- Online-only files in the folders that Google Drive for desktop, Dropbox, OneDrive and Box keep on your Mac are left out and counted. +- Searching the Index from raea.io or the iPad isn't built yet: on Pro and Team it's searched from your Macs. +- The Index's fast pass runs on a Mac. On Windows and Linux, `raea index add` lists a folder and stops there. +- What you say a library is for stays on this Mac for now: a teammate's agents don't read it yet. +- R3F's pointer input has no double click yet, and touches don't arrive as pointers. +- A game whose timeline is baked for the player can't have an `` in that timeline. +- postprocessing's Outline, TextureEffect, DepthEffect and LUT1D, and TSL's OutlineNode, are skipped, with one warning that names them. +- A scene's background under an EffectComposer's or PostProcessing's tone mapping is shown as given, where three tone-maps it. +- Drawn characters (the Character SDK) moved to 0.1.6. +- The Windows app is unsigned, as before: Windows asks once whether to run it. +- A proxy set by an automatic configuration (PAC) file isn't read. If yours uses one, start raea with `HTTPS_PROXY` set. diff --git a/docs/manual/whats-new/0.1.6.md b/docs/manual/whats-new/0.1.6.md new file mode 100644 index 00000000..98d5f2f3 --- /dev/null +++ b/docs/manual/whats-new/0.1.6.md @@ -0,0 +1,98 @@ +--- +title: "raea 0.1.6" +version: "0.1.6" +date: "2026-11-16" +summary: "The app you work in every day, lighter and quicker: its memory held through a long day, a window that rests, Claude and voice set up on a new Mac, notes that reach a working agent, and smooth timeline playback." +sources: ["https://github.com/shinyobjectz/raea/releases/tag/v0.1.6"] +--- + +raea 0.1.6 makes the app you work in every day lighter and quicker. Its window now holds its memory through a long day, and drafts finish sooner. Claude and voice now work on a new Mac without setting anything up. A note you send while your agent works goes into the turn it's on, and the command it's running keeps going. Films play smoothly in the timeline and stop at their end. Long chats open in a moment, with their older messages folded by when you had them. Export is one window, each project has a Review tab, and every comment you leave reaches the agent. + +**Get the app at [raea.io](https://raea.io)** (a Mac with Apple silicon, Windows 10 or 11, or Linux on x86_64). + +The engine alone: + +```sh +curl -fsSL https://raea.io/install | sh +``` + +On Windows, in PowerShell: `irm https://raea.io/install.ps1 | iex`. + +## What changed since 0.1.5 + +**The window holds its memory.** The app's JavaScript kept the memory it had finished with, so an hour's work grew it from 272 MB to 448 MB while what it actually held stayed near 60 MB. It now gives that memory back every few seconds and stays near 166 MB. + +**The window rests.** With nothing changing on screen, raea's window now waits for you instead of drawing the same picture 60 times a second, and it wakes on the next key, click, answer or timer. Each frame's small steps now run on one thread instead of waking a pool of workers for each: 34% less CPU at rest, 8% less in a drag, 4% less playing a film, with frames as quick as before. To go back to the old way, put `RAEA_ST=0` or `RAEA_IDLE_GATE=0` in `~/.raea/env`. + +**Drafts finish sooner.** A draft render in the app no longer runs the clipping check after its last frame, which took about a fifth of a second on a 3D draft. Renders your agents make keep the check. + +**Claude and voice work on a new Mac.** In 0.1.5, picking Claude did nothing unless Claude Code was already installed, and voice never downloaded what it needs. Now raea installs Claude Code, or Kimi Code, with its maker's own installer when it isn't there, and shows the download in onboarding's bar. The first press of the mic sets voice up, parakeet-mlx and then its 2.3 GB model, showing in the composer what it's getting and how far along it is. + +**Slash commands work.** `/goal` typed as a new chat's first line now sets the goal, where it used to go to the agent as words. The agent's own commands and skills, like `/compact`, run as commands instead of being answered as text. The box names a command once you've written it, and says when a /word isn't one of the agent's. In the chat a command is a line of its own, Running… then Ran. / and @ open their search anywhere a word starts with them, not only at the start of the box. + +**Your agent keeps its project while you're elsewhere.** An agent working in one workspace while you had another open, or another chat, could lose its project: a card it posted wasn't kept and its plan tools said it had none. Now its cards, plan and items stay in its own project whichever workspace is open. + +**Agents finish what they plan.** A task can't be marked done with a box unticked or a subtask open: the plan tools refuse it and name what's open, and closing with everything ticks and closes it all. Each time an agent stops with tasks of its own still open, raea asks it to settle them. + +**You can see where a message is.** A message sent while the agent works shows in the thread at once as waiting, with Send now and Take back (its words back in the box); the latest says Sending… then Delivered. A note sent from an item shows in the chat beside the feed, which switches to the chat it went to. + +**Films play smoothly in the timeline.** The playhead moves with every frame instead of four times a second. An edited film plays across a split without stopping to seek, and never shows a frame a cut removed. A film under the timeline stops on its last frame instead of looping back to the start. A seek while it plays shows nothing from where it was, and a film played again from its end starts at its start. + +**Notes reach your agent while it works.** Send a message, or a note from a chat's pictures, while the agent is busy and it goes into the turn the agent is on, between its steps. A command it's running keeps going; nothing is stopped or killed to make room. Each note is its own message in the thread. An agent that can't take a message mid-turn gets everything that waited as one message when its turn ends. The composer's button sends whenever there's something in the box, and is Stop only when the box is empty, so a press meant to send never stops the agent. + +**Every comment reaches the agent.** Nothing you write on an agent's work is left behind as a note it never sees: it waits for that agent and goes with your next send. Edit now edits a comment's words, and Send sends one on its own. Esc closes an open comment before it leaves Comment, and scrolling inside a comment scrolls the comment instead of zooming the picture under it. A post of plain words has Copy. + +**What's running is what's running.** The line over the composer counted every shell a chat had ever left in the background, so it could say 39 running when nothing was. It now goes by the agent's own word: a shell, a monitor or a subagent shows while it runs and goes when it ends, and nothing left from before the agent restarted, or before the app reopened, counts. + +**Renders show how far they've got.** While something renders in a chat's project, a meter over the composer fills as its frames finish. + +**Move a chat to another project.** Drag a chat from the header, or from its list of sessions, onto a project in the rail, or pick Move to in its menu. It carries on there, its agent working in the new project's folder. Archiving a chat whose agent is still at work now asks whether to stop it too; Stop and archive ends its turn and everything it left running. + +**Long chats open fast.** raea reads a chat's history from its end, a stretch at a time, and leaves pictures and long tool output on your Mac instead of in the window. The longest chat on our test Mac, 264 MB on disk, now opens with 3.4 MB in under a fifth of a second. Your last six messages are open. Older ones fold into sittings, a new one after an hour's pause, on a new day or every eight of your messages, each one row saying when it began, how many messages it holds and how you opened it. Click one to open it and everything after it; scroll to the top and the stretch before comes in, keeping your place. + +**Export, in one window.** Export in an item's header opens one window: Save as…, Download (straight into Downloads), Show in Finder, and a tile for each network saying whether the film fits its shape and length. Export again makes a smaller copy of any film, or another shape or quality of one made from a composition; copies sit beside the film. Stills, sounds and models have Download, or Download all when there are several. + +**A Review tab in every project.** Where Controllers was, Review lists the project's review links (views, notes, approval) and its work to share, newest version of each piece, with the ones tagged final first. Pick pieces and raea makes one link and copies it. Agents can mark a piece final when they post it. Controllers are still there, under Source. + +**Getting around.** +- With more than one chat in a project, up to three sit in the header. Pin a chat to keep it there. A project inside this one with an agent working shows its mark with a light; the parent project is one press away. +- The rail opens wide from its foot, with every name beside its mark, and stays that way. +- A project with projects inside it lists their tasks in its Tasks, each under its project's name, and their files, compositions and components in its Source. +- A project can open chat first or feed first. Feed first gives the work the window and puts the chat in the right panel (⌘\ shows and hides it). Set it in Edit project or the project's menu. + +**Fingerprint › Rules.** A Rules tab lists every "A standing rule?" question raea asked that you haven't answered, and the rules an agent added, each with why; keep or drop each in a click. Your own rules, each workspace's house rules and each project's own are a tree, and each rule says when it applies, what checks it and how the fingerprint learns it. Write a rule of your own, or turn a note raea is watching into one. Agents read, add and check rules, and a fingerprint score in a chat is a line of its own instead of being folded into "Used raea". + +**Fewer controls on every view.** Every view's controls were gone through again, and repeats cut. A film has one ⋯ menu, its time without the total, Share as an icon and Compare in the version menu. The film editor loses its Select arrow and the made-up "Scene N" tags on clips. The composition editor's bar goes from 15 controls to 8. + +**Agents can report a bug in raea.** `raea bug TITLE --text TEXT` sends a report to raea, from a terminal or from the app's agents (bug_report). It sends words only, with paths, emails and anything shaped like a key taken out first, and needs no account. `--dry-run` prints exactly what would go. + +**Fixed.** +- An item whose details named something the app didn't expect could leave the whole window black on opening. +- A first launch could make its workspace twice at once. +- A project you renamed went back to its old name when the app started again. +- In raea's window, the volume popover shut as the pointer moved into it. +- A picture attached to a note, and a library's posters on Publish, drew as empty boxes in raea's window. +- A panel opened after something was posted into it while it was closed showed an empty row. +- On the Mac, a window manager such as AeroSpace couldn't see a raea app's window. + +**For builders.** +- `` draws a whole app on a surface in your 3D scene, on a page of its own: click and type into it through the 3D in a live play. A play's log keeps what reached it, so `raea render --input` draws what was played, and an exported game takes its app screens along. +- A batch of stills renders each frame at its own time. Since 0.1.1, every still in a batch sampled `globals.time` 0 and drew the first frame's `` uniforms. +- `raea render --aov` and `RAEA_PASS` work with MSAA on; they failed after two frames. +- An `` scene lit by `PMREMGenerator.fromScene(new RoomEnvironment())` is lit by that room, and an object scaled to 0 draws nothing, as in three. +- raea's window: a scroll offset a page writes reads back as written, `getComputedStyle` reads colours and custom properties, and a page's own `/host/*` images and fonts load. +- The R3F guide says when to set three's ambient light to 0 by hand: raea's own ambient lights a scene's specular as well, so a scene ported as-is comes out washed. +- The sound guides teach composing music for the cut, never a default bed, with every vetted source and its licence one page away. + +**Known** +- A seek while a film plays in the timeline can show one frame from before the seek (about 33 ms) before it jumps. +- Timeline playback still passes over frames on a heavily loaded Mac, and a cut still waits for its seek's decode. +- A long 4K `raea render` can still hang before its first frame (#158). +- On a laptop with both AMD and NVIDIA graphics, the Windows app can crash at launch; set `WGPU_BACKEND=dx12` (#155). +- Characters (the Character SDK: bodies, faces, hair, sewn clothes, hands) moved to 0.1.7. +- R3F's pointer input has no double click yet, and touches don't arrive as pointers. +- In TSL compute, Points and Sprites don't read compute buffers, indirect dispatch isn't supported, a compute first dispatched after frame 0 doesn't run, and a texture or matrix uniform in a compute isn't supported. +- A render in layers for CapCut, Premiere and Resolve is planned (docs/layers.feature, from @wackyza), not built. +- postprocessing's Outline, TextureEffect, DepthEffect and LUT1D, and TSL's OutlineNode, are skipped, with one warning that names them. +- The Windows app is unsigned, as before: Windows asks once whether to run it. +- A proxy set by an automatic configuration (PAC) file isn't read. If yours uses one, start raea with `HTTPS_PROXY` set. diff --git a/docs/manual/whats-new/0.1.7.md b/docs/manual/whats-new/0.1.7.md new file mode 100644 index 00000000..927e38d5 --- /dev/null +++ b/docs/manual/whats-new/0.1.7.md @@ -0,0 +1,47 @@ +--- +title: "raea 0.1.7" +version: "0.1.7" +date: "2026-11-17" +summary: "The Windows release: workspaces that Git for Windows can open (and the ones 0.1.5 and 0.1.6 broke repaired), sign-ins and keys kept, and the app calling your PC a PC." +sources: ["https://github.com/shinyobjectz/raea/releases/tag/v0.1.7"] +--- + +raea 0.1.7 is the Windows release. On a Windows PC, 0.1.5 and 0.1.6 made workspaces that Git couldn't open and +couldn't keep a sign-in, so the app couldn't finish its first run. 0.1.7 fixes both, repairs the workspaces they +broke, and has the app speak to a PC as a PC. + +**Get the app at [raea.io](https://raea.io)** (a Mac with Apple silicon, Windows 10 or 11, or Linux on x86_64). + +The engine alone: + +```sh +curl -fsSL https://raea.io/install | sh +``` + +On Windows, in PowerShell: `irm https://raea.io/install.ps1 | iex`. + +## What changed since 0.1.6 + +**Workspaces work on Windows.** raea wrote Windows' long form of a path (`\\?\C:\...`) into a workspace's Git +settings. Git for Windows can't open that, so every Git command in the workspace failed, its projects couldn't be +read, and the app couldn't finish its first run (#169). Workspaces and projects are now made and read through +plain paths, everywhere raea names a folder: the stage, the bundler, export and live play. A workspace that 0.1.5 or +0.1.6 broke is repaired the next time raea opens it. + +**Sign-in and keys are kept on Windows.** The app kept every secret with the Mac's keychain tool, which Windows +doesn't have. Signing in failed on every Windows PC, and a pasted AI key or plugin key was lost. They're now kept on +Windows too, and a workspace that can't be made says why instead of leaving the window black. + +**Your PC is a PC.** On Windows the app says "this PC" and Ctrl where a Mac's says "this Mac" and ⌘: in onboarding, +setup, the Get Started guide and the app's errors. Words about the Mac's keychain show only on a Mac. + +**Signing in with another account.** raea.io's page for linking a computer says which account it links to, and +Use another account signs you out and brings you back to the same code, so you can link the computer to the +account you meant. + +**Known** +- Characters (the Character SDK) didn't make 0.1.7 either; they come in a later release. +- On a laptop with both AMD and NVIDIA graphics, the Windows app can crash at launch; set `WGPU_BACKEND=dx12` (#155). +- A long 4K `raea render` can still hang before its first frame (#158). +- The Windows app is unsigned, as before: Windows asks once whether to run it. +- A proxy set by an automatic configuration (PAC) file isn't read. If yours uses one, start raea with `HTTPS_PROXY` set. diff --git a/docs/manual/whats-new/0.1.8.md b/docs/manual/whats-new/0.1.8.md new file mode 100644 index 00000000..5664cf1f --- /dev/null +++ b/docs/manual/whats-new/0.1.8.md @@ -0,0 +1,106 @@ +--- +title: "raea 0.1.8" +version: "0.1.8" +date: "2026-11-18" +summary: "raea on Windows works: agents install and connect, phone and camera video plays, the local models set themselves up, and the installer asks where to go. Also your edit as layers for CapCut, Premiere and Resolve, labels on what agents show you, and a lighter app." +sources: ["https://github.com/shinyobjectz/raea/releases/tag/v0.1.8"] +--- + +raea 0.1.8 makes raea on Windows work the way it does on a Mac. Your AI agents install and connect, a phone's or a +camera's video plays, the local models set themselves up with nothing installed first, the app draws on every kind +of graphics card, and the installer asks where raea goes. It also exports your edit as layers for CapCut, Premiere +Pro and DaVinci Resolve, has agents label what they show you, and makes the app lighter and quicker. + +**Get the app at [raea.io](https://raea.io)** (a Mac with Apple silicon, Windows 10 or 11, or Linux on x86_64). + +The engine alone: + +```sh +curl -fsSL https://raea.io/install | sh +``` + +On Windows, in PowerShell: `irm https://raea.io/install.ps1 | iex`. + +## What changed since 0.1.7 + +**raea on Windows works.** +- ChatGPT, Claude, Gemini, OpenCode and Kimi install and connect on a Windows PC. A workspace is made even when Git + isn't installed. +- The app calls your PC a PC: Ctrl, not ⌘, everywhere, the whiteboard too. +- The installer asks where raea goes. It suggests a folder in your own profile, takes any empty folder you can + write to (or the folder raea is already in), and says why it won't use one that already holds other files. An update goes + where the last install went, and uninstalling removes raea's own files and nothing else. +- The app draws on every kind of graphics card. On a PC with Intel or AMD graphics, including a laptop with AMD + graphics beside an NVIDIA card, raea draws with DirectX 12. Before, the app could crash at launch on those + (#155) and on Intel's integrated graphics. 3D on DirectX 12 is now drawn as on a Mac; with `WGPU_BACKEND=dx12` + set by hand, 0.1.7 drew a scene's shapes into one another. +- A phone's or a camera's video plays, probes and checks. raea's own decoders read H.264 without B-frames, which is + what raea writes. The first time you open a video they can't read (most phone and camera footage: H.264 with + B-frames, HEVC, VP9), raea fetches FFmpeg once, about 114 MB, and checks it before use. Nothing needs installing + first. +- Agents' npm tools and MCP servers start without a shell, and their arguments arrive as written in folders with + spaces or letters outside ASCII. + +**Local models with nothing installed first.** Stable Audio Open's sound effects, matchmove (`raea track`), +Gaussian splats (`raea splat train`), liquids and TokenSynth's instruments set themselves up on a Mac, Windows or +Linux. You don't need Homebrew, Python, Git or FFmpeg. raea fetches its own uv the first time, checks it, and each +model brings its own Python. Off a Mac, Stable Audio Open runs on ONNX Runtime, on the GPU when there's an NVIDIA +card. A download that drops partway through picks up where it stopped, so a 2 GB install on a shaky connection +still finishes. + +**Your edit, as layers.** +- `raea export layers` writes each layer of a composition and a `layers.json`. +- A CapCut draft is made from that file, with the captions on their own track. +- `raea export xml` opens in Premiere Pro and DaVinci Resolve as raea drew it, with moving footage keyed. + +Thanks @wackyza, who specified this and built it (#166, #170, #171, #172). + +**Labels on what agents show you.** A contact sheet, a side-by-side or a scene comes with short tags beside the +picture, never on it. Hover one and a line draws to what it means; click it for the why. A feed card says how many +labels its item has. From the terminal: `raea show --label`, `--detail` and `--labels`, and `raea media sheet` +writes the sheet's labels beside it. + +**A lighter, quicker app.** +- A long feed of stills took raea's window past 2.5 GB; it now stays near 1.3 GB. Each picture is decoded at the + size it's drawn, cards far off screen let theirs go, and the window keeps one copy of what it shows. +- Scrolling the feed, opening an item and loading more stay within their frame budgets on Mac, Windows and Linux. + Cards redraw only when what they draw changes. +- The chat header shows one chat at a time, the one you're in, and dragging a chat out of it carries that chat. +- On the Mac, raea starts one window: never a second beside yours, and never from the update folder. A copy left in + the update folder opens the installed app. + +**3D that moves keeps moving.** In a live play, an animated material or a shader's time runs on past the first +frame, on Windows too. + +**Linux renders 3D again.** raea built from source on Linux stopped at a 3D render ("Failed to build event loop", +#182). Every engine raea makes now leaves the window to the app, under X or with no display at all. + +**For builders.** +- A composition says what a person might tune in `controls`: a number with its range, a switch, a choice, a + colour or some text, grouped and labelled. A part deep in the tree reads one with `useControl("name")`, and the + item's Controls tab moves them on the live picture. +- `@shared/` imports render. A composition that imports `@shared/components/NAME` from its workspace's `shared/` + folder renders from the terminal as it does in the app. +- `raea check` reads a video without FFmpeg. Where FFmpeg isn't installed, raea's own readers stand in, held to + FFmpeg's answers. +- `raea gen`: a fal step sends the resolution and aspect ratio its model takes, an image edit's mask reaches the + model, and a file changed in place counts as a new input. +- An agent's error says its own words, such as a used-up plan, instead of "Internal error". +- `WGPU_BACKEND` picks the graphics API raea draws with (`dx12`, `vulkan` or `gl`), when you need to override its + choice. +- The raea skill gains video-decompiler, James Dimachkie's skill for making a short product film as raea code + (MIT). + +**Known** +- On Windows with Intel or AMD graphics, DirectX 12 compiles 3D shaders more slowly, so a 3D render can take + about 15 seconds longer to start. +- TokenSynth installs on Windows but hasn't been run end to end there yet, and it runs on the CPU there. +- A seek while a film plays in the timeline can show one frame from before the seek (about 33 ms) before it jumps. +- A long 4K `raea render` can still hang before its first frame (#158). +- Characters (the Character SDK) come in a later release. +- R3F's pointer input has no double click yet, and touches don't arrive as pointers. +- postprocessing's Outline, TextureEffect, DepthEffect and LUT1D, and TSL's OutlineNode, are skipped, with one + warning that names them. +- The Windows app is unsigned, as before: Windows asks once whether to run it. +- A proxy set by an automatic configuration (PAC) file isn't read. If yours uses one, start raea with `HTTPS_PROXY` + set.