Open computers from the chat, let bots ask for a take-over, show task progress

- Serve each computer to its owner under /computers/<id>/ (HTTP and
  websockets proxied to the AIO sandbox) and show it in a shared
  ComputerView with browser, terminal and code modes, opened from the
  computers modal or a take-over button in the thread.
- ask_user_to_take_over lets a bot hand a computer to the user for a
  login or captcha; the message gets a take-over button and needs-you,
  and the viewer hands it back with a chat message.
- While a task runs the thread shows "<bot> is working..." with the
  task's latest step; steps read as plain words, not tool names.
- A coordinator with no workers no longer claims to delegate, and bots
  describe started tasks in the first person.

Co-Authored-By: Claude Opus 5.5 <[email protected]>

src/bots-queue/run-bot-task.ts

@@ -4,9 +4,11 @@ import grabBotPrompt from "@/src/functions/backend/db/bots/grab-bot-prompt";
 import runTextLoop from "@/src/harness/text/run-text-loop";
 import openComputerTools from "@/src/harness/tools/computer/open-computer-tools";
 import grabBotTools from "@/src/harness/tools/bot/grab-bot-tools";
+import askToTakeOverTool from "@/src/harness/tools/computer/ask-to-take-over-tool";
 import searchComputersTool from "@/src/harness/tools/computer/search-computers-tool";
 import computerRef from "@/src/utils/computer-ref";
 import composeJobBrief from "./compose-job-brief";
+import withTakeOverRefs from "./with-take-over-refs";
 import type { BotJobContext, BotJobOutcome } from "./types";
 
 type Params = BotJobContext & {
@@ -17,6 +19,8 @@ type Params = BotJobContext & {
  * Works through a task: the bot follows its brief with its full prompt,
  * its own tools, search_computers across all its computers and, when the
  * job has a computer, that computer's tools (over MCP), until it answers. That answer is the report for the user.
+ * When only the user can go on (a login, a captcha), the bot asks them to
+ * take over (`ask_user_to_take_over`) and the report needs them.
  * Every model turn is reported as a step (`report`).
  */
 export default async function runBotTask({
@@ -33,13 +37,22 @@ export default async function runBotTask({
     try {
         const prompt = await grabBotPrompt({ bot_id: bot.id, user_id: bot.user_id });
         const computers = await grabBotComputers({ bot_id: bot.id, user_id: bot.user_id });
+        const take_overs: string[] = [];
+
+        /**
+         * A take-over defaults to the computer the task runs on.
+         */
+        const take_over_computers = [
+            ...computers.filter((c) => c.id == job.computer_id),
+            ...computers.filter((c) => c.id != job.computer_id),
+        ];
 
         const result = await runTextLoop({
             system: [
                 prompt,
                 TaskRunNote,
                 computer
-                    ? `You're working on the computer "${computer.name}" (a Linux sandbox with a shell, files, code runners and a browser). Use its tools; don't ask the user to run anything.`
+                    ? `You're working on the computer "${computer.name}" (a Linux sandbox with a shell, files, code runners and a browser). Use its tools; don't ask the user to run anything. When only the user can go on (a login, a captcha, a code sent to them), ask them to take over with ask_user_to_take_over.`
                     : `You have no computer for this task.`,
                 computers.length > 1
                     ? `search_computers runs a read-only command on every computer you have. When you name one in the report, write its ref, e.g. ${computerRef({ id: computers[0]!.id || 0 })}: the user can click it to switch you to that computer.`
@@ -64,7 +77,16 @@ export default async function runBotTask({
             ],
             tools: [
                 ...grabBotTools({ user_id: bot.user_id, bot_id: bot.id }),
-                ...(computers.length ? [searchComputersTool({ bot_id: bot.id, computers })] : []),
+                ...(computers.length
+                    ? [
+                          searchComputersTool({ bot_id: bot.id, computers }),
+                          askToTakeOverTool({
+                              computers: take_over_computers,
+                              in_task: true,
+                              onAsk: ({ ref }) => take_overs.push(ref),
+                          }),
+                      ]
+                    : []),
                 ...(computer?.tools || []),
             ],
             bot_id: bot.id,
@@ -73,7 +95,10 @@ export default async function runBotTask({
                 report({ ...step, text: step.text && computer ? computer.redact(step.text) : step.text }),
         });
 
-        return { result: computer ? computer.redact(result.text) : result.text };
+        return withTakeOverRefs({
+            text: computer ? computer.redact(result.text) : result.text,
+            refs: take_overs,
+        });
     } finally {
         await computer?.close();
     }