Commit Graph
1106 Commits
Author SHA1 Message Date
ZacharyZhang-NY 66aae376c0 Let the CEO hand out connector toolkits agent by agent
Connections belong to the company - one Composio connected account per
toolkit, mirrored locally in connector_accounts - and access belongs to
individuals: a new agent_connector_grants table records which agent may use
which toolkit. Agent runs now load composio tools from the intersection of
active connections and that agent's grants, and tool execution re-checks the
grant server-side so an ungranted agent cannot call a connector tool it
heard about. Any agent can list_connectors to see what the company has
connected and who holds access; grant_connector/revoke_connector are
CEO-only. The Composio client speaks the v3 contract (user_id,
connected_account_id, toolkit catalog with cursor paging, managed auth
config creation, connect-link initiation). Covered by four grants contract
tests.
2026-07-06 23:13:03 -04:00
ZacharyZhang-NY 4775b23d94 Draw the sidebar with Reicon glyphs
Navigation icons now come from reicon-react (tree-shaken SVG components,
currentColor by default): Home, Briefcase, Users, ChatRoundDots, Send,
Folder, ShieldCheck, DocumentText2, Plug2, Buildings2, and Gear map to their
routes through one NavIcon component, so the glyph set lives in a single
place and NavSpec no longer carries per-item icon names.
2026-07-06 23:02:33 -04:00
ZacharyZhang-NY a11d2dfa07 Trim the sidebar to the surfaces that earn their place
Inbox, Knowledge, Meetings, and Sprints leave the navigation and their page
components go with them; the backend services and data they surfaced stay
intact for agents and automation. The secondary rail is now Documents,
Social, and Office.
2026-07-06 22:57:52 -04:00
ZacharyZhang-NY d528cd6f75 Turn the Messages rail into a real conversation list
Every channel and direct conversation is now its own row the way messengers
work: avatar or channel glyph, name, last-message preview, relative time,
and a true unread count from per-employee read state (the old badge showed
total message count). Rows sort by latest activity and the newest
conversation opens by default. Direct rows title themselves after the
counterpart resolved from memberships; agent-to-agent conversations the
board observes keep their two-name title, and opening one clears its unread
because read state is per-employee bookkeeping, not access control.
Conversation rows get their own .convo-item style instead of fighting the
sidebar's single-line nav-item rules.
2026-07-06 22:56:02 -04:00
ZacharyZhang-NY cab7b01831 Give every 1:1 its own direct conversation instead of piling into #general
Agents could only post to named public channels - the messaging tool even
excluded direct spaces - so assignments, reports, and questions all crowded
into general. Now ChatService.ensureDirectSpace finds or creates the private
two-member conversation for any agent/employee pair; send_message takes
to="Name" for 1:1 traffic (exactly one of to/channel), read_messages reads a
conversation by teammate name, and task assignments land in the manager's DM
with the assignee. In a direct conversation the counterpart agent wakes on
every message without needing an @mention - same social contract as any
messenger - still bounded by the autonomous-turn budget, and wake task
briefings tell agents to reply with to= in kind. Covered by six new
direct-message contract tests; the assignment-thread test now encodes the
DM routing contract.
2026-07-06 22:49:31 -04:00
ZacharyZhang-NY f13ef48a3e Stop the UI freeze: coalesce snapshot storms and bound chat rendering
Busy agents emitted a snapshot-changed broadcast per tool turn; every event
made the renderer reload the full snapshot while the main process re-read
whole audit tables synchronously, and ChatTimeline re-rendered every message
with per-row linear scans - quadratic work per keystroke of agent activity
until clicks stopped responding. Root fixes at each layer: all broadcasts
funnel through one 200ms-coalesced notifier (unit-tested), the renderer
reloads at most every 800ms with a trailing load, audit/access snapshot
reads use SQL limits instead of full-table scans, and the timeline renders
the latest 150 messages via O(n) lookup maps with a real show-earlier
control. cred.txt is now gitignored so the Composio key cannot leak.
2026-07-06 22:40:32 -04:00
ZacharyZhang-NY 538bf20057 Prove the populated floor end-to-end
The office e2e now also hires two agents through the real Team flow,
returns to the floor, clicks the first open desk through the same pure
floor-plan and camera math the app renders with, and asserts the right
agent's card opens - then captures a populated-floor screenshot for visual
review. Nav locators use exact accessible names so 'Chief Executive
Officer' cards cannot shadow the Office nav button.
2026-07-06 22:05:48 -04:00
ZacharyZhang-NY 574c7e0ec6 Bring the floor to life: coffee runs, snack breaks, restroom trips
Idle agents now live a little: after settling in they occasionally walk the
lane graph to the coffee machine, snack counter, or a restroom stall, dwell
there, and stroll back - carrying their coffee or snack to the desk for a
while. Working agents never leave, and an agent woken to work mid-break
abandons the trip and heads straight home. Randomness is injected so the
whole loop - trip, dwell, carry-back, interruption - is deterministic under
unit test, and a settle period keeps the floor calm right after it loads.
2026-07-06 22:02:35 -04:00
ZacharyZhang-NY e8c8414613 Open an agent profile card by clicking them on the floor
Canvas clicks hit-test against the exact positions the renderer draws -
frontmost person wins - and select the agent: a floating card in the app's
design language shows their name, title, department, level, live status, and
current task, with a selection ring under their feet. Escape, the close
button, or clicking empty floor dismisses it; hovering a person shows a
pointer cursor. The floor now seats only lifecycle-active agents, matching
how the backend wakes and assigns work. Covered by a hit-test unit test and
a dedicated office e2e that clicks the CEO through the real floor-plan math.
2026-07-06 21:58:35 -04:00
ZacharyZhang-NY 8e0716021f Let real local time paint the world outside the windows
Office windows now render a living sky: night with stars, a moon, and lit
city windows; a warm sunrise; blue daylight with the sun arcing across; and
an orange sunset - all interpolated smoothly along a palette timeline driven
by the actual clock, over a per-window deterministic skyline. Phase mapping,
sun/moon handover, star intensity, and palette blending are unit-tested.
2026-07-06 21:51:43 -04:00
ZacharyZhang-NY d92e1e8b17 Walk the office as the board member with WASD
The signed-in employee now appears automatically at the office entrance in a
blazer with an accent name chip, and moves with WASD or arrow keys: per-axis
wall sliding against the floor-plan colliders, normalized diagonal speed,
facing-aware walk animation, and a camera that follows and clamps to the
world so large teams scroll into view instead of being cut off. Key input
ignores typing targets and releases on window blur. Movement, collision,
spawn stability, and camera clamping are unit-tested.
2026-07-06 21:48:13 -04:00
ZacharyZhang-NY e6532713b5 Give every agent a distinct procedural pixel identity
Replace the single cloned character with identity-derived sprites: skin
tone, hair style and color, outfit (tee/hoodie/blazer), shirt palette, and
glasses all hash off the agent id, drawn with facing-aware variants, a walk
cycle, and carried-item support for later behaviors. The CEO always wears
the blazer. Appearance determinism and population variety are unit-tested.
2026-07-06 21:44:04 -04:00
ZacharyZhang-NY cab4e4ba33 Rebuild the pixel office as a real floor plan with rooms and lanes
Replace the viewport-derived desk grid with a fixed-world office: a north
band of rooms (CEO office, meeting room, snack bar, restroom) with door
signage opening onto a corridor, and an open desk field that grows by rows
so any head-count fits the world instead of being cut off. Geometry lives in
a pure floor-plan module that also builds an axis-aligned lane graph with
BFS routing, unit-tested for reachability and collision invariants. A camera
transform centers or clamps the view, the first c_suite agent takes the CEO
office, name labels render the full name, and the mock TODO-board text is
gone. Office screenshots join the visual-review capture set.
2026-07-06 21:39:16 -04:00
ZacharyZhang-NY f61046b7a4 Restore thread panel wiring lost in the flat-timeline refactor
The flat-messages refactor left ChatThreadPanel orphaned: ChatPage passed a
no-op onOpenThread and ChatTimeline hardcoded onOpenThread={null}, so threads
(including /escalate board flows) were unreachable from the UI and the
desktop e2e failed on main. Reconnect open/close/reply/board-intervention
wiring around the flat timeline, show reply counts on thread roots, and
clear the lint debt that severed feature left behind.
2026-07-06 21:39:03 -04:00
ZacharyZhang-NY 06fa8fc07f update 2026-07-06 21:07:02 -04:00
ZacharyZhang-NY eb22b597e5 Merge branch 'main' of https://github.com/ZacharyZhang-NY/AgentCompany 2026-07-01 19:38:15 -04:00
ZacharyZhang-NY 93516ca28b update 2026-07-01 11:56:51 -04:00
ZacharyZhang-NY 8b2f94a715 Show all messages flat in channel and fix V8 OOM crash
Chat: removed all thread abstraction. Every message in a channel now
renders inline chronologically as a flat list — no compact rows, no
thread panel, no thread navigation. Just messages, like Slack.

OOM fix: snapshot now limits fast-growing tables (chat_messages: 500,
task_runs: 200, provider_requests: 100) instead of loading unbounded
rows. This prevents the renderer V8 heap from growing past 3.5GB and
crashing. The notifyDataChanged callback is also wrapped in try/catch
to prevent errors when the renderer frame is disposed during agent runs.
2026-06-30 22:56:58 -04:00
ZacharyZhang-NY 016ae25901 Open threads in-place in center pane and fix office crash
Chat: clicking a thread row now replaces the center pane content with
the thread's full messages (back button to return to thread list).
Removed the right-side thread panel entirely — threads navigate in
place like Slack, not as a side panel overlay.

Office: reduced frame rate to 24fps, skip rendering when canvas has
zero dimensions, schedule next frame AFTER draw (not before) to
prevent runaway frame buildup that caused the white screen crash.
2026-06-30 22:49:41 -04:00
ZacharyZhang-NY 82e28111e9 Fix office layout, performance, and crash issues
Layout: agents now arrange in a horizontal grid (3-4 per row based on
viewport width) instead of stacking vertically. Position calculation
uses layoutPositions() which guarantees agents stay within the canvas.

Performance: render loop throttled to 30fps instead of uncapped 60fps.
Removed Math.random() from render path — building window lights now use
a deterministic hash that changes slowly. Canvas dimensions only resize
when clientWidth/clientHeight actually change.

Crash fix: clearRect at frame start prevents accumulated draw state.
setTransform instead of scale prevents compounding transforms. Animation
cleanup properly cancels requestAnimationFrame on unmount.
2026-06-30 22:45:16 -04:00
ZacharyZhang-NY 2447bfba9c Rebuild office with rich pixel-art rendering inspired by claude-office
Characters now have round heads, headphones, eyes, shirts, pants, and
shoes — proper pixel-art people like claude-office. Desks are detailed
wooden tables with monitors showing task text, keyboards, and coffee
cups. The wall has a city skyline window, analog clock, whiteboard with
TODO items, and an employee-of-the-month painting. Active agents bob
and show speech bubbles with their current task. Floor has tile grid.
2026-06-30 22:34:58 -04:00
ZacharyZhang-NY f60ef60da1 Replace office sidebar with full-page canvas-rendered office
The virtual office is now a dedicated page (nav: Office) with an HTML5
Canvas rendering animated pixel-art characters. Each agent is drawn as
a pixel person with deterministic skin/shirt colors, walking legs, and
a bobbing head when active. Idle agents wander randomly near their desk.
Active agents show a green dot, thinking agents show a question mark.
Departments are labeled zones with desks and monitors. Removed the old
sidebar component entirely.
2026-06-30 22:30:00 -04:00
ZacharyZhang-NY 7a85f73dbb Show threads as compact rows instead of inline full messages
The channel timeline now renders each thread as a single compact row
with sender avatar, message preview (truncated to one line), reply
count with participant avatars, and last reply time. Clicking a row
opens the thread in the right panel where the full conversation lives.
This matches Slack's thread-list pattern instead of dumping every
message body into the channel view.
2026-06-30 22:27:11 -04:00
ZacharyZhang-NY e37faf1a2e Rewrite virtual office with pixel-art characters and compact layout
Replaced generic bot icons with CSS pixel-art people — colored head,
shirt body, and legs, each agent with a stable color derived from their
name. Layout is now compact flex-wrap (42px per agent) instead of one
agent per row. Sidebar narrowed to 172px. Tooltip anchored to right
edge to prevent clipping. Department floors use the app's panel-2
background for a clean integrated look.
2026-06-30 22:20:24 -04:00
ZacharyZhang-NY 7ff8e4becd Update migration version expectation for migrations 043-044 2026-06-30 22:09:57 -04:00
ZacharyZhang-NY 63c760860e Tell agents about available external tools in system prompt
When Composio tools are loaded for an agent run, the system prompt now
mentions their count and purpose so the agent knows it can interact
with external services like GitHub, Slack, and Gmail.
2026-06-30 22:00:56 -04:00
ZacharyZhang-NY 81aae82211 Add resilient error handling for Composio tool execution
Tool execution now returns actionable error messages when a connected
account is missing, directing the admin to set up the connection. Tool
loading is resilient to API failures, falling back to cached tools if
available instead of crashing the agent run.
2026-06-30 21:59:39 -04:00
ZacharyZhang-NY e83f379143 Cache Composio tools and load saved settings in the UI
Tools are now cached per-org with a 5-minute TTL to avoid hitting the
Composio API on every agent run. The ComposioPanel loads the currently
saved API key status and pre-checks enabled toolkits from the snapshot,
so users see their existing configuration when opening Settings > Tools.
2026-06-30 21:58:48 -04:00
ZacharyZhang-NY 3d685e5a4b Add e2e and integration tests for new features
E2e test updated to verify: virtual office sidebar toggle, Composio
Tools settings tab visibility, and @mention with canonical handles.
New integration test verifies that a human reply in a thread wakes
agent participants without requiring explicit @mentions.
2026-06-30 21:55:24 -04:00
ZacharyZhang-NY 7d9995f62c Polish virtual office with building floors and animated workstations
Inspired by claude-office's multi-floor building metaphor but rendered
as a polished UI instead of pixel art. Departments appear as numbered
floors in a building frame. Each workstation has a monitor with animated
screen glow for active agents, a stand, and a status dot. The building
header shows the active/total agent ratio at a glance.
2026-06-30 21:54:05 -04:00
ZacharyZhang-NY bb24a444f4 Wake thread participants when a human replies without @mentions
When a human or board member posts in a thread where agents have
previously participated, those agents are now woken even without
explicit @mentions. This matches the old version's behavior where
any message in a conversation could wake the recipient, enabling
natural back-and-forth between humans and agents.
2026-06-30 21:51:32 -04:00
ZacharyZhang-NY 651e7a69ec Fix Composio API endpoints to match verified v3 contract
Updated getTools to use the validated toolkit_slug parameter and
per-toolkit fetching. Updated executeTool to use the verified path
POST /api/v3/tools/execute/{TOOL_NAME} with entityId and arguments
fields. Updated normalizeToolSchema to use slug and input_parameters
from the actual API response format.
2026-06-30 21:50:35 -04:00
ZacharyZhang-NY 13a235a42d Seed Composio API key and default toolkits for all organizations
New orgs get the Composio API key and default toolkits (github, gmail,
slack, notion, linear, google_calendar) during bootstrap. Existing orgs
without Composio settings are seeded at app startup via the recovery
pass, ensuring every org has external tool access from first boot.
2026-06-30 21:47:00 -04:00
ZacharyZhang-NY 26db40282b Add unit tests for @mention resolution and read_messages tool
Tests verify: canonical handle generation for multi-word names, mention
resolution via canonical handles, read_messages from channel, and
read_messages inbox (agent @mentions across channels).
2026-06-30 21:44:45 -04:00
ZacharyZhang-NY 3a3c5b7ca3 Redesign virtual office with desk workstations and spatial layout
Each agent sits at a workstation with a monitor, status-colored glow for
active agents, and a rich tooltip showing name, role, and current task.
Departments render as labeled rooms with subtle borders. The monitor
lights up when the agent has a running task run, giving a real sense of
who is working and who is idle.
2026-06-30 21:42:50 -04:00
ZacharyZhang-NY 453e47274a Inject inbox context into non-chat task runs
Heartbeat and manual task runs now load the agent's recent @mentions and
include them directly in the task prompt. This gives agents conversational
context even before they call read_messages, ensuring they respond to
teammates who addressed them rather than silently ignoring messages.
2026-06-30 21:41:28 -04:00
ZacharyZhang-NY 59e3b6bf51 Add Composio settings panel for external tool configuration
Settings > Tools tab lets the user enter their Composio API key and
select which toolkits (GitHub, Slack, Gmail, etc.) to enable for agents.
The configuration is saved per-org and loaded at agent run time.
2026-06-30 21:39:56 -04:00
ZacharyZhang-NY 77644121db Record @mention wake failures instead of silently swallowing them
The catch block in wakeAgentMentions now records wake_state on each
mention (woken/failed) instead of silently discarding the error. Failed
mentions render with a strikethrough and muted color so the user sees
which agents could not be reached, with a tooltip on hover. Migration
044 adds the wake_state column to chat_mentions.
2026-06-30 21:38:19 -04:00
ZacharyZhang-NY f6a2659761 Extract read_messages tool to keep agent-tools under 500 lines 2026-06-30 21:35:11 -04:00
ZacharyZhang-NY 07fa105bf3 Add virtual office sidebar showing real-time agent status
A collapsible right sidebar renders agent presence as a visual office
floor plan grouped by department. Each agent shows at their desk with a
status ring (active/thinking/busy/idle) and a tooltip revealing their
current task on hover. Toggle via the Office button in the left nav.
2026-06-30 21:33:42 -04:00
ZacharyZhang-NY 77f191fa25 Integrate Composio for external tool access
Agents can now call external tools (GitHub, Slack, Gmail, etc.) via
Composio's managed API. A thin HTTP client calls the Composio REST API
directly — no heavy SDK dependency. External tools are loaded per-org
from composio_settings and merged with internal tools at run time. The
agent run loop routes composio_* tool calls to the Composio execution
endpoint while internal tools dispatch as before.

Includes: migration 043 for composio_settings table, IPC handler for
saving Composio API key and toolkit configuration, and the composio
client/bridge modules.
2026-06-30 21:31:04 -04:00
ZacharyZhang-NY 65c5bec9a3 Add read_messages tool and conversational task prompts
Agents now have a read_messages tool to check their inbox and channel
history during runs, enabling them to catch up on conversation before
acting. Task prompts are rewritten to encourage checking messages first
and discussing work with teammates rather than posting status updates.
2026-06-30 21:21:21 -04:00
ZacharyZhang-NY 5bb9aea4f9 Fix @mention resolution for multi-word agent names
MentionTextarea inserted raw agent names (e.g. @Sarah Chen) but the
backend regex captured only the first word (@Sarah), causing mention
resolution to fail silently. Moved canonicalMentionHandle to shared/
so the renderer can produce space-free handles that the backend resolves
correctly.
2026-06-30 21:17:43 -04:00
ZacharyZhang-NY dfa2df3334 Remove visible input placeholders 2026-06-26 19:44:02 -04:00
ZacharyZhang-NY 8923a2bf0a Clarify agent mention reply readiness 2026-06-26 19:41:56 -04:00
ZacharyZhang-NY 91991f7c4a Restrict external browser URLs 2026-06-26 19:37:11 -04:00
ZacharyZhang-NY d148146b91 Split snapshot domain types 2026-06-26 19:34:52 -04:00
ZacharyZhang-NY d85a47c40c Harden custom provider endpoint validation 2026-06-26 19:31:32 -04:00
ZacharyZhang-NY 745c22ec77 Fix agent assignment conversations 2026-06-26 19:27:28 -04:00
ZacharyZhang-NY bd63d42aa7 Extract slash-command routing out of ChatService
ChatService was 542 lines, mixing message delivery with the dispatch of
nine slash commands. Move the command cluster — /board, /approve, /deny,
/agent, /skill, /file, /runbook, /handoff, /escalate — into a
ChatSlashRouter that owns the approval and board-intervention services it
needs. ChatService keeps message delivery and delegates two calls.
Behaviour identical: chat-service 376 lines, router 196, full suite and
e2e green; the slash-routing governance test exercises every branch.
2026-06-26 18:25:14 -04:00