XTask: Turn screen recordings into assigned Asana tasks

XTask: Turn screen recordings into assigned Asana tasks
AI Automation

A desktop workflow that records a screen, extracts actionable tasks with timestamps, and sends them to the right Asana project and assignee.

December 23, 2024

Technologies:
ElectronReactPythongRPCWhisperGPT-4oAsana

XTask: Turn screen recordings into assigned Asana tasks

The workflow

XTask turns a screen recording into structured, assignable work. A user records a walkthrough, review, or bug report; the application transcribes the recording, identifies tasks, preserves useful timestamps, and prepares the results for Asana.

How it works

  • Electron and React provide the cross-platform recording experience.
  • FFmpeg extracts and prepares audio from the recording.
  • Whisper produces the transcript used for task extraction.
  • GPT-4o tool calls turn the transcript into structured tasks.
  • A Python gRPC service processes the stream and coordinates the Asana integration.

Engineering focus

The central challenge was processing useful information while recording was still in progress. Streaming the video to the gRPC service reduced the delay between finishing a recording and reviewing the extracted work.

Asana workspace, project, and member data are used to suggest a relevant destination and assignee. The user still has a clear review point before the tasks become part of the project workflow.

Result

XTask replaces the manual sequence of recording a walkthrough, rewatching it, writing tasks, copying context, and assigning each item. The same architecture can support other project-management and automation tools without changing the recording workflow.