Tellen Logo
Header image for Demo: Claude's Computer Use Shows Promise for Auditors
General
3 min read

Demo: Claude's Computer Use Shows Promise for Auditors

November 29, 2024

I just created a demo of Claude Computer Use for auditors.

I wrote a natural language prompt, and Claude AI took control of my computer to navigate to the PCAOB website, find an inspections report, and download it. It mimicked how I would navigate the website to find the report. Check out the video.

You may be saying, what is the big deal? Well, this is one of the earliest prototypes of an agentic workflow. Over the next few years, this type of technology will be able to automate large portions of an auditor's workflow, mostly the mundane tasks like collecting documents, filling in forms, etc.

When a user asks Claude Computer Use to perform a procedure, Claude looks at the screenshots of what is visible to the user and then counts how many pixels vertically and horizontally it needs to move the cursor to click in the correct place. It is designed using a transformer model, which is the same technology used by large language models to predict the next word in a sentence.

Keep in mind that Claude Computer Use is a controlled interface. It operates under direct human guidance for specific requested tasks. This differs from autonomous AI agents, which also allow for structured interaction with a computer, but involve autonomous decision-making to plan and execute multiple steps independently.

It also differs from robotic process automation (RPA). While both technologies mimic human interaction with a computer, RPA requires developers to write code to perform a procedure, whereas Claude Computer Use takes natural language as input. Also, Claude Computer Use possesses reasoning and is trained on where to move a cursor to achieve its desired goal, whereas RPA is trained to go to one specific spot on a webpage, which means that if the webpage changes, RPA breaks but Claude Computer Use will adjust.

As you will see in my video, agentic workflow automation is still in its infancy. Claude Computer Use is a prototype and it can't do much today, but it does give us a glimpse into the future. Given the rapid pace of development of AI models over the past couple of years, I expect Claude Computer Use to learn quickly.

By the way, do you think OpenAI is jealous that Anthropic made it to market first? You bet. OpenAI announced that its version of an AI Agent tool for tasks will launch in January and will be named 'Operator.' Read about it here.

It is great to have well-funded competitors; they push innovation at a fast pace.

At Tellen we harness these new technologies and figure out ways to optimize them for auditors to help transform their business operations. We fundamentally believe that the audit industry will undergo a massive transformation over the next three to five years and AI will be its new foundation. Reach out if you want to check out the Tellen AI Platform for accounting firms.

FAQ

Frequently Asked Questions

Learn how Tellen’s AI Agent Workforce powers modern accounting firms.

What is Tellen’s AI Agent Workforce?
Tellen’s AI Agent Workforce is a suite of specialized AI-powered agents designed for accounting firms. These agents automate audit workflows, financial statement preparation, and footnote disclosures while ensuring security, compliance, and transparency.
How do Tellen’s AI agents help accounting firms scale?
By automating time-intensive tasks like substantive testing, financial reporting, and consistency checks, Tellen enables firms to handle more engagements without increasing headcount. This drives higher efficiency, capacity, and profitability.
Are Tellen’s AI agents secure?
Yes. Tellen deploys directly into your firm’s cloud environment (Azure, AWS, or GCP), ensuring that sensitive client data never leaves your control. The platform is also SOC 2 Type II certified, providing enterprise-grade security and compliance.
Can Tellen’s AI agents adapt to our firm’s unique workflows?
Absolutely. Tellen’s agents are dynamic learners. They are trained on your firm’s proprietary data, policies, and tech stack, creating a shared knowledge base that evolves with each engagement.
What accounting tasks can Tellen’s agents automate?

Tellen automates tasks across every audit stage, including:

  • Planning: Research and guidance from accounting standards.
  • Fieldwork: Substantive and control testing.
  • Reporting: Drafting financial statements and footnotes.
  • Review: Consistency checks and quality scans.
How does Tellen improve audit quality?
Tellen ensures accuracy and compliance by cross-referencing data, logging every AI decision, and providing 100% traceable outputs backed by verifiable sources—so your audit files are complete, consistent, and trustworthy.
What ROI can accounting firms expect with Tellen?
Firms using Tellen report significant time savings, revenue-per-employee growth, and improved engagement capacity. For example, one firm achieved 332% ROI and saved nearly 300 hours using AI agents.
Does Tellen integrate with our existing software?
Yes. Tellen seamlessly integrates with tools like Microsoft Teams, Slack, SharePoint, OneDrive, Copilot, Caseware, Wolters Kluwer, Thomson Reuters, and Inflo—fitting into your existing audit workflow.
How is Tellen different from generic AI tools?
Unlike generic AI or off-the-shelf automation software, Tellen is purpose-built for accounting. It is secure, compliance-focused, and continuously adapts to your firm’s unique processes, ensuring firm-specific intelligence.
How can we get started with Tellen?
You can schedule a demo or consultation via our Contact page. Our team will guide you through setup, deployment, and training so your firm can start scaling with AI-powered efficiency.