Today marks a significant milestone in the intersection of AI and auditing. We at Tellen are thrilled to announce our collaboration with Advantage Partners, a leader in SOC 2 attestations, to launch an innovative AI-powered chatbot designed to provide deep insights into the SOC 2 IT audit process.
What sets this chatbot apart?
This isn't just another chatbot. It's a purpose-built tool leveraging the combined power of leading AI models from OpenAI, Meta, and Anthropic. We've meticulously optimized and secured it to address the specific needs and challenges of CPA firms, ensuring instant access to accurate, relevant, industry-specific information. The AI-powered chatbot also seamlessly integrates with Slack, allowing users to get answers to their questions without leaving their workflow.
How does Tellen's infrastructure contribute?
Our robust AI infrastructure is the backbone of this chatbot. Built on Microsoft Azure’s cloud infrastructure, it ensures security and compliance for enterprise networks, while enabling the seamless integration of multiple AI models. This unique approach allows us to optimize responses based on a variety of factors, including accuracy, speed, succinctness, and cost-effectiveness.
How does Advantage Partners tap its vast SOC2 knowledge base?
Tellen's AI-powered chatbot leverages its Retrieval Augmented Generation (RAG) architecture to deliver high-quality SOC2 audit answers. This approach combines the strengths of large language models with Advantage Partners’ comprehensive knowledge base of SOC2 audit information. By retrieving relevant information from the knowledge base and generating responses based on that information, the chatbot can provide accurate and informative answers to even the most complex SOC2 audit questions.
Does Tellen’s vertical AI expertise actually generate better answers?
We believe that AI models are amazing general-purpose models. We also believe that vertically focused AI businesses can harness general-purpose AI models to deliver optimized results tailored to industries. Tellen is a vertically focused AI business focused on the accounting industry. We need to know for ourselves and for our clients whether our vertically focused AI architecture actually performs better than the general-purpose AI models.
Tellen’s routing agent optimizes across four dimensions: accuracy, succinctness, latency, and cost. We partnered with a third-party measurement firm, RAGmetrics, to quantify our performance. With Advantage Partners’ help, we created fifty SOC2 questions along with optimized answers and supporting documentation, and then we tested seven AI models across our four dimensions. We were pleased to learn that Tellen’s answers deliver the most accurate answers. Furthermore, when comparing Tellen’s RAG optimized answers relative to the underlying AI model answers, Tellen’s RAG pipeline generates about a 15% accuracy lift with the most accurate answers coming from Tellen’s GPT-4 Turbo RAG pipeline (4.69 out of 5). This test has given us confidence that our vertical specialization does improve answer accuracy. We expect our lead will widen as our technology matures.
Why is this important for SOC 2 audits?
SOC 2 audits are complex and demanding. By providing a tool that delivers immediate, accurate answers to audit-related questions, we're empowering Advantage Partners to streamline their processes, reduce friction, and ultimately deliver even greater value to their employees and clients.
The power of partnership:
We're incredibly proud to partner with Advantage Partners on this groundbreaking initiative. Their deep expertise in SOC 2 attestations, combined with our AI infrastructure, has resulted in a chatbot that's truly tailored to the needs of the accounting industry.
What's on the horizon?
This launch is just the beginning. We have demonstrated that this AI-powered chatbot provides optimized answers for SOC2 audits. But this chatbot is not only for SOC2 audits, this chatbot can meet the needs of every assurance firm and can be optimized based on the firms’ specialization and knowledge base.
As AI technology continues to advance, we're committed to staying at the forefront of innovation. We'll continue to refine and enhance this chatbot, ensuring it remains a valuable asset for Advantage Partners and their clients. We will continue to harness the power of AI models, as they emerge, to figure out their best use cases for accounting and to deliver accounting-specific AI applications and results.
We believe that this collaboration between Tellen and Advantage Partners is a testament to the transformative power of AI in auditing. Stay tuned for more updates as we continue to push the boundaries of what is possible
.svg)
.svg)
