Reduction in False-Positive Assessments
Days Spent Integrating Retell AI
Client Cost Savings
.svg)
AccioJob is an Edtech company that helps aspiring software engineers and data scientists land top-notch job opportunities by offering structured learning paths, mock tests, and mentorship. The platform also features a customized, AI-driven assessment tool that enhances the hiring process, ensuring better accuracy and efficiency in candidate evaluations, ultimately helping both candidates and employers find the best match.By integrating Retell AI into their innovative assessment tools, AccioJob have drastically reduced false-positive assessment scores, improved hiring accuracy, and streamlined candidate evaluations, helping their partners identify top talent at a lower cost.
Using Retell AI to build an AI invigilator, AccioJob delivers accurate, efficient, and cost-effective talent assessment solutions
*Based on the price that AccioJob charge for AI invigilation versus a traditional outsourced interview
“Retell AI is loaded with features that can fulfill our case and it's pretty easy to integrate.” --Neeraj Sharma, Head of Engineering at AccioJob.
AccioJob is redefining how companies identify top talent in India’s competitive job market. In addition to offering courses and certifications in full-stack development and data science, the company integrates cutting-edge AI technology into the hiring and evaluation process for engineering roles.
To streamline an enormous volume of job applications, AccioJob developed innovative assessment tools to streamline the evaluation process. However, the growing number of sophisticated cheating tools threatened their ability to identify the right candidates for their partner companies. By seamlessly integrating Retell AI with their existing talent management system, AccioJob is able to evaluate candidates at scale with personalized tests and stay ahead of innovations designed to beat their assessments.
As Head of Engineering at AccioJob, Neeraj Sharma experienced firsthand the complexity of identifying and hiring top talent in India’s competitive job market. “In India, when we post a software engineer role on LinkedIn, we get more than 1,000 applications,” Sharma explains. To address this, his team developed an AI-driven assessment tool that generates customized tests based on role requirements, significantly streamlining the evaluation process. “After adding this layer, we narrowed it down to 100 candidates. Then, after another two or three filtering layers, to 10 or 20 people.”
Today, over 20 companies across India rely on AccioJob’s tools to identify top talent with ease. However, AccioJob faced significant challenges keeping up with innovations in tools designed to beat their tests:
Despite implementing robust AI-generated assessments and proctoring systems, AccioJob found that sophisticated cheating methods led to a false positive rate as high as 50%. This undermined the reliability of their assessments. “We couldn’t meet our customers’ needs because we weren’t able to identify the right talent,” Sharma explains.
Whenever AccioJob released new assessments, they were very effective and accurate at identifying talent. However, candidates rapidly found workarounds to cheat on tests. This cat-and-mouse game forced AccioJob to continually innovate, iterating on their platform every few months to combat evolving methods of cheating.
With candidates already spending over an hour completing assessments, AccioJob needed a fast, seamless way to detect cheaters. The most straightforward approach was to introduce brief follow-up questions targeting the candidates’ highest-scoring responses.
AccioJob decided to build an AI-based invigilator into their assessment. However, Sharma’s team quickly realized that building this in-house would require significant time and resources.
By integrating Retell AI into their assessment tool, AccioJob is able to combat cheating and reduce false positives on tests. Retell AI offered AccioJob several benefits in enhancing the reliability of their evaluations:
Retell AI’s simple and efficient API allowed AccioJob to quickly integrate an AI invigilator into their assessment platform. Immediately after the candidate finishes their test, the AI calls the candidate to ask follow-up questions for 5-6 minutes. This drastically improves the reliability of the assessment while adding minimal time to the client interview.
“The call scheduling part was just a few API calls. Our team was able to integrate in hardly two days.”
The AI is able to identify the candidates’ highest-scoring question and ask targeted, more difficult follow-up questions. Using data from the follow-up call, AccioJob generates an authenticity score, a key metric to identify whether candidates have cheated. The data generated during these calls reduced false positive scores by 70%.
“We see 15% false-positives compared to 50% before. This is only the beginning. We are trying to reduce it further.”
By enhancing the reliability of their evaluations, AccioJob delivers significant cost savings to their clients at a fraction of the price of outsourcing interviews. Even better, the AI delivers reliable, consistent insight into the interviewee’s answers.
“This is a 30-40% cost saving compared to a human interviewer and we see a massive difference in the quality of feedback.”
Seamless, Self-Optimizing Integration with Talent Management Systems
AccioJob have seen an overwhelmingly positive response to this assessment from their customers. Although it remains to be seen over time, early feedback suggests that the false positive score is decreasing over time. This is in total contrast to AccioJob’s previous assessments, where cheaters consistently found ways to bypass the system within just a few months.
“Our partner companies are really, really satisfied with these candidates.”
Building for the future: The AI invigilator is just the beginning for AccioJob: This product has created a demand for further voice AI integration in the interview process. “This saves small startups so much bandwidth.”
Consistency and accuracy: AccioJob has a network of mentors who can interview candidates, but they see more unbiased and consistent assessment from the AI invigilator. “The feedback from the AI invigilator is really accurate.”
The benefits of an API: By working with Retell, AccioJob’s benefit from external infrastructure management and rapid feature development. “We chose Retell because we wanted the best features to come to us very quickly.”
.png)
.svg)
.svg)
.svg)
