AI Time Tracking System
Automated extraction and booking of timesheets from email inboxes with human-in-the-loop validation.
About the Project
A staffing agency received timesheets in various formats – often handwritten and scanned via email. The manual transfer of this data to the ERP system was time-consuming and error-prone.
The Solution
The developed solution automates this process end-to-end: An Azure Logic App workflow reads the relevant Outlook mailbox and passes incoming timesheets to a Microsoft Foundry Agent. This uses a Content Understanding model for data extraction from the various document formats – regardless of whether machine-generated or handwritten.
Validation
The extracted data passes through a deterministic validation algorithm that performs plausibility checks. Upon successful validation, the data is booked directly into the ERP system. If validation fails or the result is uncertain, the process is forwarded to a human employee (human-in-the-loop).
Human-in-the-Loop
For manual post-processing, a Power Apps interface was developed through which employees can monitor the status of timesheets, make corrections and initiate final booking. Integration with the ERP system is done via its REST API through Azure Function.
Highlights
- End-to-end automation from email inbox to ERP booking
- Content Understanding for handwritten and machine documents
- Deterministic validation algorithm
- Human-in-the-loop for uncertain cases via Power Apps
Challenges
Extraction from handwritten documents with varying quality. Definition of robust validation rules.
Results
Significant reduction of manual capture effort. Consistent data quality through algorithmic validation. Scalable solution for growing document volumes.
Interested?
Are you interested in a similar project or want to learn more? Get in touch – we look forward to hearing from you!
Get in touch