Auditly: the shopkeeper talks, the ledger writes itself

Auditly is an open-source AI application designed to help small shopkeepers in India keep their accounts in a paper ledger, called a khata, by speaking into it instead of typing. The owner of a kirana shop writes down transactions twice a day from memory, which often leads to inaccuracies and inefficiency. Auditly removes the need for typing and instead allows the shopkeeper to speak their transactions in Hindi or Hinglish, and the app converts them into structured records.

To use Auditly, the shopkeeper presses a green microphone button and says their transaction, such as "paanch kilo cheeni bechi do sau rupaye kilo" (sold five kilos of sugar at two hundred a kilo). The app then displays a record of the sale, including the quantity, price per kilo, and total amount. It also records any expenses, such as the electricity bill. The shopkeeper can review the day's transactions, make corrections, and save them.

Auditly uses an open-weight model called gpt-oss-120b, which is hosted via Groq's OpenAI-compatible endpoint. The model converts spoken transactions into JSON format and validates the data before saving. It handles various nuances of spoken Hindi, such as converting spoken numbers to the correct numerical values and identifying product names. Additionally, Auditly includes features like a review screen for checking transactions before saving and a voice feature that reads the day's records back to the shopkeeper in Hindi.