Piyush Chugeja

Career counselling meetings, turned into a summary and a to-do list

A bot joins the counselling call and what comes back is a speaker-labelled transcript. The model turns that into a fixed JSON payload (summary, action items, insights, who spoke) in whichever of English, Hindi or Marathi the session ran in. The model is the project’s own: three open-weight families were benchmarked on a hand-built dataset of counselling transcripts, and the best of them, Llama 3.1 8B, was fine-tuned with Unsloth and LoRA until it beat the others on quality and inference time at once.

Indian Sign Language read from video, then written out as a sentence

Gesturely turns Indian Sign Language into readable sentences. Each sign is captured as a short clip, reduced to a sequence of body-pose landmarks rather than pixels, and classified against a 40-word vocabulary. The recognised words then go to a language model with one instruction: make a grammatical sentence out of these and add nothing. The sentence can then be translated and spoken aloud.