Skip to content
View TBO22's full-sized avatar

Highlights

  • Pro

Block or report TBO22

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
TBO22/README.md

Hi, I'm Talha Bin Omar 👋

AI Engineer • Speech AI • LLMs • Model Optimization

Profile Views


About Me

  • AI Engineer working with deep learning, speech systems, and large language models.
  • Currently pursuing Data Science at Air University Islamabad, in my 7th semester.
  • Started working professionally in AI during my 5th semester.
  • I work across model architecture, training, fine-tuning, optimization, inference, and deployment.
  • Strong focus on Speech-to-Text, Text-to-Speech, speech translation, and low-resource languages.
  • Worked extensively with Pakistani Pashto and challenging real-world speech data.
  • Experienced with LLM training, fine-tuning, embeddings, synthetic data generation, and model adaptation.
  • Build production AI systems using FastAPI, Docker, Kafka, CUDA, and GPU inference pipelines.
  • Interested in model optimization, inference engines, Apple Silicon, GPU computing, and open-source AI infrastructure.
  • Also involved in mentoring junior engineers and interns in machine learning and deep learning.

Research & Publications

Denoising Telerik RadCaptcha

Denoising Telerik RadCaptcha: A Comparative Evaluation of the Effectiveness of Pre-Processing Techniques and Deep Learning Methods Using a Novel Dataset

Talha Bin Omar, Tahir Sher, Abdul Rehman, M. Haroon Khan

ICCK Transactions on Advanced Computing and Systems • 2026

PaperDOI

Developed and evaluated a deep learning based approach for breaking Telerik RadCaptcha using a novel dataset of 3,000 real-world CAPTCHA images.

97.60% character accuracy • 92.08% full CAPTCHA accuracy


What I Work On

Speech AI

  • Automatic Speech Recognition
  • Text-to-Speech
  • Speech-to-Speech Translation
  • Low-resource language modeling
  • Whisper fine-tuning and optimization
  • Voice and acoustic modeling
  • Neural audio pipelines
  • Streaming and real-time inference

Large Language Models

  • LLM fine-tuning
  • Parameter-efficient training
  • LoRA and DoRa
  • Synthetic data generation
  • Model evaluation
  • Quantization
  • Local LLM deployment
  • Agentic AI systems

Model Optimization

  • GPU inference optimization
  • CUDA workloads
  • Quantized inference
  • CTranslate2
  • Apple Silicon / MPS
  • Memory optimization
  • Latency optimization
  • Production inference pipelines

AI Infrastructure

  • FastAPI
  • Docker
  • Kafka
  • REST APIs
  • Model serving
  • GPU deployments
  • Data pipelines
  • Git and GitHub

Selected Work

Speech-to-Speech AI

Built custom speech pipelines involving technologies such as:

Whisper → Neural Adapters → G2P / Linguistic Processing → TTS

Worked on speech recognition and translation under heavily degraded GSM and telephony audio, where noise, compression, low bandwidth, and unclear speech make conventional models struggle.

My work includes:

  • Custom Whisper fine-tuning
  • Encoder adaptation using LoRA
  • Decoder hidden-state extraction
  • Neural representation adapters
  • Transformer and CTC architectures
  • Temporal convolution bridges
  • NeMo-based linguistic processing
  • VITS-based speech synthesis
  • End-to-end GPU inference pipelines

Real-Time Speech Generation

Developed an English-to-Pashto speech-to-speech research pipeline combining:

Whisper + Neural Adapters + NeMo G2P + Pashto VITS

Evaluation on an RTX 3090:

Generated Audio: 11.006 seconds
End-to-End Inference: 4.436 seconds
Real-Time Factor: 0.403

The complete pipeline operates significantly faster than real time.

CTranslate2 / Apple Silicon

Working on an experimental Apple Silicon MPS backend contribution for OpenNMT/CTranslate2.

The work involves extending a high-performance inference library beyond its traditional CPU and CUDA execution paths and evaluating:

  • MPS operator support
  • Model correctness
  • WER / BLEU preservation
  • Performance
  • Memory behavior
  • Apple Silicon compatibility

This work involves lower-level model execution and inference infrastructure rather than treating ML frameworks as black boxes.

Vibify

Built Vibify, an AI-powered music recommendation platform using:

FastAPI • OpenAI Embeddings • Pinecone • Python

Implemented semantic music recommendation using vector embeddings and similarity search.


Tech Stack

Languages

AI / Deep Learning

Backend & Infrastructure

Compute & Optimization

Developer Tools


Current Interests

interests = [
    "Speech AI",
    "Large Language Models",
    "Low-Resource Languages",
    "Real-Time AI",
    "Model Optimization",
    "Quantization",
    "Inference Engines",
    "Apple Silicon AI",
    "GPU Computing",
    "Open Source AI"
]

I particularly enjoy understanding how models work internally, modifying architectures, optimizing inference paths, and turning research models into production systems.


Connect


GitHub Stats

GitHub Streak

GitHub Streak

GitHub Profile Stats


Building AI systems from model architecture to production inference.

Pinned Loading

  1. AU_Merit_List_24.github.io AU_Merit_List_24.github.io Public

    Unofficial Merit List Based on Web Scraping Data

    HTML 4 1

  2. FruitBrainAI FruitBrainAI Public

    This repository contains a Convolutional Neural Network (CNN) model built from scratch for fruit classification. The model uses three convolutional layers followed by max-pooling layers for featur…

    Python 2

  3. Neural_Network_Implementation Neural_Network_Implementation Public

    Basic Neural Network implementation in c++ using Linked Lists

    C++ 1

  4. CTranslate2 CTranslate2 Public

    Forked from OpenNMT/CTranslate2

    Fast inference engine for Transformer models

    C++

  5. Renewable_vs_Non_Renewable_Datafest_Pakistan Renewable_vs_Non_Renewable_Datafest_Pakistan Public

    This repository contains the Datafest Pakistan project Made by Team EcoVision, which explores 12 years of Pakistan's energy data with a focus on renewable energy, especially solar power.

    Python

  6. Virtual-Canvas-OpenCV Virtual-Canvas-OpenCV Public

    The Virtual Canvas Project is an interactive digital workspace designed to simulate a real-life drawing experience. This project aims to provide users with a seamless, intuitive interface for creat…

    Python