vLLM
Translation
Part 2: Scaling Translation Inference: +82% Throughput
How we improved vLLM inference throughput by 82% using AsyncLLMEngine and right-sized continuous batching
Ashar Mirza - VoicePing
5 min
Research
VoicePing benchmarks, methodology, model evaluations, and product research.
55 articles
FastAPI
vLLM
Part 1: The Bottleneck to Scale Our Translation Inference Servers
Identifying architectural bottlenecks in FastAPI + multiprocessing setup preventing efficient GPU utilization
Ashar Mirza - VoicePing
7 min
Face Recognition
Emotion Detection
Preprocessing and Analysis of Video and Audio Data for Face and Emotion Recognition
Building a video preprocessing pipeline for facial analysis, pose estimation, and emotion detection
Aditya Sundar - Waseda University
3 min
Web Scraping
Python
Building a Scalable Asynchronous Web Crawler for Data Collection
September 2024 - Development of an efficient async web crawler using Python, aiohttp, and BeautifulSoup for large-scale data collection
Aditya Sundar - Waseda University
8 min
Machine Translation
Large Language Models
Machine Translation with Large Language Models and Hallucination Reduction
Fine-tuning Llama 3.1 for Chinese-to-English translation with hallucination mitigation strategies
Shuang LIANG - The University of Tokyo
3 min
Machine Translation
RAFT
Enhancing English-Chinese Translation with Retrieval-Augmented Fine-Tuning (RAFT)
Exploring RAFT methodology for bidirectional English-Chinese translation using Llama 3.1
Kai-Teh Tzeng - Lehigh University
2 min
Try VoicePing for Free
Experience communication beyond language barriers with real-time voice translation
Get Started Free