LyricPhonics: AI Multimodal Phonics Cover Engine

"Imagine you want to sing your favorite Japanese or Chinese anime song, but you can't read the alphabet. LyricPhonics turns complex characters into words you can actually pronounce and sing, timed perfectly to the music."

1. The Problem (Why I Built This)

Singers who want to cover international songs on TikTok, YouTube, or Reels face three big hurdles:

• Unreadable Foreign Characters: Hanzi, Kanji, and Hangul cannot be pronounced without years of language study.
• Academic Pinyin/Romaja Cannot Be Sung: Standard romanization lacks musical rhythm and natural pitch cues, making covers sound robotic and off-beat.
• No Millisecond Timestamps: Online lyrics are just plain text without musical entry points or pause markers.

2. How I Solved It (Under The Hood)

LyricPhonics uses multimodal AI and enterprise backend engineering to make foreign lyrics immediately singable:

• Clean Architecture (.NET 8): Separated into 4 independent layers (Domain, Application, Infrastructure, Api) protected by 25/25 unit tests. Any AI provider or cloud storage can be swapped without touching core business logic.
• Sliding-Window Key Pool & Polly v8: Free AI APIs enforce harsh rate limits (e.g. 5 requests/minute). I engineered a sliding-window key rotator with Polly v8 exponential backoff to achieve zero HTTP 429 crashes.
• Military-Grade Secret Vault: User and admin API credentials are encrypted with 100,000 PBKDF2 hashing rounds and AES-256-GCM. Plaintext keys never touch the database.
• 60fps Real-Time Lyric Sync: Uses an O(log N) Binary Search algorithm. It pinpoints the active lyric in under 1ms instead of lagging with slow linear scans.
• Client-Side Multi-Format Export: Exports timestamped lyrics directly to LRC, SRT, and TXT subtitle files in the browser without server load.

3. Key Takeaway & Results

• Reliability: 100% test coverage across core services (25/25 xUnit tests passed).
• Performance: Sub-millisecond lyric synchronization running at a fluid 60fps.
• Cost: $0 infrastructure cost using Cloudflare R2 and efficient sliding-window key rotation.