Lead Software Engineer
July 2019 - Present
Onix
- Lead a team of 6+ engineers of L3 - L4 level to drive AI-native development, utilizing Modern AI tools to accelerate the delivery of deterministic processing engines and reduce QA cycles by ~40%.
- Architected large-scale data systems to extract execution lineage and dependency graphs for Shell, SQL, JavaScript, Python, and Scala, utilizing Neo4j to drive modernization strategies.
- Achieved 100% analysis coverage (up from 60%) by designing runtime engines with control-flow tracking and runtime interception using GraalVM and Truffle instrumentation.
- Improved lineage reliability by ~35% by building a confidence-based trust scoring system leveraging RAG-based context enrichment.
- Engineered a unified logic interpretation layer using the Apache Calcite framework and a custom canonical model to handle diverse input representations across multi-language codebases.
- Developed a 2-step Scala lineage pipeline using a hybrid LLM approach: automated parsing/extraction to create a DTO model, followed by Semantic Search on a Vector DB to inject dependency source code into detailed prompts for commercial llm processing.
- Delivered high-impact PoCs and critical fixes, including Databricks, Airflow metadata extraction, ANTLR-based TPT parsers, and resolving production blockers during legacy Shell-to-Java upgrades.
- Spearheaded core infrastructure improvements, including containerization, CI/CD optimization, and a plugin-based architecture, reducing deployment time by ~30%.
- Drove AI enablement initiatives by integrating Model Context Protocol (MCP) with internal metadata glossaries, providing LLMs with context aware understanding for explainable lineage and product insights.