Research & Technical Writing
- Evacuated U-tube Solar Collector – Published in the ASME Journal of Solar Energy Engineering with an accompanying GitHub implementation.
Large Language Models
- PPO to GRPO in Large Language Models Alignment
- From AdamW to Muon Optimizer
- Character.ai optimized inference blog post explained
- ORPO for preference data alignment of LLMs
- JSON vs YAML function calling Finetuning comparison
- ReFT: Representation Finetuning Paper deep dive
- DoRA paper deep dive
- ColBERTv2 explained with implementation
- Mamba architecture deep-dive
- LoRA: Low-Rank Adaptation breakdown
- QLoRA explained
- vLLM inference pipeline walkthrough
- RoFormer in JAX
- AdaLoRA primer