Sept 2026 – Present
Machine Learning Research Intern
Deep Forest Sciences
Chemical Language Models & Molecular Representation Learning
- Developing ChemBERTa-4, an OLMo-based chemical language model for molecular property prediction, retrosynthesis, and molecular generation.
- Conducted comparative tokenizer analysis across OLMo, ChemFM, and ChemBERTa-3, identifying 9.55% and 87.97% vocabulary overlap with OLMo, respectively, to inform chemical tokenization and vocabulary adaptation strategies.
- Benchmarked OLMo-7B across 9 molecular property datasets following continued pretraining on 10K–5M PubChem samples, evaluating toxicity, bioactivity, and physicochemical predictions using ROC-AUC and RMSE.
- Applied QLoRA fine-tuning to OLMo-7B, improving performance on 8 of 9 molecular benchmarks over non-fine-tuned baselines, achieving up to 22.1% relative ROC-AUC improvement and 16.4% RMSE reduction in the 100K PubChem configuration.