Experience
Research experience
A Network-based Exploration to Unveil Communities of Large Language Model Modules
PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI
· Utilize network analysis to map the association between datasets and cognitive skills within LLMs, revealing the distribution of skills across different model modules.
· Analyze the localization of skills in LLM modules and evaluate how targeted fine-tuning of modules based on specific skill distributions impacts model performance.
Forecasting Open-Weight AI Model Growth on HuggingFace(Link)
PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI
· Study the trajectory of growth of a number of fine-tuned models after release.
· Compare the impact of different companies on the AI community through their released models.
Boosting Reinforcement Learning for Network Analysis with Data Augmentation Strategies
PI: Dr. Pin-Yu Chen, IBM; Dr. Sholom Havlin, Bar-Ilan University; Dr. Jianxi Gao, RPI
· Created a robust RL and GNN framework as a medium for finding critical nodes in complex networks.
· Analyzed synthetic and real-world graphs on different critical node problems using targeted attacks.
Financial Recall Using Large Language Models
Co-Author: Xiaowei Wang, RPI | PI: Dr. Jianxi Gao, RPI
· Create a framework to retrieve and process financial datasets using BERT-based models and index them with FAISS for efficient similarity searches.
· Fine-tuned Llama2 with BGE embeddings and re-ranker to achieve state-of-the-art results in sentiment analysis across financial domains.
On the Robustness of Large Language Models for Tabular Question Answering(Link)
Co-Author: Sixue Xing | PI: Dr. Soham Dan, IBM; Dr. Jianxi Gao, RPI
· Analyze structural and value-based perturbation of tabular question answering using LLM.
· Study the impact of few-shot prompting on tabular question-answering tasks using different sizes of LLMs.
· Evaluate changes in the performance of newer versions of LLM models.
Convolutional Neural Network-based EEG Emotion Classification with the Forward Selection Wrapper technique for Channel Selection (Link)
Advisor: Dr. Jon G. Sigurjonsson, University of Iceland
· Used forward selection wrapper technique for channel filtration.
· Used Keras to create a Convolutional Neural Network (CNN) that classifies emotion using the DEAP dataset.
Work Experience
Web Development Intern, Temple Sinai, 208 Summit Avenue, Summit, NJ [July 2019- Sept 2019]
- Build and deploy a website using React as a tool in a suitable web hosting platform
- Explore ideas with the client to come forward with an appealing websiteWeb App and App Developer, Hazelnut [June 2019 – Feb 2020]
-Front-end engineering team for implementing UI design of the website and the mobile app
-Assist Hazelnut core developers with application beta-testing and application deployment
Student Technician, IT Department, Caldwell University, Caldwell, New Jersey [Aug 2018 – May 2021]
- Provided timely resolutions to your technology inquiries
- Fix technical issues in faculty, staff, or student’s computer devicesPeer Tutor, Academic Success Center, Caldwell University, Caldwell, New Jersey [Sept 2017- Dec 2020]
- Tutored Mathematics and Computer Science courses to students in need
- Recorded and analyzed data of all the tutors to create a report for the Supervisor