Experience

Research experience

A Network-based Exploration to Unveil Communities of Large Language Model Modules

PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI

·  Utilize network analysis to map the association between datasets and cognitive skills within LLMs, revealing the distribution of skills across different model modules.

·  Analyze the localization of skills in LLM modules and evaluate how targeted fine-tuning of modules based on specific skill distributions impacts model performance.


Forecasting Open-Weight AI Model Growth on HuggingFace(Link)

PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI

·  Study the trajectory of growth of a number of fine-tuned models after release.

·  Compare the impact of different companies on the AI community through their released models.


Boosting Reinforcement Learning for Network Analysis with Data Augmentation Strategies                     

PI: Dr. Pin-Yu Chen, IBM; Dr. Sholom Havlin, Bar-Ilan University; Dr. Jianxi Gao, RPI

·  Created a robust RL and GNN framework as a medium for finding critical nodes in complex networks.

·  Analyzed synthetic and real-world graphs on different critical node problems using targeted attacks.


Financial Recall Using Large Language Models

Co-Author: Xiaowei Wang, RPI | PI: Dr. Jianxi Gao, RPI

·  Create a framework to retrieve and process financial datasets using BERT-based models and index them with FAISS for efficient similarity searches.

·   Fine-tuned Llama2 with BGE embeddings and re-ranker to achieve state-of-the-art results in sentiment analysis across financial domains.


On the Robustness of Large Language Models for Tabular Question Answering(Link)

Co-Author: Sixue Xing | PI: Dr. Soham Dan, IBM; Dr. Jianxi Gao, RPI

·  Analyze structural and value-based perturbation of tabular question answering using LLM.

·  Study the impact of few-shot prompting on tabular question-answering tasks using different sizes of LLMs.

·  Evaluate changes in the performance of newer versions of LLM models.


Convolutional Neural Network-based EEG Emotion Classification with the Forward Selection Wrapper technique for Channel Selection (Link)

Advisor: Dr. Jon G. Sigurjonsson, University of Iceland

·  Used forward selection wrapper technique for channel filtration.

·  Used Keras to create a Convolutional Neural Network (CNN) that classifies emotion using the DEAP dataset.


Work Experience

-Assist Hazelnut core developers with application beta-testing and application deployment

- Recorded and analyzed data of all the tutors to create a report for the Supervisor

EmailTwitterGitHubLinkedIn