Retrieval Augmented Generation Large Language Model

Motivation

Writing applications for Small Business Innovation Research (SBIR) grants can be time consuming and eat at company resources. Therefore there is an interest in using AI to aide in this writing process.

Challenge

Create an easy to use RAG-LLM that can be used by anyone in the company. The LLM should take in knowlede about projects in the form of pdf, .txt, .json, and even websites urls and then be able to answer user questions in a chatbot format.

Solution

Using Meta's Llama a RAG-LLM was created with an accompying Tkinter GUI for ease of use.

Approach

I used Meta's Llama base LLM as RAG implementation was fairly easy and this method had already been completed by my project supervisor and could be passed down to me. I created my own custom scrapers for websites and txt files to allow for better RAG success. F1, Rouge,Bleu,Cosine Similarity, and Recall scores were used to quantify the success of the model when writing proposal abstracts. These scores served as metrics for all changes that were made in the model. A Tkinter GUI was made allowing for all functions of the product to be accessible outside terminal use and therefore be more accessible.

Skills Demonstrated Project Artifacts
RAG-LLM See Below
Tkinter GUI See Below

Benefits

This product will help users who wish to speed up the application writing process for SBIRs and therefore save time and company resources. This project taught me about Large Language Models, building a GUI from scratch, and ultimatley designing a product.