Huda Rasyad Wicaksono, . (2026) IMPLEMENTASI LLM-RAG UNTUK AUTOMATED DOCUMENT GENERATION AND VALIDATION PADA PROPOSAL PROGRAM KREATIVITAS MAHASISWA DI FIK UPNVJ. Skripsi thesis, Universitas Pembangunan Nasional Veteran Jakarta.
![[img]](http://repository.upnvj.ac.id/style/images/fileicons/text.png) |
Text
ABSTRAK.pdf Download (795kB) |
|
Text
AWAL.pdf Download (4MB) |
|
Text
BAB 1.pdf Restricted to Repository UPNVJ Only Download (3MB) |
|
Text
BAB 2.pdf Restricted to Repository UPNVJ Only Download (9MB) |
|
Text
BAB 3.pdf Restricted to Repository UPNVJ Only Download (5MB) |
|
Text
BAB 4.pdf Restricted to Repository UPNVJ Only Download (34MB) |
|
Text
BAB 5.pdf Download (1MB) |
|
Text
DAFTAR PUSTAKA.pdf Download (2MB) |
|
Text
RIWAYAT HIDUP.pdf Restricted to Repository staff only Download (165kB) |
|
Text
LAMPIRAN.pdf Restricted to Repository UPNVJ Only Download (6MB) |
|
Text
HASIL PLAGIARISME.pdf Restricted to Repository staff only Download (26MB) |
|
Text
ARTIKEL KI.pdf Restricted to Repository staff only Download (393kB) |
Abstract
The proposal review process for the Program Kreativitas Mahasiswa (PKM) at FIK UPNVJ is still conducted manually, and a 2025 Belmawa report recorded 75 error findings in UPNVJ PKM proposals, related to formatting and document structure, while the PKM guidebook's formatting rules change yearly, complicating manual template creation. This research aims to design, implement, and evaluate a system based on LLM and RAG capable of extracting format parameters from the PKM guidebook (automated document generation and validation), and to evaluate the system through black box testing and UAT. The research applies Design Science Research (DSR) for artifact design and evaluation, combined with Rapid Application Development (RAD) for incremental development, limited to the construction stage without cutover. The system was built using a Service Based Architecture consisting of a frontend service (Next.js), a web backend service (Express.js), AI services (FastAPI and Python), and a database (Supabase), incorporating Human in The Loop at the extraction review and proposal assessment stages. Testing data were analyzed using the RAGAS framework for RAG pipeline quality and the PSSUQ instrument for system usability. Black box testing shows all seven functional scenarios succeeded without failure. UAT recorded an average PSSUQ score of 1.89 on a 1-7 scale (Good category, 85.2% satisfaction). RAGAS evaluation recorded faithfulness 1.000, answer relevancy 0.9186, context recall 0.900, and context precision 0.8175. This research concludes that the designed LLM-RAG architecture is feasible as the basis for automated document generation and validation of PKM proposals at UPNVJ, with good functional reliability and user acceptance.
| Item Type: | Thesis (Skripsi) |
|---|---|
| Additional Information: | [No.Panggil: 2210511098] [Pembimbing 1: Neny Rosmawarni] [Pembimbing 2: Radinal Setyadinsa] [Penguji 1: Musthofa Galih Pradana] [Penguji 2: Kharisma Wiati Gusti] |
| Uncontrolled Keywords: | automated document generation, automated document validation, LLM-RAG, Program Kreativitas Mahasiswa, Rapid Application Development |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > T Technology (General) |
| Divisions: | Fakultas Ilmu Komputer > Program Studi Informatika (S1) |
| Depositing User: | HUDA RASYAD WICAKSONO |
| Date Deposited: | 28 Jul 2026 08:58 |
| Last Modified: | 03 Sep 2026 05:25 |
| URI: | http://repository.upnvj.ac.id/id/eprint/51791 |
Actions (login required)
 |
View Item |