JSAI (Journal Scientific and Applied Informatics)

Sentiment Analysis of the MPStore Application Using Logistic Regression and LDA Algorithms

2025-12-09T15:28:34+07:00

The rapid growth of the digital economy encourages user satisfaction as the key to successful application innovation. Within technopreneurship, understanding user sentiment is essential for sustainable product development. This study aims to analyze sentiment and identify the deter-minants of user satisfaction regarding the MPStore application based on reviews from the Google Play Store. Review data were collected via scraping and analyzed using Logistic Regression (LR) for sentiment classification (positive, negative, neutral) also Latent Dirichlet Al-location (LDA) for satisfaction topic extraction. The result shows that the LR model achieved an accuracy of 88.5%. The LDA analysis also successfully revealed eight main topics, includ-ing ease of use, transaction speed, and technical obstacles (errors, login, balance issues). Over-all, a majority of users hold a positive perception of MPStore's efficiency and ease of transac-tions. This study concludes that the combination of sentiment analysis and topic modeling is effective for explaining the level of user satisfaction and providing a strategic foundation for digital application developers.

Retrieval-Augmented Generation Method in the Development of Large Language Model Chatbots for the Anambas Civil Registry Public Information Service

2025-12-15T14:16:10+07:00

Population administration services in the Anambas Islands Regency face significant challenges related to limited information access caused by geographical conditions. Service information on the official Disdukcapil website, which is passive, often makes it difficult for the public to obtain fast and relevant answers. This condition leads to service queue buildups and potentially decreases public satisfaction. As a solution, an intelligent chatbot application based on a Large Language Model (LLM) with a Retrieval-Augmented Generation (RAG) approach was developed. This method effectively combines precise information retrieval capabilities from a document database with the LLM's natural language understanding ability to produce contextual answers. The system's development process was carried out using the LangChain framework, Chroma vector store, and was integrated into a web interface as the frontend. Official Disdukcapil service information was processed through chunking, embedding, and RAG pipeline creation stages. The results showed that the chatbot was able to respond to inquiries about population services accurately and efficiently. Based on evaluations using the BERTScore metric, the system obtained average scores of 98,5% for Precision, 99,1% for Recall, and 98,8% for F1-Score. This system can be accessed from anywhere, greatly assisting people in remote areas, and serves as a potential initial prototype to support the digitization of public services in archipelago regions.

Information Technology, Social Media, and Digital Transformation on the Performance of Laundry MSMEs in Batam City

2025-12-15T14:10:30+07:00

This study examines the effects of information technology, social media, and digital transformation on the business performance of laundry MSMEs in Batam City using a quantitative associative approach. Data were collected from 94 owners or managers of laundry MSMEs through questionnaires and analyzed using IBM SPSS Statistics 25. Classical assumption tests indicated that the data were normally distributed and free from multicollinearity and heteroscedasticity. Simultaneous testing showed that information technology, social media, and digital transformation jointly have a significant effect on business performance (F = 4.588; p = 0.005). However, partial test results revealed that only social media has a positive and significant effect on business performance, while information technology and digital transformation do not show significant effects. These findings suggest that in small-scale service MSMEs, market-oriented digital tools are more effective in improving business performance than complex internal technology adoption.

Comparative Analysis of UI/UX of Online Transportation Booking Applications Using the System Usability Scale (SUS) and Heuristic Evaluation

2025-12-09T11:05:18+07:00

This study aims to analyze and compare the User Interface (UI) and User Experience (UX) of three online transportation applications in Palembang City, namely Gojek, Grab, and Maxim. The rapid growth of Indonesia’s online transportation industry, which reached 88.3 million users in 2024, highlights the importance of evaluating usability quality. Palembang has unique geographical characteristics, as the city is divided by the Musi River, creating specific challenges for app-based transportation services. The novelty of this study lies in the integration of the System Usability Scale (SUS) with Nielsen’s heuristic evaluation within an urban geographical context fragmented by natural barriers. A descriptive comparative approach was employed, involving 120 active users and three UI/UX expert evaluators. The results show that Gojek achieved the highest SUS score of 78.5 (Good), followed by Grab with 75.2 (Good) and Maxim with 68.7 (OK). One-Way ANOVA indicates significant differences among the applications (F = 12.847; p < 0.001). Theoretically, these findings demonstrate that an integrated usability evaluation approach provides a more comprehensive understanding of UI/UX quality in geographically specific contexts.

Development and Evaluation of the Usability of the Hadroh Instrument Marketing Website Using the System Usability Scale (SUS)

2025-12-02T09:31:15+07:00

The rapid growth of digital technology has encouraged micro, small, and medium enterprises (MSMEs) to adopt digital marketing strategies in order to remain competitive. This study aims to develop a marketing website for the Syekh Hadroh MSME and to evaluate the quality of the developed system in terms of functionality and usability. The research employed a Research and Development (R&D) approach with the Waterfall model as the system development method. Functional testing was conducted using Black Box Testing with the Equivalence Partitioning technique, while usability evaluation was performed using the System Usability Scale (SUS) involving 10 respondents. The results of Black Box testing indicate that all test scenarios were successfully executed with a success rate of 100%, demonstrating that the system functions according to the specified requirements. Furthermore, the SUS evaluation produced an average score of 73, which falls into the “good” usability category, indicating that the system is easy to use and well accepted by users. These results suggest that the developed marketing website is functionally reliable and usable, and therefore suitable for implementation as a digital marketing medium to support market expansion and improve service quality for MSMEs.

Analysis of the Effect of Conventional QRIS and ESB QRIS Use on Digital Payment Efficiency at BJ Restaurants in the Digital Age

2025-12-19T16:22:38+07:00

The development of digitalization has encouraged the adoption of cashless payment systems through the Quick Response Code Indonesian Standard (QRIS) in the culinary sector, including Rumah Makan BJ. This study aims to analyze the effect of Conventional QRIS and ESB QRIS on digital payment efficiency. This research employs a quantitative approach with a sample of 122 respondents. Data were collected through questionnaires and analyzed using SPSS version 17. The partial test results indicate that Conventional QRIS has a positive and significant effect on digital payment efficiency, with a t-value of 2.802 and a significance level of 0.006 (<0.05). ESB QRIS shows a stronger influence, with a t-value of 6.029 and a significance level of 0.000 (<0.05). Simultaneously, the ANOVA test shows an F-value of 57.155 with a significance of 0.000, indicating that both variables jointly have a significant effect on digital payment efficiency. The coefficient of determination (R²) of 0.405 indicates that 40.5% of the variation in digital payment efficiency is explained by QRIS usage. These findings are consistent with previous studies on integrated digital payment systems.

Modeling and Simulation of Car Robot Path Planning Using the Ant System Method in a Structured Environment

2026-01-06T18:27:40+07:00

Path planning is a fundamental problem in mobile robot navigation that requires efficient route optimization while avoiding obstacles. This study implements the Ant System method to solve the mobile robot path planning problem using a modeling and simulation approach in a structured environment. The path planning process utilizes pheromone mechanisms and heuristic information to determine an optimal path from the initial state to the goal state. A total of ten simulation experiments were conducted with variations in the number of intermediate coordinates, iterations, and ants. The results show that the proposed method successfully generated collision-free paths in all experiments, with path lengths ranging from 31.4915 to 32.6788 units. The analysis indicates that the balance between the number of intermediate coordinates, iterations, and ants significantly affects path quality, where well-balanced parameters produce smoother and more stable trajectories. Overall, the Ant System method achieved a 100% success rate, demonstrating its effectiveness and reliability for mobile robot path planning in structured environments.

Decision Tree Modeling Using the ID3 Algorithm in a Data Mining Approach

2026-01-06T21:26:58+07:00

The rapid development of information technology has encouraged the use of data mining as a foundation for data-driven decision-making across various sectors, including the karaoke entertainment industry. This study aims to evaluate the performance of the ID3 algorithm in supporting decision support systems through the construction of a decision tree–based classification model. The research method employs the Knowledge Discovery in Databases (KDD) approach, which involves data selection, data transformation, modeling using the ID3 algorithm, and evaluation of decision outcomes. The performance of the method was evaluated based on five key aspects: decision-making capability, classification processing speed, classification result stability, model interpretability, and suitability to user needs. The results indicate that the ID3 algorithm achieved an average success rate of 92%, with the highest performance observed in processing speed and classification stability. These findings demonstrate that the ID3 algorithm is effective, efficient, and highly interpretable, making it suitable for implementation as a classification method in data mining–based decision support systems.

Predicting Flood Potential Using Machine Learning with the XGBoost and Logistic Regression Approaches

2026-01-06T23:40:59+07:00

Flooding is one of the most frequent natural disasters in Indonesia, causing significant material losses and casualties. This study aims to develop a flood potential prediction model based on weather data using machine learning approaches, namely XGBoost and Logistic Regression. The dataset consists of 1,513,505 weather records with 1,165 flood events (0.077%). The features include temperature, humidity, wind speed and direction, weather codes, and temporal features generated using a sliding window approach for H-1, H-2, and H-3. Data imbalance was addressed using a combination of stratified undersampling and SMOTE, changing the class ratio from 1:1,298 to 1:3.3. Experimental results show that XGBoost outperforms Logistic Regression, achieving an accuracy of 98.40%, precision of 97.93%, recall of 95.07%, and an ROC-AUC of 99.38%, while Logistic Regression achieved an accuracy of 62.77%. Feature importance analysis indicates that weather codes at H-3 and H-1 are the most influential predictors. With a low false negative rate of 4.9%, the proposed XGBoost model is considered reliable for implementation as a flood early warning system.

Causal Model of the Influence of Digital Facilities and Content on Students' Information Technology Competence with Learning Interest Mediation

2026-01-07T13:02:38+07:00

This study aims to analyze the effect of facility availability and digital content on students’ information technology competencies with learning interest as a mediating variable. A quantitative approach with a survey method was employed involving 178 students from Information Technology and Visual Communication Design programs. Data were analyzed using multiple regression, simple regression, and path analysis with SPSS 25. The results indicate that facility availability and digital content have a positive and significant effect on students’ learning interest, accounting for 68.2% of the variance. Learning interest also has a significant positive effect on students’ information technology competencies, contributing 61.5% of the variance. Furthermore, digital content shows a significant indirect effect on students’ competencies through learning interest. These findings highlight the strategic role of learning interest as a mediating variable in the causal model of digital learning and imply that improving students’ competencies requires not only adequate facilities and high-quality digital content but also instructional strategies that foster students’ learning interest.

Application of Naive Bayes Algorithm with TF-IDF Weighting and Lexicon Approach for Sentiment Analysis of Student Opinions on Campus Facilities

2025-12-30T23:27:01+07:00

This study aims to analyze student sentiment towards campus facilities at Nurul Jadid University using the NaiveBayes method. Data was collected through questionnaires and processed using Visual Studio Code software. The process stages included manual sentiment classification, data preprocessing, lexicon classification, TF-IDF weighting, and classification using the Naive Bayes method. The results of each step are presented in tables and graphs. The system was also implemented by creating a web application that allows users to enter new text/opinions and obtain sentiment classification results. The results of testing manual sentiment classification and lexicon with the Naive Bayes algorithm showed different levels of accuracy, with manual sentiment classification having an accuracy value of 75% and lexicon sentiment classification having an accuracy value of 85%. In conclusion, the lexicon approach with the Naive Bayes algorithm is superior to the manual approach because it is more objective, consistent, efficient, and easy to develop and is suitable for analyzing student opinions on campus facilities, thus providing material for consideration in campus policy.

Evaluation of the Development of an Automated Workflow-Based New Student Admission Information System Using a Research and Development Approach

2025-12-21T09:49:52+07:00

The New Student Admissions (PMB) process is a strategic endeavor that influences the quality of university entrants. Nonetheless, in several colleges, particularly in remote regions, the execution of PMB remains manual, which may lead to issues regarding efficiency, accuracy, and openness in data management. This study seeks to create and assess an automated workflow-oriented PMB information system to enhance PMB management at the Muhammadiyah Selayar Institute of Technology, Science, and Business. The system development employs the Waterfall methodology, encompassing the phases of requirements analysis, design, implementation, and system testing. Evaluation is conducted by assessing the validity, practicality, and efficacy of the system with the participation of internal users as evaluators. The evaluation results demonstrated a validity rate of 100%, practicality of 95.83%, and effectiveness of 89.56%, demonstrating the system's feasibility for supporting the PMB process. This system can systematically combine the registration process, document verification, selection, and results announcement. This research contributes an automated workflow implementation model within the PMB information system, enhancing process management efficiency and facilitating the oversight of PMB activities. While the test remains confined to the institution's internal setting, the findings of this study are anticipated to serve as a benchmark for the establishment of a comparable PMB system in universities with analogous attributes.

Implementation of Rapid Application Development and Evaluation of User Experience Questionnaire in Website-Based PKL Registration Information System at UMNU Kebumen

2026-01-01T02:51:08+07:00

Field Work Practice (PKL) as a mandatory curriculum component at Ma'arif Nahdlatul Ulama University (UMNU) Kebumen still faces administrative challenges such as data duplication, non-real-time quota validation, and non-integrated payment verification. Unlike similar systems that focus only on basic registration, this study develops a web-based PKL registration information system by integrating real-time quota validation features and a payment verification mechanism by the treasurer. The system was developed using the Rapid Application Development (RAD) method to accelerate the development process. The system was built with the Laravel framework and MySQL. Functional testing results show that all features run with 100% accuracy. Evaluation using the User Experience Questionnaire (UEQ) on 42 respondents yielded positive scores on six aspects: attractiveness (1.623), clarity (1.524), efficiency (1.655), accuracy (1.589), stimulation (1.601), and novelty (1.244). The system has been proven to optimize the PKL administrative process and can serve as a model for developing integrated systems in higher education institutions.

Evaluation of Web-Based Crystal Ice Distribution Information System Using System Usability Scale (SUS) and User Acceptance Testing (UAT)

2025-12-22T21:27:09+07:00

This study aims to evaluate the usability and user acceptance of a web-based crystal ice distribution information system developed to support the operations of PT Eshokita Tubindo Mandiri. The system was developed using the Waterfall method with stages of requirements analysis, design, implementation, and testing. The system evaluation was conducted using the System Usability Scale (SUS) and User Acceptance Testing (UAT) on 13 respondents who were directly involved in the distribution process. The test results showed a SUS score of 82.11, which is classified as very good, and all system functions were accepted by users based on the UAT results. However, the scope of testing was still limited to one company and a relatively small number of respondents. This study contributes to the evaluation of cold chain distribution information systems based on usability and user acceptance.

Evaluation of Retrieval Methods in Domain-Specific Chatbots Based on Retrieval-Augmented Generation

2026-01-13T13:10:39+07:00

This study evaluated retrieval methods in the implementation of a domain-specific chatbot based on Retrieval-Augmented Generation to improve information accuracy and relevance while reducing hallucination risks. The primary problem addressed was the incorrect selection and prioritization of contextual documents in chatbot systems built on large language models, particularly in technical domains. An experimental approach was applied by comparing three retrieval strategies: lexical retrieval based on term frequency–inverse document frequency, semantic retrieval using vector representations, and a hybrid retrieval method combining lexical and semantic signals. System performance was measured using Recall at different ranking thresholds and Mean Reciprocal Rank to assess both document discovery and ranking quality. The results demonstrated that lexical retrieval achieved the highest precision at the top-ranked position, while semantic retrieval showed reduced effectiveness due to semantic drift in technical documents. The hybrid approach improved mid-range recall performance but still exhibited ranking ambiguity for top-ranked results. These findings indicated that retrieval quality in Retrieval-Augmented Generation systems depended more on effective ranking and context prioritization than on document availability alone. The study concluded that systematic evaluation of retrieval methods was essential for developing reliable domain-specific chatbots.

Evaluation of the Success of Regional Trade Information System Implementation Based on the HOT-Fit Framework and the Technology Acceptance Model

2026-01-13T12:38:34+07:00

The Pangkalpinang City Trade Information System (SIPGK) was developed as a digital instrument to support trade data management and data-driven public information services. This study aims to evaluate the implementation success of SIPGK using the Human–Organization–Technology Fit (HOT-Fit) model, with the Technology Acceptance Model (TAM) employed as a complementary interpretative lens. A qualitative evaluative approach was applied through observation, interviews, and system documentation. The results indicate that the technology aspect demonstrates a system availability rate of 95%, reflecting good system quality and service stability, while the organizational aspect is supported by formal policies and standard operating procedures. However, the human aspect remains a key limiting factor due to disparities in digital literacy and data input consistency, along with suboptimal cross-unit data integration. These findings reveal a gap between technological and organizational readiness and human resource capacity in achieving strategic system utilization. The novelty of this study lies in applying the HOT-Fit model to a regional trade information system context, which has been rarely examined, and in integrating TAM as an interpretative framework to explain user acceptance.