Methods of Fine-Tuning of Artificial Intelligence

Authors

  • O. V. Kudryk Vinnytsia National Technical University
  • O. V. Bisikalo Vinnytsia National Technical University
  • Yu. S. Zditovetskiy Vinnytsia National Technical University

DOI:

https://doi.org/10.31649/1997-9266-2024-175-4-139-146

Keywords:

learning methods, fine-tuning, artificial intelligence, machine learning, models, data analysis, chat GPT

Abstract

Approaches to fine-tuning of artificial intelligence based on two proposed methods are considered. For this purpose, a review of the main methods of retraining artificial intelligence was carried out, their advantages and disadvantages were determined. The proposed methods have their own characteristics, each of them is suitable for different types of tasks.

The "Step-by-Step" method is based on multiplying the information entered into the AI verif дication model and consolidating this information at each stage of training. Using this approach, it becomes possible to detect errors at the early stages and provide additional information to the model, which allows the artificial intelligence to learn the material better.

In its turn, the "All at once" method simultaneously introduces a large amount of information to the AI model at the initial stage, after which the verification of the fixed information begins by placing questions. This approach can be effective for tasks that require rapid learning and need complex comprehension of large amounts of information.

Each of the methods has its advantages and disadvantages, the effectiveness of each of them may vary depending on the specific context of application. The Step-by-Step method allows the AI to learn the details better, but may require more time and resources. The "All at once" method allows to achieve results faster, but it can lead to a superficial understanding of the material and increase the number of errors.

In this work, a schematic block of each of the two methods was developed, a comparative analysis of the effectiveness of these methods was carried out using the example of fine-tuning the ChatGPT model. An experimental approbation of the AI training process was carried out based on each of the methods, due to which a comparative assessment of the effectiveness of the results of fine-tuning was performed and appropriate conclusions were drawn. The results of the study can be useful for developers and researchers working in the field of artificial intelligence and can help to use a better method of retraining for specific tasks.

Therefore, modified methods of fine-tuning of artificial intelligence have been studied, which allow using a smaller amount of resources and obtaining high accuracy and efficiency of work for specific tasks.

Author Biographies

O. V. Kudryk, Vinnytsia National Technical University

Post-Graduate Student with the Chair of Automation and Intelligent Information Technologies

O. V. Bisikalo, Vinnytsia National Technical University

 Dr. Sc. (Eng.), Professor, Head with the Chair of Automation and Intelligent Information Technologies

Yu. S. Zditovetskiy, Vinnytsia National Technical University

Post-Graduate Student with the Chair of Automation and Intelligent Information Technologies

References

М. Мар’єнко, і В. Коваленко «Штучний інтелект та відкрита наука в освіті,» Фізико-математична освіта, № 1, с. 48-53, 2023.

N. Lore et al., “Large model strategic thinking, small model efficiency: transferring theory of mind in large language models,” arXiv preprint arXiv:2408.05241, 2024.

J. Cheonsu, “Fine-tuning and utilization methods of domain-specific llms,” arXiv preprint arXiv:2401.02981. 2024.

R. Mathav et al., “Fine tuning llms for enterprise: practical guidelines and recommendations,” arXiv preprint arXiv: 2404.10779, 2024.

H. Sun, “Supervised fine-tuning as inverse reinforcement learning,” arXiv preprint arXiv:2403.12017, 2024.

H. Mentzingen et al., “Textual similarity for legal precedents discovery: Assessing the performance of machine learning techniques in an administrative court,” International Journal of Information Management Data Insights, no. 4(2), p.100247, 2024.

Y. Xie et al., “Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 23715-23724, 2023.

Fine-tuning – OpenAI platform. [Electronic resource]. Available: https://platform.openai.com/docs/guides/fine-tuning .

API Reference – OpenAI API. [Electronic resource]. Available: https://platform.openai.com/docs/api-reference .

Oracle APEX Documentation. [Electronic resource]. Available: https://docs.oracle.com/en/database/oracle/apex/index.html .

НМТ онлайн 2024 року з хімії – демоваріант, сайт ЗНО. Освіта.UA. [Електронний ресурс]. Режим доступу: https://zno.osvita.ua/chemistry/574/ .

НМТ онлайн 2024 року з української мови – демоваріант, сайт ЗНО. Освіта.UA. [Електронний ресурс]. Режим доступу: https://zno.osvita.ua/ukrainian/568/ .

ЗНО онлайн 2021 року з географії – основна сесія, сайт ЗНО. Освіта.UA. [Електронний ресурс]. Режим доступу: https://zno.osvita.ua/geography/476/ .

Downloads

Abstract views: 25

Published

2024-08-30

How to Cite

[1]
O. V. Kudryk, O. V. Bisikalo, and Y. S. Zditovetskiy, “Methods of Fine-Tuning of Artificial Intelligence”, Вісник ВПІ, no. 4, pp. 139–146, Aug. 2024.

Issue

Section

Information technologies and computer sciences

Metrics

Downloads

Download data is not yet available.