Инфраструктура за създаване на чатбот с големи езикови модели и контекстно разширяване на инструкциите
Infrastructure for Deploying Large Language Models in Chatbots with Retrieval-augmented Generation

Summary/Abstract: The article presents an infrastructure that integrates freely available tools and large language models into a personalized chatbot. The aim is to show how large language models can be used with affordable graphics processors and what possibilities exist to enrich user queries with additional context depending on the objective and area of application. Working with pre-trained large language models will be demonstrated using RAG (Retrieval-Augmented Generation) technology for Bulgarian to solve a specific task in a particular thematic domain. The chosen task is document summarization, and the domain is science and education. The presented solution can also be used to create other applications for the Bulgarian language.

• Details
• Contents