UMK
1About
Transforming Public Access to Information with Semantic Search
Profil Software partnered with the City of Krakow to enhance its public information bulletin (BIP), which contains over 1.6 million documents in various formats (HTML, Word, PDF). The existing search engine allowed users to input keywords and search documents, but it didn’t allow questions or semantic search. The goal of the project was to implement a semantic search engine based on Retrieval-Augmented Generation (RAG). This solution would allow users to ask questions and receive AI-generated responses, along with the relevant documents used to formulate the answer, providing a more intuitive and efficient way to access public information.
2Challenge
The project presented two significant challenges. The vast amount of documents (over 1.6 million) necessitated the creation of a vector database for efficient search capabilities. Managing such a large dataset required robust infrastructure and scalable solutions. Additionally, the team committed to using open-source models, running them on custom-configured hardware (GPUs), rather than relying on ready-made solutions from providers like OpenAI. The second problem was that many AI models are optimized for languages like English, French, or Spanish, but less so for Polish. This meant the team needed to identify or adapt models that could effectively handle the nuances of the Polish language. A benchmarking process was employed to ensure that the models selected would perform accurately in Polish.
3Solution
To address these challenges, Profil Software implemented a multi-faceted approach. The team developed a framework for continuous benchmarking, where various components of the RAG application (such as the LLM or data embedding models) were tested for accuracy, context relevance, and document alignment. This iterative process ensured constant optimization of the system to meet project goals. The solution was built using a microservice architecture with three core services: Web, NLP, and ETL (Extract, Transform, Load), all hosted on Kubernetes. This approach enabled deployment both on cloud infrastructure and the City of Krakow's on-premise servers. The vector database was built on top of PostgreSQL using the pgvector extension hosted in Kubernetes cluster. This decision significantly reduced operational costs while ensuring flexibility.With this comprehensive approach, we delivered a highly efficient, scalable, and cost-effective AI-powered search solution tailored to the unique needs of the City of Krakow’s public information system.
4Technologies
5Services
“We are a cybersecurity startup in a highly specialized field of work. In Profil, we have found a partner that has been able to meet our demanding requirements and become a true extension to our core team. Profil’s technical proficiency, communication, and the streamlined SDLC process have been superb. We look forward to our continued partnership.”
“It was most impressive that the company embraced my app as well as developed it. Profil Software was able to translate my needs as a meditation teacher into functionality within the app.”
“We were an early-stage startup that had an idea, and working with Profil, we were able to get an MVP launch quickly. The expertise of the team is phenomenal - depth of knowledge on backend development, and rapid iteration on frontend work. We have been working with Profil for over 2 and a half years now and will continue to do so into the future.”
“The collaboration with Profil Software has permitted key in-house staff to work on company management, freeing up their time and ensuring deliverables are produced much quicker. They are a fantastic team, with excellent skills, effective methodologies, and good suggestions.”
“…Profil Software picked up our processes quickly.
They’re willing to learn new things and offer great insights.
The solutions improve the client’s speed and accuracy of performing tasks, and a new form of testing ensures fewer bugs, better uptime, and happier customers.”
Let's talk!
Profil Software will help you pick the right team for your software development. Book an appointment and tell us what you need!
Other projects
Tarot Routing
Route Planning and Optimization SoftwareTarot Routing uses state-of-the-art algorithms to plan more efficient last-mile driving routes faster than humans can. Customers reduce their driving time by 30%, and of course reduce their CO₂ emissions, petrol consumption, driver salaries and maintenance costs.