Generative AI-based Style Recommendation Using Fashion Item Detection and Classification

dc.contributor.advisorAnbarjafari, Gholamreza, juhendaja
dc.contributor.advisorJafari, Akbar A., juhendaja
dc.contributor.authorKalinin, Aleksandr
dc.contributor.otherTartu Ülikool. Loodus- ja täppisteaduste valdkond
dc.contributor.otherTartu Ülikool. Tehnoloogiainstituut
dc.date.accessioned2024-06-17T11:42:52Z
dc.date.available2024-06-17T11:42:52Z
dc.date.issued2024
dc.description.abstractThis thesis describes the creation of a cutting-edge style recommendation system that uses generative AI and deep learning approaches to analyse fashion photos. The system is intended to process input images, such as selfies or studio-quality photos, and output a text file with extensive feedback on the individual’s style and suggestions for improvement. The system consists of two main components: the YOLOv8 convolutional neural network, which detects and crops clothing items, and the GPT-4.0 large language model, which generates informative style commentary and recommendations. YOLOv8 is briefly trained on a specific dataset to improve its performance in recognising 10 different types of clothes, while GPT-4.0, which is accessible via the OpenAI API, is charged with giving cohesive and short style suggestions. To evaluate the success of the suggested solution, real experimental trials were conducted at many events in Madrid and Tallinn. Three well-known AI models were used for comparison: OpenAI’s GPT-4.0 Vision, Google’s Gemini 1.5 Pro, and Anthropic’s Claude 3 - Opus. Participants judged the quality of each model’s fashion recommendations. The results showed that GPT-4.0 Vision and Gemini 1.5 Pro had comparable average ratings, indicating higher perceived quality than Claude 3 - Opus. This thesis demonstrates how cutting-edge computer vision and natural language processing technology may transform personalised fashion advising services, improving accuracy and relevance of style recommendations.
dc.identifier.urihttps://hdl.handle.net/10062/99883
dc.language.isoen
dc.publisherTartu Ülikool
dc.rightsAttribution-NonCommercial-NoDerivs 3.0 Estoniaen
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/ee/
dc.subjectGenerative AI
dc.subjectDeep learning
dc.subjectObject detection
dc.subjectImage processing
dc.subjectFashion
dc.subject.otherbakalaureusetöödet
dc.titleGenerative AI-based Style Recommendation Using Fashion Item Detection and Classification
dc.title.alternativeGeneratiivne AI-pohine stiilisoovitus, mis kasutab moesemete tuvastamist ja klassifitseerimist
dc.typeThesis

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
AleksandrKalinin_ST.pdf
Size:
4.47 MB
Format:
Adobe Portable Document Format