Novel Method for Caption Based Description in Image using Machine Learning

Abstract

The challenging research area of image captioning aims to produce written descriptions that faithfully capture the atmosphere and events captured in a photograph. In order to recognize objects interpret changing conditions and understand the semantic connections within the image advanced machine learning algorithms are required. This study builds an image captioning system using CNN, RNN and ResNet architectures. Here the MSCOCO benchmark dataset is used to enable precise scenario inference with CNN acting as the encoder and RNN as the decoder. By utilizing skip connections and avoiding multiple convolutional layers the system uses ResNet which efficiently utilizes its layers and reduces computation time. This approach resolves the gradient explosion problem and enhances model performance. The proposed model performs better than previous implementations in several evaluation criteria such as BLEU, METEOR, CIDEr and ROUGE. Using the Pillow library the system preprocesses images to enhance brightness and minimize size for optimal training. Additionally the models predicted accuracy is raised by utilizing the TorchVision library. With these enhancements the system can now generate high-quality captions with precise semantic understanding and contextual value.