Document Type : Research Article


College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.


In a world full of many ideas turning to various kinds of products that need to be protected and here comes the importance of intellectual property rights. Intellectual property has many types however, our interest is in trademarks. The Madrid system is a system used by a group of countries that were in the Madrid level of the agreement so they authorize it and they that has the agreement with them to use but the problem with it that it is a text-based system because of that we proposed a reverse image engine and that is because the reverse search image is better than the text-based system. we have discussed all of the terms and terminology that we need in our project. Along with reviewing the famous reverse-image search engines and the first systems of trademark image retrieval (TIR) and some of the related papers. Introducing our project with all the system analysis phases.
The project approach is a reverse image search engine, it will be designed using a CBIR system with deep neural networks. This project will be implemented in the second semester of the 2020 year.


[1] Rami M Olwan. The history of international intellectual property and development. In Intellectual Property and Development, pages 35–98. Springer, 2012.
[2] W.I.P.O.,n.d. Inside WIPO ,What is WIPO? Available at:, Accessed 05 02 2020.
[3] W.I.P.O.,n.d. Intellectual Property Statistics. Available at: collapse 01, Accessed 05 02 2020.
[4] W.I.P.O.,n.d. Facts and Figures. Available at:, Accessed 05 02 2020.
[5] W. I. P. O., n.d. wipo | madrid, madrid the international trademark system. Available at:, Accessed 05 02 2020.
[6] Supreet Sidhu and Jyoti Saxena. Content based image retrieval a review. International Journal Of Research In Computer Applications And Robotics, 3(5):84–88, 2015.
[7] Hyun-Ho Han, Seuc-Ho Ryu, Gyoo-Soo Chae, and Sang-Hun Lee. Image retrieval using cbir including light position analysis. Wireless Personal Communications, 105(2):525–543, 2019.
[8] Ghanshyam Raghuwanshi and Vipin Tyagi. Impact of feature extraction techniques on a cbir system. In International Conference on Advances in Computing and Data Sciences, pages 338–348. Springer, 2019.
[9] Snehal Mahajan and Dharmaraj Patil. Image retrieval using contribution-based clustering algorithm with different feature extraction techniques. In 2014 Conference on IT in Business, Industry and Government (CSIBIG), pages 1–7. IEEE, 2014.
[10] Mushtaq Ali, Le Dong, Yan Liang, Zongyi Xu, Ling He, and Ning Feng. A color image retrieval system based on weighted average. In 2014 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), pages 184–189. IEEE, 2014.
[11] S Mangijao Singh and K Hemachandran. Content-based image retrieval using color moment and gabor texture feature. International Journal of Computer Science Issues (IJCSI), 9 (5):299, 2012.
[12] Manimala Singha and K Hemachandran. Content based image retrieval using color and texture. Signal & Image Processing, 3(1):39, 2012.
[13] S Sulochana and R Vidhya. Texture based image retrieval using framelet transform-gray level cooccurrence matrix (glcm). International Journal of Advanced Research in Artificial Intelligence, 2 (2):68–73, 2013.
[14] Nitin Jain and Dr SS Salankar. Color & texture feature extraction for content based image retrieval. IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-ISSN, pages 2278–1676, 2014.
[15] Amandeep Khokher and Rajneesh Talwar. Content-based image retrieval: Feature extraction techniques and applications. In International conference on recent advances and future trends in information technology (iRAFIT2012), pages 9–14, 2012.
[16] A Bhagyalakshmi and V Vijayachamundeeswan. A survey on content based image retrieval using various operators. In Proceedings of IEEE International Conference on Computer Communication and Systems ICCCS14, pages 018–023. IEEE, 2014.
[17] Chaudhari Reshma and AM Patil. Content based image retrieval using color and shape features. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering, 1(5):386–392, 2012.
[18] AF Adrakatti, RS Wodeyar, and KR Mulla. Search by image: a novel approach to content based image retrieval system. International Journal of Library Science, 14(3):41–47, 2016.
[19] B Ramamurthy and KR Chandran. Content based image retrieval for medical images using canny edge detection algorithm. International Journal of Computer Applications, 17(6):32–37, 2011.
[20] Wipo ip portal. Available at:, Accessed 2019 12 24.
[21] trademarkengine, n.d. trademarkengine. Available at:, Accessed 05 02 2020.
[22] trademarkengine, n.d. About Trademark Engine. Available at:, Accessed 05 02 2020.
[23] trademarkengine, n.d. free trademark search. Available at:, Accessed 29 12 2014.
[24] Trademarkvision, n.d. Welcome. Available at:, Accessed 05 02 2020.
[25] Trademarkvision, n.d. Home. Available at:, Accessed 05 02 2020. [26] EUIPO european union intellectual property office esearch plus, n.d. eSearch plus The EUIPO’S database access. Available at:, Accessed 2019 12 24.
[27] Trademarkvision, n.d. Powering governments. Available at:, Accessed 05 02 2020.
[28] Australian government ip australia australian trade mark search, n.d. Quick search. Available at: /quick, Accessed 2019 12 24.
[29] Claudio A Perez, Pablo A Est´evez, Francisco J Galdames, Daniel A Schulz, Juan P Perez, Diego Bast´ıas, and Daniel R Vilar. Trademark image retrieval using a combination of deep convolutional neural networks. In 2018 International Joint Conference on Neural Networks (IJCNN), pages 1–7. IEEE, 2018.
[30] Toshikazu Kato, Koreaki Fujimura, and Hiroyuki Shimogaki Nonmember. Trademark: multimedia image database system with intelligent human interface. Systems and computers in Japan, 21(11):33–46, 1990.
[31] Jian-Kang Wu, Chian-Prong Lam, Babu M. Mehtre, Yong Jian Gao, and A Desai Narasimhalu. Content-based retrieval for trademark registration. In Representation and Retrieval of Visual Media in Multimedia Systems, pages 69–91. Springer, 1996.
[32] John P Eakins, Jago M Boardman, and Margaret E Graham. Similarity retrieval of trademark images. IEEE multimedia, 5(2):53–63, 1998.
[33] Michael S Lew. Principles of visual information retrieval. Springer Science & Business Media, 2013.
[34] Stefanos Vrochidis, Anastasia Moumtzidou, and Ioannis Kompatsiaris. Concept-based patent image retrieval. World Patent Information, 34(4): 292–303, 2012.
[35] Zhengkang Chen and Xiaohong Wang. Trademark image retrieval system based on sift algorithm. In 2018 IEEE/ACIS 17th International Conference on Computer and Information Science (ICIS), pages 740–743. IEEE, 2018.
[36] Martin F Porter. An algorithm for suffix stripping. Program, 2006.
[37] Bernhard E Boser, Isabelle M Guyon, and Vladimir N Vapnik. A training algorithm for optimal margin classifiers. In Proceedings of the fifth annual workshop on Computational learning theory, pages 144–152, 1992.
[38] D Dietrich, B Heller, and B Yang. Data science & big data analytics discovering, analyzing, visualizing and presenting data (pp. 420), 2015.
[39] KG Srinivasa, GM Siddesh, and H Srinidhi. Network data analytics: a hands-on approach for application development. Springer, 2018.
[40] Charu C Aggarwal et al. Neural networks and deep learning. Springer, 10:978–3, 2018.