Augmented Reality on Sudoku Puzzle using Computer Vision and Deep Learning
Azhar Talha Syed1, Suresh Merugu2

1Azhar Talha Syed, Department of Computer Science and Engineering, CMR College of Engineering & Technology, Hyderabad (Telangana), India.

2Suresh Merugu, Research and Development Centre, CMR College of Engineering & Technology, Hyderabad (Telangana), India.

Manuscript received on 05 September 2019 | Revised Manuscript received on 14 September 2019 | Manuscript Published on 26 October 2019 | PP: 140-145 | Volume-8 Issue-11S2 September 2019 | Retrieval Number: K102209811S219/2019©BEIESP | DOI: 10.35940/ijitee.K1022.09811S219

Open Access | Editorial and Publishing Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open-access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)

Abstract: Many people try solving Sudoku puzzles everyday. These puzzles are usually found in newspapers, magazines and so on. Whenever a person is unable to solve a puzzle or is running short on time to solve the puzzle, it will be very convenient to show the solved puzzle as an augmented reality. Objectives: In this paper, we propose an optimal way of recognizing a Sudoku puzzle using computer vision and Deep Learning, and solve the puzzle using constraint programming and backtracking algorithm to display the solved puzzle as augmented reality. Also, a comparative performance analysis with the previous work is provided with this paper. Methods: In order to implement augmented reality on to the Sudoku puzzle, image classification itself won’t be sufficient as the solved puzzle has to be shown on top of the area of the unsolved puzzle in the original image. So puzzle detection has to be performed and for doing so we used CNN and Object Localization algorithms. After the detection we stored the values detected in each 9×9 cells and ran a constraint programming and backtracking algorithm to solve the puzzle and finally filled the detected empty cells with correct values of the solved puzzle. Applications/Improvements: Usually the Sudoku puzzles that we find in newspapers and magazines are surrounded by a lot of noise such as text (characters) irrelevant to the puzzle and borders of the newspaper which could be similar to a Sudoku puzzle structure. In this paper we emphasise on how to handle such disturbances and improve the performance.

Keywords: Object Localization, Sudoku, CNN, Augmented Reality, Computer Vision.
Scope of the Article: Deep Learning