Uganda started the implementation of Universal Primary Education (UPE) policy in 1997, purposely to allow access to all children of school-going age. However, during the implementation phase, many institutional and structural issues emerged that impacted the quality of education provided. This paper focuses on the views of a common man on the quality of education and particularly UPE in Uganda. In other words, how doses a common man who goes about his daily businesses in the markets, on the streets (informal sector) hustling to make ends meet, including payment of school dues view the quality of primary education in Uganda? Data was collected using interviews and focus group discussions (FGDs) from a total of 110 respondents spread across the five divisions of Kampala Capital City Authority (KCCA) area. Results indicate that the common man is fully aware that the different challenges affecting UPE have compromised its quality; and these range from inadequate funding by the government, corruption by government officials both at national and local levels but also headteachers and teachers in schools to issues of insufficient infrastructure in schools, absenteeism by both pupils and teachers and a curriculum that is not focused on local realities and needs. All these challenges in the eyes of the common man have affected the quality of UPE in Uganda. As a way forward, the paper recommends that there is a need for government to review the entire UPE policy with a view to understanding the implementation challenges in detail and seek for solutions. The curriculum too needs to be reviewed to match the community needs. Equally important, government needs to increase education budget and fully fund the education sector.