This work in progress paper presents a preliminary analysis on the challenges of knowledge management (KM) experienced in the ERP implementation phase. This paper is an integral section of an ongoing research focusing on the role of KM during the ERP implementation lifecycle in both large and medium organizations in South Africa. One of the key research objectives is to investigate the core challenges of KM in large and medium organizations in South Africa. A review of the existing literature reveals a lack of comprehensive KM research during the different ERP implementation phases and particularly, in emerging economies. Initial findings include lack of process, technical and project knowledge as key challenges. Other concerns include poor understanding of the need for change, lack of contextualization and management support. This paper closes some of the identified research gaps in this area and should benefit large organizations in the South African economy.