New technological developments, the availability of big data, and the creation of research platforms open a variety of  opportunities to generate, store, and analyze research data. To ensure the sustainable handling of research data, the European Commission as well as scientific commissions have recently highlighted the importance of implementing a research data management system (RDMS) in higher education institutes (HEI) which combines technical as well as organizational solutions. A deep understanding of the requirements of research data management (RDM), as well as an overview of the different stakeholders, is a key prerequisite for the implementation of an RDMS. Based on a scientific literature review, the aim of this study is to answer the following research questions: “What organizational factors need to be considered when implementing an RDMS? How do these organizational factors interact with each other and how do they constrain or facilitate the implementation of an RDMS?” The structure of the analysis is built on the four components of Leavitt’s classical model of organizational change: task, structure, technology, and people. The findings reveal that the implementation of RDMS is strongly impacted by the organizational structure, infrastructure, labor culture as well as strategic considerations. Overall, this literature review summarizes different approaches for the implementation of an RDMS. It also identifies areas for future research.