Evaluating the Performance of LLMs in Drafting Data Management Plans

Most funders now require Data Management Plans (DMPs) to be submitted as part of a grant proposal. A DMP is a document that describes how researchers will manage, preserve, and share data from their projects in line with the Findable, Accessible, Interoperable, and Reusable (FAIR) principles and other relevant disciplinary guidelines. Its aim is to ensure researchers plan in advance for effective data management and sharing. Preparing a DMP can be difficult for researchers because they often lack training and knowledge in data management practices. Librarians are available to assist at larger institutions, but they face similar challenges and do not always have the resources to assist with all aspects of a DMP. Open-source platforms like DMPTool provide funder guidance, sample DMPs, and templates, but researchers and librarians still need to manually complete sections that vary based on domain and funder requirements.