For the purposes of this guide, text and data mining (TDM) refers to actions including scraping, data mining, data extraction and data harvesting. The ability to do TDM through W&M Library subscriptions varies by vendor. Some vendors/publishers allow users to do so with few restraints, some require written permission to be sought (then grant either paid or free access), and others entirely forbid it. W&M Libraries advocates for TDM rights in all of our contracts but are not always successful. Please check the policy of the relevant database or publisher before you download any data from them for the purposes of text or data mining. Avoid web scraping or downloading large amounts of content from databases to which the library subscribes, especially if you have not sought prior permission. Failure to comply may lock you out of the content and may jeopardize other library users' access.
All library database subscriptions prohibit commercial use.
ABC-CLIO
Access method: None. TDM is not permitted
For more information: Email databases@abc-clio.com
Adam Matthew
Access method: FTP or direct website access, both require permission of vendor
For more information: Visit Adam Matthew Text and Data Mining
Association for Computing Machinery
Access method: Vendor-provided API, no cost to user
For more information: Email dl-team@hq.acm.org
ACS (American Chemical Society)
Access method: None. TDM is not permitted
For more information: Email help@cas.org
Bloomberg
Access method: None. TDM is not permitted.
Cambridge University Press
Access method: Cambridge does not currently provide access to Content via an API. If you would like to carry out programmatic or large-scale downloading which may be affected by technical protection measures, or if you need delivery of content in specific formats, please contact openresearch@cambridge.org.
For more information: Email openresearch@cambridge.org
Digital Theatre Plus (DT+)
Access Method: Not specified, but TDM is allowed per license
For more information: Email support@digitaltheatreplus.com
Dow Jones (Factiva)
Access method: None. TDM is not permitted under current license.
For more information: Advanced Analytics and Data Mining
EBSCO
Access method: None. TDM is not permitted.
For more information: Contact EBSCO
Elsevier
Access method: API through Elsevier Developer Portal
For more information: Elsevier text and data mining policy
Factiva
Access method: None. TDM is not permitted
For more information: Advanced Analytics and Data Mining
IEEE [Institute of Electrical and Electronics Engineers]
Access method: Sign in or register for an IEEE account to obtain an API key. A summary of the TDM project will be required before an API key is issued. Please note the database does not provide access to full-text metadata via API.
For more information: Currently Available APIs
IOP Institute of Physics
Access method: TDM access can be arranged by request.
For more information: Text and Data Mining Policy
O'Reilly
Access method: None. TDM is not permitted
For more information: Email legal@oreilly.com
Oxford University Press
Access method: TDM is allowed if researcher provides details of the intended activity via an email to Data.Mining@oup.com and completes questionnaire provided by publisher if requested to do so. Copies of any publications downloaded must be promptly destroyed once it is no longer necessary. Other rules and regulations may apply.
For more information: Email Data.Mining@oup.com
PLOS
Access method: Bulk download from https://allof.plos.org/allofplos.zip or visit https://api.plos.org/
For more information: PLOS Text and Data Mining
ProQuest (see TDM Studio)
Refinitiv
Access method: None. TDM is not permitted
For more information: Email Legal.IP@refinitiv.com
S&P Global
Access method: None. TDM is not permitted.
For more information: Customer Care
Sage
Access method: Users must agree to the terms of use and re-use detailed in the standard text and data mining license.Downloading articles from Sage Journals for the purposes of text and data mining is expressly permitted in the standard license agreements and terms of use for no extra fee. You do not need to ask permission to systematically download articles provided that you abide by downloading limits. Sage also includes Text and Data Mining license and full-text URL information via the CrossRef Public API. Guidance on using the CrossRef Public API is available in the Text and Data Mining for Researchers page on the Crossref website.
For more information: Text and Data Mining on Sage Journals or email: onlinesupport@sagepub.co.uk
ScienceDirect (see Elsevier)
Scopus (see Elsevier)
Springer Nature
Access method: Content may be downloaded for TDM directly from SpringerLink, and downloading may be automated for that purpose; Springer APIs may be used to identify desired content for download.
For more information: Springer Nature TDM policy or email: Tdm@springernature.com.
Taylor and Francis
Access method: TDM access can be arranged by request, users should contact support@tandfonline.com
For more information: Text and Data Mining
TDM Studio
Coverage: TDM Studio is a cloud-based text and data mining solution that allows users to analyze text and data from licensed Proquest content, including: newspapers, scholarly articles, dissertations, theses, and government databases. The platform allows users to use their preferred data analysis methods in a coding workbench in Jupyter Notebook Environment, or a pre-defined data visualization module with no coding experience required
Access method: wm.edu email account required. Visit https://tdmstudio.proquest.com, and click "Create Account" button. Follow instructions to finalize account setup.
For more information: Email TDMStudio@clarivate.com.
Wiley
Access method: API. Academic subscribers can use their ORCID ID to obtain an API token which allows access to subscribed content once accepted the Wiley click-through TDM license and received the API token. The token enables Wiley to verify that the individual has agreed to Wiley Terms and Conditions. Can also use the Crossref API as an intermediary to access Wiley full-text abstracts and pdfs.
Further Information: Wiley Text and Data Mining or email TDM@wiley.com