NDL contains text of content in LexisNexis, focusing on news (newspapers, newswires, industry trade press, magazines, etc.), company and financial, and dockets. NDL allows for cloud access to search, analysis, and visualization; and it provides ways to export your findings. The platform provides a Jupyter Notebook environment, supporting both R and Python code. UC San Diego currently has a small number of Nexis Data Lab accounts for use by faculty and students. To request access to an account, contact Data Science Librarian Stephanie Labou
More than 200 licensed ProQuest content products, including government, archival, dissertation, and news databases, are available for analysis with R or Python through ProQuest TDM Studio. Contact Stephanie Labou (slabou@ucsd.edu) for additional assistance. Includes the ability to text mine the Wall Street Journal.
To create an account:
1. Go to https://tdmstudio.proquest.com
2. Click “Create an account” button
3. Use your UCSD email address to create your account.
Explore UCSD holdings from Gale Primary Sources using digital humanities tools. Rediscover and interpret the past through analysis and visualization of historical texts, including newspapers, books, archival collections, and more. (Create your personal DSL account online to begin selecting and analyzing materials. Be sure to be on VPN if off campus for account to work properly.) Learn more via tutorials and recorded webinars
Datastream's ESG Data
The Refinitiv ESG data is hosted on Refinitiv Workspace. Once you register, go to the Apps Library and type ESG to see what is available to use.
Although Workspace primarily provides financial and economic data, news, equity reports, and company & industry analysis, it also features unique content about companies’ ESG performance, sustainable leadership monitoring (SLM), and peer analysis. First-time users register here, https://my.refinitiv.com/productregistration.html (ESG data is in the basic license, called “Workspace for Students”).
RW is only available to UC San Diego students, faculty, and staff; only for non-commercial, academic research. It replaces ThomsonONE/Investext and Datastream, and now works across several browsers.
Register only once; otherwise login to Workspace using the main link. You may use web or desktop app version (includes the Workspace add-in for Excel), once you are registered.
1973-present. Huge database of citations to statistical publications from U.S. federal and state governments, international agencies, nonprofit and educational institutions, and private publishers including trade and industry groups. Full text of the publication or report is often included, and many tables are downloadable in Excel. Particularly good for demographic and country-level information. Previous name Statistical Universe.
As of 2020, subscription includes:
Statistical Insight Tables
Statistical Insight Statistical Reference Index Full Text
Statistical Insight American Statistics Index Abstracts and Indexing ONLY (no current full text)
ProQuest Statistical Insight IIS Abstracts and Indexing Web Service (no current full text)
ProQuest Statistical Insight SRI Abstracts and Indexing Web Service
Financial and economic data covering over 150 countries and over 6,500 historical and current data series. Bonds, T-bills, unemployment, GDP, commodity prices, exchange rates, and more, some dating back to 1900. Note: To access, use the “Login Anonymously” option and choose GFDatabase in the left nav bar.
WRDS provides access to selected datasets in the fields of finance, accounting, banking, economics, management, marketing and public policy. ACCESS: UC San Diego faculty, staff and students first must sign up for a WRDS account by using the Register link on the landing page. LIMITATIONS: Masters & Undergraduate students do not have access during summer or quarter breaks. UC San Diego affiliates without AD network accounts are ineligible for WRDS accounts (most Extension students are in this category). In those cases, Mergent Online and Global Financial Database are your recommended alternatives.
Currently includes (as of 9/14/2021):
Bank Regulatory Database
Blockholders Database
CBOE (Chicago Board Options Exchange)
S&P Compustat Bank
Compustat Bank - daily updates
S&P Compustat Global
Compustat Global - daily updates
Compustat Legacy - Global
S&P Compustat North America - annual update (current + historical data)
Compustat North America - daily updates (current + historical data)
Compustat Legacy - North America
S&P Compustat North America - monthly update (current + historical data)
S&P Compustat Historical Segments
Compustat Historical Segments - daily updates
Contributed Data - Characteristic Returns
Contributed Data
Contributed Database: Intangible Value
KPSS Technological Innovation
Contributed Database: LIVA
CRSP/Compustat Merged (Annual)
CRSP Indexes (Annual)
CRSP Stock (Annual)
CRSP Treasuries (Annual)
CRSP Ziman Real Estates (Annual)
CRSP Index History Intraday (Quarterly)
Dow Jones Averages & Total Return Indexes
Direct Marketing Educational Foundation
SEC Disclosure of Order Execution Statistics
Fama-French portfolios and factors
Federal Judicial Center Linking
Federal Judicial Center Litigation
Federal Reserve Board Foreign Exchange Rates, Interest Rates, and State Composite Indexes
Macro Finance Society
MSRB - Municipal Securities Transaction Data
OTC Markets End-of-Day Pricing
Philadelphia Stock Exchange Currency Options and Implied Volatility
Publicly Available Data
The Penn World Tables Database
Research Quotient (provided to all academics with a Compustat subscription)
NYSE Trades & Quotes 1993
NYSE Trades & Quotes 1994
NYSE Trades & Quotes 1995
NYSE Trades & Quotes 1996
NYSE Trades & Quotes 2014
NYSE Trades & Quotes - Exists for FK contraint
NYSE Trades and Quotes - for website use
NYSE Millisecond Trades & Quotes 2014
NYSE Millisecond Trades & Quotes 2015
NYSE Millisecond Trades & Quotes 2016
NYSE Millisecond Trades & Quotes 2017
NYSE Short Sales 2005
NYSE Short Sales 2006
NYSE Short Sales 2007
Total q by Luke Taylor
FINRA TRACE Enhanced
FINRA TRACE corporate bond trades
WRDS Research Applications
WRDS Backtest Basic
WRDS Beta Suite
WRDS Efficient Frontier
WRDS EU Short Sales
Event Study Intl using Compustat
Event Study Intraday
Event Study Long Run
Event Study US
WRDS Financial Ratios (base)
WRDS Financial Ratios with CCM
Linking Suite: Bond - CRSP
Linking Suite: TAQ Monthly - CRSP
Linking Suite: TAQ Daily - CRSP
Linking Suite: Supply Chain
WRDS Patent Database
WRDS SAS Visual Analytics
WRDS Company Subsidiaries
WRDS World Indices
MIDAS
Access Datastream content online via Refinitiv Workspace. Additionally, you may register for the Datastream add-on to do graphical exploration of trends and relationships between series. Datastream provides time series for over a million financial instruments, securities, and economic indicators from over 175 countries. Workspace content also includes company profiles, ESG performance, indices, bonds, commodities, interest and exchange rates, estimates, futures and options, country macroeconomics, market research and investment house reports. New users complete self-registration here - https://my.refinitiv.com/productregistration.html
The Inter-University Consortium for Political and Social Research. World's largest archive of social science data. Election data, opinion polls, more. Special collections on Health, Education, Aging, Crime, Substance Abuse. Raw data; no tables. To download data, create a personal account using your ucsd.edu email address while accessing the database from a UC San Diego computer, UCSD-PROTECTED wireless, or the VPN.
Provides easy access to statistical data. Data is downloadable in Excel and CSV, and shapefiles when multiple geographies are covered. Sources include: Bombay Stock Exchange, British Bankers' Association, Chicago Board Options, Exchange, China Data Center, D&B (Dun & Bradstreet), Dave Leip's Atlas of US Presidential Elections, Defense Manpower Data Center, Deutsche Börse Group, Dow Jones, Easy Analytic Software Inc. (EASI), Eurostat, FTSE Group, HSI Services Limited (Hong Kong), International Monetary Fund, London Bullion Market Association , London Platinum & Palladium Market, NASDAQ OMX Group, National Bureau of Economic Research, Nikkei, Organisation for Economic Co-operation and Development, Shanghai Stock Exchange, Standard & Poor's, World Bank, World Resource Institute, Xignite, and many US Federal agencies. See the Data-Planet Libguides for more detail.
UC San Diego subscribes to Nielsen marketing data from the Chicago Booth School of Business. The James M. Kilts Center for Marketing at Chicago Booth and the Nielsen Company have partnered to make four datasets available to US-based academic researchers. There are special restrictions on data access and use. Read the instructions before requesting access.
Congressional Bills; Bill Status; Bill Summaries; Commerce Business Daily; Code of Federal Regulations (Annual Edition); Electronic Code of Federal Regulations; Federal Register; United States Government Manual; House Rules and Manual; Privacy Act Issuances; Public Papers of the Presidents of the United States; Supreme Court Decisions 1937-1975 (FLITE)
Monitors the world's broadcast, print, and web news from nearly every corner of every country in over 100 languages and identifies the people, locations, organizations, counts, themes, sources, emotions, counts, quotes, images and events driving our global society every second of every day, creating a free open platform for computing on the entire world. Download data on country-level newsworthy events back to 1979, updated every 15 minutes.
SimplyAnalytics is a web-based mapping application that lets users quickly create professional-quality thematic maps and reports using demographic, business, and marketing data for the United States. Access limited to 5 simultaneous users. Try again later if refused. Includes EASI/MediaMark Research Incorporated (MRI) and Simmons LOCAL data packages. (formerly known as SimplyMap).
The predominate software in GIS is ArcGIS by Esri. It can be expensive and has a learning curve for users, but is extremely robust and as noted, is predominate in the GIS industry. Can be used in a desktop, server or web environment.
ArcGIS Business Analyst provides location-based intelligence for planning, site selection, and customer segmentation. Combine demographic, lifestyle, and spending data with map-based analytics for accurate reports and dynamic presentations. It is available as a web browser SaaS solution or as a desktop-based tool. First you should register for an ArcGIS account here.
Browse these annual volumes to get ideas. They include a 'best in breed' compilation from users, and cover topics from business and economics as well as government, health, naturual resources, transportation, utilities and more.
Research Methods & Tools
Sage Research MethodsIncludes books, reference works and journal articles from across the social sciences research methods, including a large collection of qualitative methods books. The resources cover every aspect of research skills training and can help researchers at all levels through every step of the research process, from coming up with a research question, doing a literature review, planning a project, collecting and analyzing data, and writing up a report, dissertation or thesis. Also included are SRM Cases (stories of how real research projects were conducted) and SRM Datasets (a collection of teaching datasets and instructional guides that give students a chance to learn data analysis by practicing themselves).
Text Mining and Visualization by Markus Hofmann (Editor); Andrew Chisholm (Editor)This book introduces text mining by using popular open-source tools: KNIME, RapidMiner, Weka, R, and Python. The contributors, who are experienced with text mining and open-source software, explain how text data are gathered and processed from a wide variety of sources, including books, server access logs, websites, social media sites, and message boards. Each chapter presents a case study that you can follow as part of a step-by-step, reproducible example. You can also easily apply and extend the techniques to other problems.
Free programmatic access to stocks, ETFs, mutual funds, foreign exchange rates, financial reports from SEC filings, and over 50 derived technical indicators. Free API key allows up to 500 API calls per day by default. More information: (1) introduction to stock APIs, (2) official API documentation
API access to Cornell's open-access arXiv e-print repository, used primarily by physics, mathematics and computer science communities to share cutting-edge research.
Crossref is a not-for-profit membership organization for scholarly publishing who works to make content easy to find, cite, link, and assess. The Crossref API allows researchers to easily harvest full-text documents from all participating members, regardless of whether the content is open access or subscription.Explanatory slides
The OECD dataset APIs let you programmatically access a selection of our top used datasets covering data for OECD countries and selected non-member economies. OECD datasets are dynamically updated.
Access data from the United Nations Commodity Trade Statistics database, including International Merchandise Trade Statistics (IMTS) and the work of the International Merchandise Trade Statistics Section (IMTSS) of the United Nations Statistics Division. Sign in required to access developer tools including API.
Three APIs to provide access to different datasets: one for Indicators (or time series data), one for Projects (or data on the World Bank’s operations), and one for the World Bank financial data (World Bank Finances API).
This link opens in a new window
Text Mining and Visualization by
This book introduces text mining by using popular open-source tools: KNIME, RapidMiner, Weka, R, and Python. The contributors, who are experienced with text mining and open-source software, explain how text data are gathered and processed from a wide variety of sources, including books, server access logs, websites, social media sites, and message boards. Each chapter presents a case study that you can follow as part of a step-by-step, reproducible example. You can also easily apply and extend the techniques to other problems.
