Text Mining and Visualization
by
This book introduces text mining by using popular open-source tools: KNIME, RapidMiner, Weka, R, and Python. The contributors, who are experienced with text mining and open-source software, explain how text data are gathered and processed from a wide variety of sources, including books, server access logs, websites, social media sites, and message boards. Each chapter presents a case study that you can follow as part of a step-by-step, reproducible example. You can also easily apply and extend the techniques to other problems.
Mapping texts: computational text analysis for the social sciences
by
Data that is represented here includes: stocks/equities; bonds; mutual funds; market indices; commodities; derivatives; foreign exchange; interest rates and company financials.
Financial and economic data covering over 150 countries and over 6,500 historical and current data series. Bonds, T-bills, unemployment, GDP, commodity prices, exchange rates, and more, some dating back to 1900. Note: To access, use the “Login Anonymously” option and choose GFDatabase in the left nav bar.
This resource replaces Mergent Online in June 2025. It provides access to company financials, ratios, business segments, descriptions, sustainability, officers and directors. It is especially useful for company, industry, index, ESG and economic data views, SEC filings, and other reports.
Workspace provides financial and economic data, news, equity reports, and company & industry analysis. Its international in scope and covers both public and private company information. Workspace is most often used for investment analysts’ reports, public company financials & filings, business news, economic indicators, stock prices, and data, and a variety of instruments (bonds, commodities, currencies, ETFs, futures, indexes, options and more). Unique content includes ESG data, performance forecasts & consensus estimates, deals & transactions (M&A, IPOs, venture capital & private equity). Download limit of 150 pages per day, reset daily at midnight local time. New users complete self-registration here - https://my.refinitiv.com/productregistration.html
CEIC Data contains economic, industrial and financial time-series data. Access limited to 5 simultaneous users. Try again later if refused.
Four databases are included in this package:
• China Premium Databases
The China Premium Database offers over 415,000 time-series records on macroeconomic, sector, industry and regional data dating back to 1949. The China Premium Database is available in both English and Chinese.
• Brazil Premium Databases
The Brazil Premium Database covers 13 macroeconomic and 13 industry growth sectors with unmatched coverage of the energy, biofuel, and automobile sectors. Regional data are also available for Brazil's 5 regions, all 27 states, and 6000 municipalities.
• Global Database
CEIC Data’s Global Database provides access to granular macroeconomic data covering both developed and emerging markets covering over 200 economies and is ideal for business students, professors and lecturers for macroeconomic research projects and course assignments.
• Daily Database
Provides economic studies, company & industry reports, country risk, economic and industrial statistics, and political news with a focus on emerging market countries. Covers public & private companies & global industry reports. Includes interactive data analysis tools & news alerts. Excellent China coverage.
Explore UCSD holdings from Gale Primary Sources using digital humanities text and data mining tools. No coding required! Rediscover and interpret the past through analysis and visualization of historical texts, including newspapers, books, archival collections, and more. (Create your personal DSL account online to begin selecting and analyzing materials. Be sure to be on VPN if off campus for account to work properly.) Learn more via tutorials and recorded webinars
The sources in this category span several disciplines, however, include economic data. These sources may also be listed under more specific topics in this guide.
CEIC Data contains economic, industrial and financial time-series data. Access limited to 5 simultaneous users. Try again later if refused.
Four databases are included in this package:
• China Premium Databases
The China Premium Database offers over 415,000 time-series records on macroeconomic, sector, industry and regional data dating back to 1949. The China Premium Database is available in both English and Chinese.
• Brazil Premium Databases
The Brazil Premium Database covers 13 macroeconomic and 13 industry growth sectors with unmatched coverage of the energy, biofuel, and automobile sectors. Regional data are also available for Brazil's 5 regions, all 27 states, and 6000 municipalities.
• Global Database
CEIC Data’s Global Database provides access to granular macroeconomic data covering both developed and emerging markets covering over 200 economies and is ideal for business students, professors and lecturers for macroeconomic research projects and course assignments.
• Daily Database
Provides easy access to statistical data. Data is downloadable in Excel and CSV, and shapefiles when multiple geographies are covered. Sources include: Bombay Stock Exchange, British Bankers' Association, Chicago Board Options, Exchange, China Data Center, D&B (Dun & Bradstreet), Dave Leip's Atlas of US Presidential Elections, Defense Manpower Data Center, Deutsche Börse Group, Dow Jones, Easy Analytic Software Inc. (EASI), Eurostat, FTSE Group, HSI Services Limited (Hong Kong), International Monetary Fund, London Bullion Market Association , London Platinum & Palladium Market, NASDAQ OMX Group, National Bureau of Economic Research, Nikkei, Organisation for Economic Co-operation and Development, Shanghai Stock Exchange, Standard & Poor's, World Bank, World Resource Institute, Sharadar, and many US Federal agencies. See Sage's Sage Data LibGuide for more detail. If you are having trouble connecting, check the status page to see if Sage Data is down.
BMI provides proprietary data, analyst reports, ratings, rankings, and forecasts covering 175 countries and 25 industry sectors. Login path: choose SSO > Organization ID = UCSD. BMI includes lengthy country and industry reports, financial markets and commodities coverage, plus newsletters and daily alerts.
Financial and economic data covering over 150 countries and over 6,500 historical and current data series. Bonds, T-bills, unemployment, GDP, commodity prices, exchange rates, and more, some dating back to 1900. Note: To access, use the “Login Anonymously” option and choose GFDatabase in the left nav bar.
1973-present. Huge database of citations to statistical publications from U.S. federal and state governments, international agencies, nonprofit and educational institutions, and private publishers including trade and industry groups. Full text of the publication or report is often included, and many tables are downloadable in Excel. Particularly good for demographic and country-level information. Previous name Statistical Universe.
An easy to use mapping, analytics, and data visualization app with 100,000+ data variables, including demographic data from the US Census, and the American Community Survey (ACS), consumer spending data from the Consumer Expenditure Survey (CEX), 2020 Election Data, and D&B's Points-of-Interest business directory providing access to over 5 million US business profiles. The included MRI-SimmonsLOCAL consumer behavior dataset contains data on over 8,000 brands, 450 categories, the MOSAIC segmentation system, and detailed lifestyle information. Community Lifestages presents data based on Householder Age, Income and Household Family Status. Users also have access to the CDC PLACES health dataset which includes 27 diverse health measures, such as Health Outcomes, Prevention, Risk Behaviors, and Health Status. Data is largely available down to the block group level, and custom locations can be created. Includes EASI/MediaMark Research Incorporated (MRI) and Simmons LOCAL data packages. Data is downloadable in GIS-ready shapefiles. Users may log in as a Guest, or create an account to save their work. Access limited to 5 simultaneous users. Try again later if refused. (formerly known as SimplyMap).
Single search interface for data produced and collected by various United Nations (UN) organizations. Provides 442 economic, social, cultural, health, and demographic data series for countries of the world. Data providers include UN, UNESCO, FAO, WHO, IMF, UNICEF, ITU, and World Bank. Some indicators reach back as far as the 1940s.
WRDS provides access to selected datasets in the fields of finance, accounting, banking, economics, management, marketing, public policy and public health statistics. ACCESS: UC San Diego faculty, staff and students first must sign up for a WRDS account by using the Register link on the landing page. LIMITATIONS: Masters & Undergraduate students do not have access during summer or quarter breaks. UC San Diego affiliates without AD network accounts are ineligible for WRDS accounts (most Extension students are in this category). In those cases, Mergent Market Atlas and Finaeon (formerly Global Financial Database) are your recommended alternatives.
1973-present. Huge database of citations to statistical publications from U.S. federal and state governments, international agencies, nonprofit and educational institutions, and private publishers including trade and industry groups. Full text of the publication or report is often included, and many tables are downloadable in Excel. Particularly good for demographic and country-level information. Previous name Statistical Universe.
The focus here is on capturing data that supports behavioral economics, with an emphasis on consumer surveys, economic attitudes and bahavior as well as public opinion poll and election data.
Our ESG data comes hosted on two platforms:LSEG Refinitiv Workspace and Mergent Market Atlas. The data are from the same source. Mergent has easy-to-access, overall reporting. It's great for tracking overall company and peer performance. LSEG Refinitiv gets more granular on specific factors that make up the ESG pillars. Not everyone will need that level of granularity.
This resource replaces Mergent Online in June 2025. It provides access to company financials, ratios, business segments, descriptions, sustainability, officers and directors. It is especially useful for company, industry, index, ESG and economic data views, SEC filings, and other reports.
An easy to use mapping, analytics, and data visualization app with 100,000+ data variables, including demographic data from the US Census, and the American Community Survey (ACS), consumer spending data from the Consumer Expenditure Survey (CEX), 2020 Election Data, and D&B's Points-of-Interest business directory providing access to over 5 million US business profiles. The included MRI-SimmonsLOCAL consumer behavior dataset contains data on over 8,000 brands, 450 categories, the MOSAIC segmentation system, and detailed lifestyle information. Community Lifestages presents data based on Householder Age, Income and Household Family Status. Users also have access to the CDC PLACES health dataset which includes 27 diverse health measures, such as Health Outcomes, Prevention, Risk Behaviors, and Health Status. Data is largely available down to the block group level, and custom locations can be created. Includes EASI/MediaMark Research Incorporated (MRI) and Simmons LOCAL data packages. Data is downloadable in GIS-ready shapefiles. Users may log in as a Guest, or create an account to save their work. Access limited to 5 simultaneous users. Try again later if refused. (formerly known as SimplyMap).
Single search interface for data produced and collected by various United Nations (UN) organizations. Provides 442 economic, social, cultural, health, and demographic data series for countries of the world. Data providers include UN, UNESCO, FAO, WHO, IMF, UNICEF, ITU, and World Bank. Some indicators reach back as far as the 1940s.
Provides economic studies, company & industry reports, country risk, economic and industrial statistics, and political news with a focus on emerging market countries. Covers public & private companies & global industry reports. Includes interactive data analysis tools & news alerts. Excellent China coverage.
NOTE: Institution-wide access to China Focus City Data ends on 8/31/25. EIU Viewpoint Country Analysis Advanced module contains background, trends and risk analysis on countries and regions. EIU is known for its global coverage of current political, economic, and business affairs. It features worldwide industry coverage for automotive, consumer goods, energy, financial services, healthcare and telecommunications. This EIU Viewpoint platform also includes “China Focus City Data,” which can be accessed under the “More” tab in the upper right corner of the Viewpoint homepage. Former names: Economist Intelligence Unit (UCSD portal), Access China All Cities
IBISWorld contains U.S. and global industry market research reports, including a specialized collection of China Industry Reports. It also provides U.S. business risk ratings, and selected economic and demographic data. Contents are downloadable as full reports or selected elements, such as SWOT analyses, statistical tables and graphs.
BMI provides proprietary data, analyst reports, ratings, rankings, and forecasts covering 175 countries and 25 industry sectors. Login path: choose SSO > Organization ID = UCSD. BMI includes lengthy country and industry reports, financial markets and commodities coverage, plus newsletters and daily alerts.
CEIC Data contains economic, industrial and financial time-series data. Access limited to 5 simultaneous users. Try again later if refused.
Four databases are included in this package:
• China Premium Databases
The China Premium Database offers over 415,000 time-series records on macroeconomic, sector, industry and regional data dating back to 1949. The China Premium Database is available in both English and Chinese.
• Brazil Premium Databases
The Brazil Premium Database covers 13 macroeconomic and 13 industry growth sectors with unmatched coverage of the energy, biofuel, and automobile sectors. Regional data are also available for Brazil's 5 regions, all 27 states, and 6000 municipalities.
• Global Database
CEIC Data’s Global Database provides access to granular macroeconomic data covering both developed and emerging markets covering over 200 economies and is ideal for business students, professors and lecturers for macroeconomic research projects and course assignments.
• Daily Database
An easy to use mapping, analytics, and data visualization app with 100,000+ data variables, including demographic data from the US Census, and the American Community Survey (ACS), consumer spending data from the Consumer Expenditure Survey (CEX), 2020 Election Data, and D&B's Points-of-Interest business directory providing access to over 5 million US business profiles. The included MRI-SimmonsLOCAL consumer behavior dataset contains data on over 8,000 brands, 450 categories, the MOSAIC segmentation system, and detailed lifestyle information. Community Lifestages presents data based on Householder Age, Income and Household Family Status. Users also have access to the CDC PLACES health dataset which includes 27 diverse health measures, such as Health Outcomes, Prevention, Risk Behaviors, and Health Status. Data is largely available down to the block group level, and custom locations can be created. Includes EASI/MediaMark Research Incorporated (MRI) and Simmons LOCAL data packages. Data is downloadable in GIS-ready shapefiles. Users may log in as a Guest, or create an account to save their work. Access limited to 5 simultaneous users. Try again later if refused. (formerly known as SimplyMap).
1790-present. This site combines data from the U.S. Census of Population and Housing & the American Community Survey (ACS) with a user friendly interface, allowing the creation of maps & statistical tables. Census Tract boundaries are available back to 1940. Now also includes data on U.S. elections, business pattern, environmental summary, health, religion, and crime; the UK and Canadian censuses; Irish religious data; World Development Indicators, and EuroStat. Presidential, senatorial, congressional and gubernatorial election data comes from Dave Leip's Atlas of U.S. Presidential Elections and is available for map presentation only.
