Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • M management
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 182
    • Issues 182
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • dbnomics-fetchers
  • management
  • Wiki
  • Fetcher description
  • BEA

Last edited by Michel Juillard Oct 09, 2017
Page history

BEA

BEA

Provider

provider_name: BEA
provider_longname: U.S. Bureau of Economic Analysis
provider URL: http://www.bea.gov/
approximate number of datasets: 3 main groups(National Data, Industry Data and International Data), each of them contains 2 main subgroups. In each subgroups we have different sections and in each sections there is more than 30 datasets.

Data accessibility

SDMX: No
REST API: The JSON Data Service and XML, http://datahelp.imf.org/knowledgebase/articles/667681-using-json-restful-web-service
Bulk Download: yes, csv, xls, zipped xls nd ziped csv and API
Account: yes, for API, http://www.bea.gov/api/signup/

Desired datasets

Description: We are interested in National Data, Industry Data and International Data main groups

Data tree

Existence of a hierachy of datasets on web site: National Data (first level) GDP and personal income(Second level) Section1: Domestic product and income (third level ) Tables Sheets (Forth level) Section2: Personal income and outlays(third level ) Section3: Government current receipts and expenditures(third level ) Section4: Foreign transactions(third level ) Section5: Saving and investment(third level ) Section6: Income and employment by industry(third level ) Section7: Supplemental tables(third level ) Fixed Assets Accounts tables(Second level) Section1: Fixed assets and consumer Durable goods(third level ) Section2: Private fixed assets by type(third level ) Section3: Private fixed assets by industry(third level ) Section4: Nonresidential fixed assets(third level ) Section5: Residential fixed assets(third level ) Section6: Private fixed assets(third level ) Section7: Governmental fixed assets(third level ) Section8: Consumer durable goods(third level ) Section9: Chained dollar tables(third level ) Industry Data(first level) GDP-by-industry(Second level) Value added by industry(A,Q)(third level ) Gross output by industry(A,Q)(third level ) intermediate input by industry(A,Q)(third level ) Input-Output(Second level) Use table(third level ) make table(third level ) Direct requierments(third level ) Total requirments(third level ) International Data(first level) Int'Transactions, Services & IIP(Second level) International transactions(ITA)(third level ) International services(third level ) International investment position(IIP)(third level ) Direct investment & MNEs ()(Second level) U.S. Direct Investment Abroad:(third level ) Balance of payments and direct investment position data Data on the activities of U.S. multinational enterprises Foreign Direct Investment in the United States: Balance of payments and direct investment position data Data on the activities of U.S affiliates of foreign multinational enterprises
How to recover the information: http://www.bea.gov//national/nipaweb/DownSS2.asp#ZXLS, http://www.bea.gov//national/FA2004/DownSS2.asp http://www.bea.gov//industry/iTables%20Static%20Files/AllTables.zip http://www.bea.gov//industry/iTables%20Static%20Files/AllTablesQTR.zip http://www.bea.gov//industry/iTables%20Static%20Files/AllTablesIO.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/ITA-XLS.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/IntlServ-XLS.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/IIP-XLS.zip http://www.bea.gov/international/di1usdbal.htm http://www.bea.gov/international/di1usdop.htm http://www.bea.gov/international/di1fdibal.htm http://www.bea.gov/international/di1fdiop.htm

Datasets

datasetCode: provided, table code (need to parse cell(1,1) of the sheet)
how to get release date: In each xls sheet: Data published November 25, 2015 and File created 11/24/2015 11:44:04 AM
dataset docHref: no
dataset notes: yes
dimension_list: to be made up from the series, line number
use of attributes: no
attribute_list:
available frequencies: Annual, Quarterly and Monthly
availability of previous updates: No
existence of real time datasets: No

Series

Series key: key (column 3)
Series name: second element of each row + frequency
Series docHref: no
Series notes: yes(Same for all series, better to put it in datasets notes)
missing values: code for missing values
date format: String
mixed frequencies in the same dataset: no

Updates

calendar of future updates:

http://www.bea.gov/newsreleases/2016rd.htm (annual calendar, need to check it previous December)

summary of previous updates:

yes, http://bea.gov/newsreleases/rels.htm

regular updates:
RSS flow:

Yes, http://bea.gov/rss/index.htm

best way to monitor updates:

calendar

Special problems

To have dataset name we have to open the xls or csv file. because the sheet name in datasets here. If we keep line as a series name, we can not keep the data in the same format of the data sourse. for example we will loose Addena in the following example. But some time we are obliged to keep the line which is ''. Because it is an explanation about the serie, for example:

26 Less: Administrative expenses
Effect of participation in defined contribution plans on personal income, saving, and wealth:

27 Effect on personal income (1-9-10 or 15-9-10) 28 Less: Effect on personal consumption expenditures (2) 29 Equals: Effect on personal saving 30 Plus: Holding gains and other changes in assets 31 Equals: Change in personal wealth

  • Released date dose not keep in same cell in all xls file.
  • Monthly data has a different template, the data are arranged in different lines.

For Direct investment & MNEs there is not a direct line.

Other remarks

  • the same series can be found in several tables
  • the table row headers could be stored in Datasets, including informational headers such as 'Addenda' for replicating the published tables.

Data samples

location: light files in dlstats/dlstats/tests/resources/bea/
description:
Clone repository
  • 17 11 07
  • ClientNotes
  • Fetcher Description
    • AFDB
    • BCB
    • BCEAO
    • BEA
    • BI
    • BIS
    • BLS
    • BOJ
    • BUBA
    • CBO
    • CEPII
    • FHFA
    • GGDC
View All Pages