=============== BEA =============== Provider ======== :provider_name: BEA :provider_longname: U.S. Bureau of Economic Analysis :provider URL: http://www.bea.gov/ :approximate number of datasets: 3 main groups(National Data, Industry Data and International Data), each of them contains 2 main subgroups. In each subgroups we have different sections and in each sections there is more than 30 datasets. Data accessibility ================== :SDMX: No :REST API: The JSON Data Service and XML, http://datahelp.imf.org/knowledgebase/articles/667681-using-json-restful-web-service :Bulk Download: yes, csv, xls, zipped xls nd ziped csv and API :Account: yes, for API, http://www.bea.gov/api/signup/ Desired datasets ================ :Description: We are interested in National Data, Industry Data and International Data main groups Data tree ========= :Existence of a hierachy of datasets on web site: National Data (first level) GDP and personal income(Second level) Section1: Domestic product and income (third level ) Tables Sheets (Forth level) Section2: Personal income and outlays(third level ) Section3: Government current receipts and expenditures(third level ) Section4: Foreign transactions(third level ) Section5: Saving and investment(third level ) Section6: Income and employment by industry(third level ) Section7: Supplemental tables(third level ) Fixed Assets Accounts tables(Second level) Section1: Fixed assets and consumer Durable goods(third level ) Section2: Private fixed assets by type(third level ) Section3: Private fixed assets by industry(third level ) Section4: Nonresidential fixed assets(third level ) Section5: Residential fixed assets(third level ) Section6: Private fixed assets(third level ) Section7: Governmental fixed assets(third level ) Section8: Consumer durable goods(third level ) Section9: Chained dollar tables(third level ) Industry Data(first level) GDP-by-industry(Second level) Value added by industry(A,Q)(third level ) Gross output by industry(A,Q)(third level ) intermediate input by industry(A,Q)(third level ) Input-Output(Second level) Use table(third level ) make table(third level ) Direct requierments(third level ) Total requirments(third level ) International Data(first level) Int'Transactions, Services & IIP(Second level) International transactions(ITA)(third level ) International services(third level ) International investment position(IIP)(third level ) Direct investment & MNEs ()(Second level) U.S. Direct Investment Abroad:(third level ) Balance of payments and direct investment position data Data on the activities of U.S. multinational enterprises Foreign Direct Investment in the United States: Balance of payments and direct investment position data Data on the activities of U.S affiliates of foreign multinational enterprises :How to recover the information: http://www.bea.gov//national/nipaweb/DownSS2.asp#ZXLS, http://www.bea.gov//national/FA2004/DownSS2.asp http://www.bea.gov//industry/iTables%20Static%20Files/AllTables.zip http://www.bea.gov//industry/iTables%20Static%20Files/AllTablesQTR.zip http://www.bea.gov//industry/iTables%20Static%20Files/AllTablesIO.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/ITA-XLS.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/IntlServ-XLS.zip http://www.bea.gov/international/bp_web/startDownload.cfm?dlSelect=tables/XLSNEW/IIP-XLS.zip http://www.bea.gov/international/di1usdbal.htm http://www.bea.gov/international/di1usdop.htm http://www.bea.gov/international/di1fdibal.htm http://www.bea.gov/international/di1fdiop.htm Datasets ======== :datasetCode: provided, table code (need to parse cell(1,1) of the sheet) :how to get release date: In each xls sheet: Data published November 25, 2015 and File created 11/24/2015 11:44:04 AM :dataset docHref: no :dataset notes: yes :dimension_list: to be made up from the series, line number :use of attributes: no :attribute_list: :available frequencies: Annual, Quarterly and Monthly :availability of previous updates: No :existence of real time datasets: No Series ====== :Series key: key (column 3) :Series name: second element of each row + frequency :Series docHref: no :Series notes: yes(Same for all series, better to put it in datasets notes) :missing values: code for missing values :date format: String :mixed frequencies in the same dataset: no Updates ======= :calendar of future updates: http://www.bea.gov/newsreleases/2016rd.htm (annual calendar, need to check it previous December) :summary of previous updates: yes, http://bea.gov/newsreleases/rels.htm :regular updates: - :RSS flow: Yes, http://bea.gov/rss/index.htm :best way to monitor updates: calendar Special problems ================ To have dataset name we have to open the xls or csv file. because the sheet name in datasets here. If we keep line as a series name, we can not keep the data in the same format of the data sourse. for example we will loose Addena in the following example. But some time we are obliged to keep the line which is ''. Because it is an explanation about the serie, for example: 26 Less: Administrative expenses Effect of participation in defined contribution plans on personal income, saving, and wealth: 27 Effect on personal income (1-9-10 or 15-9-10) 28 Less: Effect on personal consumption expenditures (2) 29 Equals: Effect on personal saving 30 Plus: Holding gains and other changes in assets 31 Equals: Change in personal wealth - Released date dose not keep in same cell in all xls file. - Monthly data has a different template, the data are arranged in different lines. For Direct investment & MNEs there is not a direct line. Other remarks ============= - the same series can be found in several tables - the table row headers could be stored in Datasets, including informational headers such as 'Addenda' for replicating the published tables. Data samples ============ :location: light files in dlstats/dlstats/tests/resources/bea/ :description: