-
Notifications
You must be signed in to change notification settings - Fork 149
Mongolia_Employment Statvar configurations #1604
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
SudhishaK
merged 9 commits into
datacommonsorg:master
from
SudhishaK:mongolia_employment
Sep 11, 2025
Merged
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit
Hold shift + click to select a range
1a77926
Mongolia_Employment Statvar configurations
SudhishaK 7bd9f08
removed unwanted files
SudhishaK 8592f79
updated the files
SudhishaK 1d0692e
updated the files
SudhishaK 18b2baf
updated configs
SudhishaK f9881d0
updated configs
SudhishaK 6bf7fd8
updated readme and run.sh file
SudhishaK 0c9cfdb
updated readme file
SudhishaK cd85d5b
Merge branch 'master' into mongolia_employment
SudhishaK File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
120 changes: 120 additions & 0 deletions
120
statvar_imports/mongolia_imports/mongolia_employment/README.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,120 @@ | ||
| #### Copyright 2025 Google LLC | ||
| #### | ||
| #### Licensed under the Apache License, Version 2.0 (the "License"); | ||
| #### you may not use this file except in compliance with the License. | ||
| #### You may obtain a copy of the License at | ||
| #### | ||
| #### http://www.apache.org/licenses/LICENSE-2.0 | ||
| #### | ||
| #### Unless required by applicable law or agreed to in writing, software | ||
| #### distributed under the License is distributed on an "AS IS" BASIS, | ||
| #### WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
| #### See the License for the specific language governing permissions and | ||
| #### limitations under the License. | ||
|
|
||
|
|
||
| ## Mongolia_Employment Import | ||
|
|
||
| This import contains statistical data related to Mongolia's labour and business at the country level. | ||
|
|
||
| ----- | ||
|
|
||
| ### ⚙️ How to Use | ||
|
|
||
| The workflow for this data import involves two main steps: Manually downloading the necessary files and then processing them. | ||
|
|
||
| #### Step 1: Download the Data | ||
|
|
||
| - **Source:** [Mongolia labour and business data](https://www.1212.mn/en/statcate) | ||
| - **Description:** The provided URL links to the official website of the National Statistical Office (NSO) of Mongolia. This specific page presents official statistics and data related to the country's labour and business statistics. | ||
|
|
||
| To get the necessary data files, you'll need to manually download source files. | ||
| `https://www.1212.mn/en/statcate/table/Labour%2C%20business/Labour` | ||
|
|
||
| All downloaded files will be located into the `mongolia_employment/input_files` folder. | ||
|
|
||
| This import will be refreshed in a semi-automated manner. | ||
|
|
||
| ----- | ||
|
|
||
| #### Step 2: Process the Files | ||
|
|
||
| After downloading the files, you can process them to generate the final output. There are two ways to do this: | ||
|
|
||
| **Option A: Use the `run.sh` script** | ||
|
|
||
| The `run.sh` script automates the processing of all the downloaded files. | ||
|
|
||
| **Run the following command:** | ||
|
|
||
| ```bash | ||
| sh run.sh | ||
| ``` | ||
|
|
||
| **Option B: Manually Execute the Processing Script** | ||
|
|
||
| You can also run the `stat_var_processor.py` script individually for each file. This script is located in the `data/tools/statvar_importer/` directory. | ||
|
|
||
| Here are the specific commands for each file: | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/employment_by_classification_of_economic_activites_region_gender_and_agegroup.csv | ||
|
SudhishaK marked this conversation as resolved.
Outdated
|
||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_classification_of_economic_activites_region_gender_and_agegroup_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_by_classification_of_economic_activites_region_gender_and_agegroup_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/employment_by_occupation_by_region_gender_and_agegroup.csv | ||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_by_occupation_by_region_gender_and_agegroup_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/employment_to_population_ratio_by_region_gender_and_agegroup.csv | ||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_to_population_ratio_by_region_gender_and_agegroup_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/employment_to_population_ratio_by_region_gender_and_agegroup_metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_to_population_ratio_by_region_gender_and_agegroup_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/labour_force_by_region_gender_and_agegroup.csv | ||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/labour_force_by_region_gender_and_agegroup_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/labour_force_by_region_gender_and_agegroup_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/labour_underutilization_by_region_gender_and_agegroup.csv | ||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/labour_underutilization_by_region_gender_and_agegroup_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/labour_underutilization_by_region_gender_and_agegroup_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
| ```bash | ||
| python3 stat_var_processor.py | ||
| --input_data=../../statvar_imports/mongolia_imports/mongolia_employment/input_files/registered_unemployed_by_education_level_region_gender_month.csv | ||
| --pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/registered_unemployed_by_education_level_region_gender_month_pvmap.csv | ||
| --config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv | ||
| --output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/registered_unemployed_by_education_level_region_gender_month_output | ||
| --places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv | ||
| --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf | ||
| ``` | ||
|
|
||
|
|
||
88 changes: 88 additions & 0 deletions
88
...t/employment_by_classification_of_economic_activites_region_gender_and_agegroup_pvmap.csv
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,88 @@ | ||
| key,prop,val,,,,,,,, | ||
| Sex:Total,#ignore,skip,,,,,,,, | ||
| Aimag:Total,observationAbout,country/MNG,,,,,,,, | ||
| Aimag,observationAbout,{Data},,,,,,,, | ||
| Male,gender,Male,,,,,,,, | ||
| Female,gender,Female,,,,,,,, | ||
| 15-19,age,[15 19 Years],,,,,,,, | ||
| 20-24,age,[20 24 Years],,,,,,,, | ||
| 25-29,age,[25 29 Years],,,,,,,, | ||
| 30-34,age,[30 34 Years],,,,,,,, | ||
| 35-39,age,[35 39 Years],,,,,,,, | ||
| 40-44,age,[40 44 Years],,,,,,,, | ||
| 45-49,age,[45 49 Years],,,,,,,, | ||
| 50-54,age,[50 54 Years],,,,,,,, | ||
| 55-59,age,[55 59 Years],,,,,,,, | ||
| 60-64,age,[60 64 Years],,,,,,,, | ||
| 65-69,age,[65 69 Years],,,,,,,, | ||
| 70+,age,[70 - Years],,,,,,,, | ||
| ,,,,,,,,,, | ||
| ,,,,,,,,,, | ||
| "Agriculture, forestry and fishing",economicSector,AgricultureForestFishingSector,,,,,,,, | ||
| Mining and quarrying,economicSector,MiningQuarrying,,,,,,,, | ||
| Processing industries,economicSector,ProcessingIndustry,,,,,,,, | ||
| "Electricity, gas, steam and air conditioning supply",economicSector,ElectricityGasSteamAndAirConditioner,,,,,,,, | ||
| "Water supply; sewerage, waste management and remediation activities",economicSector,WaterSupplySewerageWasteManagement,,,,,,,, | ||
| Construction,economicSector,ConstructionSector,,,,,,,, | ||
| Wholesale and retail trade; repair of motor vehicles and motorcycles,economicSector,WholesaleRetailTradeAndRepair,,,,,,,, | ||
| Transportation and storage,economicSector,TransportStorageSector,,,,,,,, | ||
| Accomodation and food service activities,economicSector,AccommodationFoodSector,,,,,,,, | ||
| Information and communication,economicSector,InformationAndCommunication,,,,,,,, | ||
| Financial and insurance activities,economicSector,FinancialAndInsuranceActivities,,,,,,,, | ||
| Real estate activities,economicSector,RealEstate,,,,,,,, | ||
| "Professional, scientific and technical activities",economicSector,ProfessionalScientificTechnicalActivities,,,,,,,, | ||
| Administrative and support service activities,economicSector,AdministrativeAndSupportServices,,,,,,,, | ||
| Public administration and defence; compulsory social insurancy,economicSector,PublicAdministrationAndDefence,,,,,,,, | ||
|
SudhishaK marked this conversation as resolved.
Outdated
|
||
| Education services,economicSector,EducationSector,,,,,,,, | ||
| Human health and social work activities,economicSector,HumanHealthAndSocialWork,,,,,,,, | ||
| "Arts, entertainment and recreation",economicSector,ArtsEntertainmentRecreation,,,,,,,, | ||
| Other service activities,economicSector,OtherServiceSector,,,,,,,, | ||
| Activities of households as employers,economicSector,HouseholdActivities,,,,,,,, | ||
| Activities of extraterritorial organizations and bodies,economicSector,ExtraterritorialOrganizationsAndBodies,,,,,,,, | ||
| 1985,observationDate,1985,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1986,observationDate,1986,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1987,observationDate,1987,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1988,observationDate,1988,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1989,observationDate,1989,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1990,observationDate,1990,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1991,observationDate,1991,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1992,observationDate,1992,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1993,observationDate,1993,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1994,observationDate,1994,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1995,observationDate,1995,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1996,observationDate,1996,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1997,observationDate,1997,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1998,observationDate,1998,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 1999,observationDate,1999,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2000,observationDate,2000,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2001,observationDate,2001,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2002,observationDate,2002,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2003,observationDate,2003,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2004,observationDate,2004,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2005,observationDate,2005,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2006,observationDate,2006,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2007,observationDate,2007,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2008,observationDate,2008,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2009,observationDate,2009,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2010,observationDate,2010,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2011,observationDate,2011,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2012,observationDate,2012,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2013,observationDate,2013,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2014,observationDate,2014,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2015,observationDate,2015,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2016,observationDate,2016,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2017,observationDate,2017,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2018,observationDate,2018,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2019,observationDate,2019,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2020,observationDate,2020,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2021,observationDate,2021,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2022,observationDate,2022,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2023,observationDate,2023,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2024,observationDate,2024,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2025,observationDate,2025,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2026,observationDate,2026,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2027,observationDate,2027,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2028,observationDate,2028,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2029,observationDate,2029,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2030,observationDate,2030,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
| 2031,observationDate,2031,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count | ||
6 changes: 6 additions & 0 deletions
6
...s/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_metadata.csv
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| parameter,value | ||
| #places_within,country/MNG | ||
| output_columns,"observationAbout,observationDate,value,variableMeasured,unit,scalingFactor" | ||
| header_rows,1 | ||
| url,"https://www.1212.mn/en/statcate/table-view/Labour%2C%20business/Labour/DT_NSO_0400_006V12_1.px?subtables=EMPLOYMENT,%20by%20occupation,%20sex,%20age%20group,%20region,%20aimag%20and%20the%20capital" | ||
| mapped_columns,5 |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.