Mongolia_Employment Statvar configurations

statvar_imports/mongolia_imports/mongolia_employment/README.md

@@ -0,0 +1,122 @@
+#### Copyright 2025 Google LLC
+####
+#### Licensed under the Apache License, Version 2.0 (the "License");
+#### you may not use this file except in compliance with the License.
+#### You may obtain a copy of the License at
+####
+####       http://www.apache.org/licenses/LICENSE-2.0
+####
+#### Unless required by applicable law or agreed to in writing, software
+#### distributed under the License is distributed on an "AS IS" BASIS,
+#### WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+#### See the License for the specific language governing permissions and
+#### limitations under the License.
+
+
+## Mongolia_Employment Import
+
+This import contains statistical data related to Mongolia's labour and business at the country level.
+
+-----
+
+### ⚙️ How to Use
+
+The workflow for this data import involves two main steps: Manually downloading the necessary files and then processing them.
+
+#### Step 1: Download the Data
+
+- **Source:** [Mongolia labour and business data](https://www.1212.mn/en/statcate)
+- **Description:** The provided URL links to the official website of the National Statistical Office (NSO) of Mongolia. This specific page presents official statistics and data related to the country's labour and business statistics.
+
+To get the necessary data files, you'll need to manually download source files.
+<https://www.1212.mn/en/statcate/table/Labour%2C%20business/Labour>
+
+All downloaded files will be located into the gcs path `unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files` and can be directly read from it while processing.
+
+#### Autorefresh Type:
+
+This import will be refreshed in a semi-automated manner.
+
+-----
+
+#### Step 2: Process the Files
+
+After downloading the files, you can process them to generate the final output. There are two ways to do this:
+
+**Option A: Use the `run.sh` script**
+
+The `run.sh` script automates the processing of all the downloaded files.
+
+**Run the following command:**
+
+```bash
+sh run.sh
+```
+
+**Option B: Manually Execute the Processing Script**
+
+You can also run the `stat_var_processor.py` script individually for each file. This script is located in the `data/tools/statvar_importer/` directory.
+
+Here are the specific commands for each file:
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/employment_by_classification_of_economic_activities_region_gender_and_agegroup.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_classification_of_economic_activities_region_gender_and_agegroup_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_by_classification_of_economic_activities_region_gender_and_agegroup_output
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/employment_by_occupation_by_region_gender_and_agegroup.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_by_occupation_by_region_gender_and_agegroup_output
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/employment_to_population_ratio_by_region_gender_and_agegroup.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/employment_to_population_ratio_by_region_gender_and_agegroup_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/employment_to_population_ratio_by_region_gender_and_agegroup_metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/employment_to_population_ratio_by_region_gender_and_agegroup_output
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/labour_force_by_region_gender_and_agegroup.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/labour_force_by_region_gender_and_agegroup_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/labour_force_by_region_gender_and_agegroup_output
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/labour_underutilization_by_region_gender_and_agegroup.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/labour_underutilization_by_region_gender_and_agegroup_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/labour_underutilization_by_region_gender_and_agegroup_output 
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+```bash
+python3 stat_var_processor.py
+--input_data=gs://unresolved_mcf/country/mongolia/mongolia_employment/latest/input_files/registered_unemployed_by_education_level_region_gender_month.csv
+--pv_map=../../statvar_imports/mongolia_imports/mongolia_employment/registered_unemployed_by_education_level_region_gender_month_pvmap.csv
+--config_file=../../statvar_imports/mongolia_imports/mongolia_employment/metadata.csv
+--output_path=../../statvar_imports/mongolia_imports/mongolia_employment/output_files/registered_unemployed_by_education_level_region_gender_month_output
+--places_resolved_csv=../../statvar_imports/mongolia_imports/mongolia_employment/places_resolved.csv 
+--existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf
+```
+
+

statvar_imports/mongolia_imports/mongolia_employment/employment_by_classification_of_economic_activities_region_gender_and_agegroup_pvmap.csv

@@ -0,0 +1,88 @@
+key,prop,val,,,,,,,,
+Sex:Total,#ignore,skip,,,,,,,,
+Aimag:Total,observationAbout,country/MNG,,,,,,,,
+Aimag,observationAbout,{Data},,,,,,,,
+Male,gender,Male,,,,,,,,
+Female,gender,Female,,,,,,,,
+15-19,age,[15 19 Years],,,,,,,,
+20-24,age,[20 24 Years],,,,,,,,
+25-29,age,[25 29 Years],,,,,,,,
+30-34,age,[30 34 Years],,,,,,,,
+35-39,age,[35 39 Years],,,,,,,,
+40-44,age,[40 44 Years],,,,,,,,
+45-49,age,[45 49 Years],,,,,,,,
+50-54,age,[50 54 Years],,,,,,,,
+55-59,age,[55 59 Years],,,,,,,,
+60-64,age,[60 64 Years],,,,,,,,
+65-69,age,[65 69 Years],,,,,,,,
+70+,age,[70 - Years],,,,,,,,
+,,,,,,,,,,
+,,,,,,,,,,
+"Agriculture, forestry and fishing",economicSector,AgricultureForestFishingSector,,,,,,,,
+Mining and quarrying,economicSector,MiningQuarrying,,,,,,,,
+Processing industries,economicSector,ProcessingIndustry,,,,,,,,
+"Electricity, gas, steam and air conditioning supply",economicSector,ElectricityGasSteamAndAirConditioner,,,,,,,,
+"Water supply; sewerage, waste management and remediation activities",economicSector,WaterSupplySewerageWasteManagement,,,,,,,,
+Construction,economicSector,ConstructionSector,,,,,,,,
+Wholesale and retail trade; repair of motor vehicles and motorcycles,economicSector,WholesaleRetailTradeAndRepair,,,,,,,,
+Transportation and storage,economicSector,TransportStorageSector,,,,,,,,
+Accomodation and food service activities,economicSector,AccommodationFoodSector,,,,,,,,
+Information and communication,economicSector,InformationAndCommunication,,,,,,,,
+Financial and insurance activities,economicSector,FinancialAndInsuranceActivities,,,,,,,,
+Real estate activities,economicSector,RealEstate,,,,,,,,
+"Professional, scientific and technical activities",economicSector,ProfessionalScientificTechnicalActivities,,,,,,,,
+Administrative and support service activities,economicSector,AdministrativeAndSupportServices,,,,,,,,
+Public administration and defence; compulsory social insurancy,economicSector,PublicAdministrationAndDefence,,,,,,,,
+Education services,economicSector,EducationSector,,,,,,,,
+Human health and social work activities,economicSector,HumanHealthAndSocialWork,,,,,,,,
+"Arts, entertainment and recreation",economicSector,ArtsEntertainmentRecreation,,,,,,,,
+Other service activities,economicSector,OtherServiceSector,,,,,,,,
+Activities of households as employers,economicSector,HouseholdActivities,,,,,,,,
+Activities of extraterritorial organizations and bodies,economicSector,ExtraterritorialOrganizationsAndBodies,,,,,,,,
+1985,observationDate,1985,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1986,observationDate,1986,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1987,observationDate,1987,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1988,observationDate,1988,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1989,observationDate,1989,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1990,observationDate,1990,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1991,observationDate,1991,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1992,observationDate,1992,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1993,observationDate,1993,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1994,observationDate,1994,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1995,observationDate,1995,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1996,observationDate,1996,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1997,observationDate,1997,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1998,observationDate,1998,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+1999,observationDate,1999,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2000,observationDate,2000,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2001,observationDate,2001,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2002,observationDate,2002,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2003,observationDate,2003,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2004,observationDate,2004,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2005,observationDate,2005,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2006,observationDate,2006,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2007,observationDate,2007,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2008,observationDate,2008,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2009,observationDate,2009,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2010,observationDate,2010,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2011,observationDate,2011,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2012,observationDate,2012,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2013,observationDate,2013,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2014,observationDate,2014,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2015,observationDate,2015,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2016,observationDate,2016,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2017,observationDate,2017,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2018,observationDate,2018,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2019,observationDate,2019,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2020,observationDate,2020,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2021,observationDate,2021,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2022,observationDate,2022,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2023,observationDate,2023,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2024,observationDate,2024,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2025,observationDate,2025,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2026,observationDate,2026,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2027,observationDate,2027,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2028,observationDate,2028,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2029,observationDate,2029,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2030,observationDate,2030,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count
+2031,observationDate,2031,value,{Number},employmentStatus,Employed,populationType,Person,measuredProperty,count

statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_metadata.csv

@@ -0,0 +1,6 @@
+parameter,value
+#places_within,country/MNG
+output_columns,"observationAbout,observationDate,value,variableMeasured,unit,scalingFactor"
+header_rows,1
+url,"https://www.1212.mn/en/statcate/table-view/Labour%2C%20business/Labour/DT_NSO_0400_006V12_1.px?subtables=EMPLOYMENT,%20by%20occupation,%20sex,%20age%20group,%20region,%20aimag%20and%20the%20capital"
+mapped_columns,5

statvar_imports/mongolia_imports/mongolia_employment/employment_by_occupation_by_region_gender_and_agegroup_pvmap.csv

@@ -0,0 +1,55 @@
+key,p1,v1,p2,v2,p3,v3,p4,v4,,
+Aimag,observationAbout,{Data},,,,,,,,
+"Work, profession:Total",#ignore,skip,,,,,,,,
+Female,gender,Female,,,,,,,,
+Male,gender,Male,,,,,,,,
+Aimag:Total,observationAbout,country/MNG,,,,,,,,
+15-19,age,[15 19 Years],,,,,,,,
+20-24,age,[20 24 Years],,,,,,,,
+25-29,age,[25 29 Years],,,,,,,,
+30-34,age,[30 34 Years],,,,,,,,
+35-39,age,[35 39 Years],,,,,,,,
+40-44,age,[40 44 Years],,,,,,,,
+45-49,age,[45 49 Years],,,,,,,,
+50-54,age,[50 54 Years],,,,,,,,
+55-59,age,[55 59 Years],,,,,,,,
+60-64,age,[60 64 Years],,,,,,,,
+65-69,age,[65 69 Years],,,,,,,,
+70+,age,[70 - Years],,,,,,,,
+,,,,,,,,,,
+,,,,,,,,,,
+Manager,occupationalCategory,Manager,,,,,,,,
+Professionals,occupationalCategory,Professional,,,,,,,,
+Technicians and associate professionals,occupationalCategory,TechnicianAndAssociateProfessional,,,,,,,,
+Clerical support workers,occupationalCategory,ClericalWorker,,,,,,,,
+Services and sales workers,occupationalCategory,ServicesAndSales,,,,,,,,
+"Skilled agricultural, forestry and fishery workers",occupationalCategory,AgricultureForestryFishing,,,,,,,,
+Craft and related trades workers,occupationalCategory,CraftsAndTrade,,,,,,,,
+"Plant and machine operators, and assemblers",occupationalCategory,PlantOperatorAndMachineOperatorAndMachineAssemble,,,,,,,,
+Elementary occupations,occupationalCategory,ElementaryWorker,,,,,,,,
+Armed forces occupations,armedForcesStatus,InArmedForces,,,,,,,,
+,,,,,,,,,,
+2009,observationDate,2009,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2010,observationDate,2010,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2011,observationDate,2011,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2012,observationDate,2012,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2013,observationDate,2013,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2014,observationDate,2014,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2015,observationDate,2015,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2016,observationDate,2016,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2017,observationDate,2017,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2018,observationDate,2018,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2019,observationDate,2019,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2020,observationDate,2020,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2021,observationDate,2021,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2022,observationDate,2022,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2023,observationDate,2023,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2024,observationDate,2024,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2025,observationDate,2025,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2026,observationDate,2026,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2027,observationDate,2027,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2028,observationDate,2028,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2029,observationDate,2029,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2030,observationDate,2030,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2031,observationDate,2031,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed
+2032,observationDate,2032,populationType,Person,measuredProperty,count,value,{Number},employmentStatus,Employed

statvar_imports/mongolia_imports/mongolia_employment/employment_to_population_ratio_by_region_gender_and_agegroup_metadata.csv

@@ -0,0 +1,6 @@
+parameter,value
+#places_within,country/MNG
+output_columns,"observationAbout,observationDate,value,variableMeasured,unit,scalingFactor"
+header_rows,1
+url,"https://www.1212.mn/en/statcate/table-view/Labour%2C%20business/Labour/DT_NSO_0400_035V7_1.px?subtables=EMPLOYMENT,%20by%20classification%20of%20economic%20activites,%20aimag%20and%20the%20capital,%20gender,%20age%20group"
+mapped_columns,4