← Back to IT country layer · Country index

IT population QA downloader: freeze exact official payloads for national-scale rerun

blocked synth-downloader

Task metadata

idt_bf874ee3
titleIT population QA downloader: freeze exact official payloads for national-scale rerun
assigneesynth-downloader
statusblocked
tenantsynthestat
priority65
workspace_kinddir
workspace_path/home/synthestat
created_byuser
created_at2026-05-19 20:17:20 CEST
started_at2026-05-19 20:33:52 CEST
completed_at

Latest summary

SOURCE_PAYLOAD_MISSING: approved ISTAT SDMX endpoints for IT `22_289`, `DF_DCSS_FAM_POP_TV_1`, `DF_DCSS_ABITAZIONI_TV_1/2`, `DF_DCSS_HCUE_COM_7_COM`, and `CL_ITTER107` timed out from this host; exact retry commands and blocker manifest are in /home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/source_payload_missing_manifest.json.

Body

Country: IT — Italy
Parents: t_ca8ba63b, t_4cdf60f2
Mission: verify/freeze the exact official payloads named by marginals and distribution researchers for national-scale population QA.

Deliverables:
- catalogue/freeze note under /home/synthestat/workspace/manager_handoffs/downloader/ and latest.md updated;
- if files are fetched or already frozen, provide paths, checksums, row counts, schema sketch, source URL/table id, retrieval timestamp;
- if not fetchable now, return exact commands/API/table ids needed and block with SOURCE_PAYLOAD_MISSING, not vague text.

Do not overwrite production catalogues. Do not copy unrelated caches wholesale.

Parents

[
  "t_4cdf60f2",
  "t_ca8ba63b"
]

Children

[
  "t_728b5e94"
]

Runs

IDProfileStatusOutcomeStartedEndedSummary/error
126synth-downloaderblockedblocked2026-05-19 20:33:52 CEST2026-05-19 20:48:47 CESTSOURCE_PAYLOAD_MISSING: approved ISTAT SDMX endpoints for IT `22_289`, `DF_DCSS_FAM_POP_TV_1`, `DF_DCSS_ABITAZIONI_TV_1/2`, `DF_DCSS_HCUE_COM_7_COM`, and `CL_ITTER107` timed out from this host; exact retry commands and blocker manifest are in /home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/source_payload_missing_manifest.json.

Events

TimeKindPayload
2026-05-19 20:17:20 CESTcreated{ "assignee": "synth-downloader", "status": "todo", "parents": [ "t_ca8ba63b", "t_4cdf60f2" ], "tenant": "synthestat", "skills": [ "synthestat-kb-workflow" ] }
2026-05-19 20:33:31 CESTcommented{ "author": "synth-marginals-researcher", "len": 829 }
2026-05-19 20:33:51 CESTpromotednull
2026-05-19 20:33:52 CESTclaimed{ "lock": "vmi3188806:1590352", "expires": 1779216532, "run_id": 126 }
2026-05-19 20:33:52 CESTspawned{ "pid": 1690959 }
2026-05-19 20:48:42 CESTcommented{ "author": "synth-downloader", "len": 1452 }
2026-05-19 20:48:47 CESTblocked{ "reason": "SOURCE_PAYLOAD_MISSING: approved ISTAT SDMX endpoints for IT `22_289`, `DF_DCSS_FAM_POP_TV_1`, `DF_DCSS_ABITAZIONI_TV_1/2`, `DF_DCSS_HCUE_COM_7_COM`, and `CL_ITTER107` timed out from this host; exact retry commands and blocker manifest are in /home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/source_payload_missing_manifest.json." }

Comments

2026-05-19 20:33:31 CEST · synth-marginals-researcher
Parent t_ca8ba63b marginal-source handoff ready for downloader. Read:
- `/home/synthestat/workspace/manager_handoffs/marginals/2026-05-19_2029_IT_sources.md`
- `/home/synthestat/workspace/manager_handoffs/marginals/2026-05-19_2029_IT_needs.md`
- `/home/synthestat/workspace/manager_handoffs/marginals/latest.md`

Key P0 marginal freeze targets: ISTAT `22_289`/`DCIS_POPRES1` population, `DF_DCSS_FAM_POP_TV_1`/`DCSS_FAM_POP_TV` household/private+institutional residents, `DF_DCSS_ABITAZIONI_TV_1/2` dwelling totals, and verify `DF_DCSS_HCUE_COM_7_COM`. Use coherent 2024-12-31 / 2025-01-01 bundle: 58,943,464 persons; 26,670,169 private households; 58,525,651 private-household residents; 417,813 institutional-household residents. Dwelling value fetch timed out in marginal run, so retry exactly rather than treating as unknown.
2026-05-19 20:48:42 CEST · synth-downloader
SOURCE_PAYLOAD_MISSING handoff:

- Wrote downloader reports:
  - `/home/synthestat/workspace/manager_handoffs/downloader/2026-05-19_2039_download_log.md`
  - `/home/synthestat/workspace/manager_handoffs/downloader/2026-05-19_2039_catalogue_updates.md`
  - `/home/synthestat/workspace/manager_handoffs/downloader/latest.md`
- Wrote explicit failure/candidate catalogue artifacts:
  - `/home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/source_payload_missing_manifest.json` (SHA256 `eb5f375e60919cd3714f3f2cd6e87aa8cdbb2eb2fa18152e7307ff74a1f842a6`)
  - `/home/synthestat/output/catalogue/it_population_qa_freeze_2026-05-19_2039.json` (same SHA256)
  - `/home/synthestat/output/catalogue/it_population_qa_freeze_latest.json`
- Verification: manifest status `SOURCE_PAYLOAD_MISSING`; 8/8 approved ISTAT targets are `SOURCE_PAYLOAD_MISSING`; no raw payload bytes, row counts, or checksums are claimed.
- Failed targets include `22_289`, `DF_DCSS_FAM_POP_TV_1` indicators, `DF_DCSS_ABITAZIONI_TV_1/2`, `DF_DCSS_HCUE_COM_7_COM`, and `CL_ITTER107`. Exact retry curl commands are stored per target in the manifest and download log.
- Appended manager update to `/home/synthestat/workspace/manager_handoffs/manager_updates.md`.

Do not promote the IT national population QA bundle until the ISTAT SDMX payloads are successfully frozen with raw bytes, headers, checksums, row counts, and codelists.