Reproducible workflows for linked health data in secure environments: a pipeline-based approach for analyses under data access constraints (23999)
Background: Reproducibility in epidemiology is typically grounded in data sharing and open access.In secure data environments using privacy-preserving record linkage (PPRL), however,these principles are inherently constrained.This creates a methodological tension between protecting sensitive health data and ensuring analytical transparency.We present an applied approach to structuring epidemiological analysis within a secure setting,focusing on techniques to improve reproducibility under restricted data access.
Methods: An analytical workflow was implemented using linked primary care and administrative health data in Western Australia, integrating hospital admissions,emergency presentations,and death registrations with general practice data (>12 million records; ~3.3 million individuals).Analytical pipelines were developed in a controlled virtual machine with no data transfer allowed.The package {targets} in R was used to structure data ingestion,parameter specification,and statistical modelling.Analytical components were parameterised,allowing modification of cohort definitions, variable construction,and model specifications,with automated re-execution and validation of downstream outputs.
Results: A Chronic Heart Failure(CHF) cohort of 42,799 patients was derived from 55,766 identified cases across two intervention tranches in a selected sample of practices.The primary contribution of the workflow was structuring analytical processes to enable consistent,traceable re-estimation of results.Parameterised pipeline components enabled iterative refinement of cohort inclusion criteria and variable definitions,with all models re-fitted through full pipeline re-execution.This eliminated the need to reconstruct analytical datasets manually and reduced the risk of divergence among analysts,ensuring alignment between evolving cohort definitions and analytical outputs.The workflow also enabled systematic tracking of changes across iterations, strengthening internal validation and auditability.However,reproducibility remained bound to authorised environments,limiting external verification.
Conclusion: In secure, privacy-preserving data contexts, reproducibility depends on structuring analysis rather than enabling data access.Pipeline-based workflows provide a practical mechanism for standardising and iteratively refining complex analyses within constrained environments,supporting reproducibility and controlled analytical flexibility.This approach strengthens data quality and transparency while acknowledging the limits of external reproducibility,offering a pragmatic model for epidemiological research conducted in secure environments.