Skip to content

Feature/strip example pipeline code out#29

Open
warren-davies4 wants to merge 46 commits intoNHSDigital:mainfrom
nhsengland:feature/strip-example-pipeline-code-out
Open

Feature/strip example pipeline code out#29
warren-davies4 wants to merge 46 commits intoNHSDigital:mainfrom
nhsengland:feature/strip-example-pipeline-code-out

Conversation

@warren-davies4
Copy link
Collaborator

No description provided.

dependabot bot and others added 30 commits February 20, 2026 14:01
Bumps [pyspark](https://github.com/apache/spark) from 3.2.1 to 3.3.2.
- [Commits](apache/spark@v3.2.1...v3.3.2)

---
updated-dependencies:
- dependency-name: pyspark
  dependency-version: 3.3.2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
…ite error

- Added save_df_as_named_csv to write_csv.py to wrap save and rename steps
- Cast void-typed columns to StringType before writing to avoid PySpark AnalysisException
- Replaced duplicate csv save/rename blocks in create_publication.py with new wrapper
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant