Skip to content

Support array-valued schema options in Python - #39583

Merged
Abacn merged 1 commit into
apache:masterfrom
bvolpato:bv/issue-039557
Aug 3, 2026
Merged

Support array-valued schema options in Python#39583
Abacn merged 1 commit into
apache:masterfrom
bvolpato:bv/issue-039557

Conversation

@bvolpato

@bvolpato bvolpato commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Fixes #39557.

Summary

Python schema translation rejected array-valued options received from other SDKs because option values only supported atomic types. This change recursively decodes and encodes array values, infers container element types when regenerating schema protos, and adds an ARRAY<STRING> roundtrip regression case.

With Python support in place, this also restores Debezium's primaryKeyColumns schema option, which had been removed as a temporary workaround.

Testing

  • uvx tox -e py311 -- -k proto_survives_typing_roundtrip apache_beam/typehints/schemas_test.py (365 passed)
  • target/.tox/py311/bin/python -m pytest -q apache_beam/typehints/schemas_test.py (759 passed, 5 skipped)
  • ./gradlew :sdks:java:io:debezium:test with seven non-Docker unit classes selected (41 passed)
  • ./gradlew :sdks:java:io:debezium:compileJava :sdks:java:io:debezium:spotlessJavaCheck
  • YAPF and git diff --check

  • Mention the appropriate issue in the description.
  • Update CHANGES.md with noteworthy changes. Not needed for this focused bug fix.
  • File an Apache Individual Contributor License Agreement. Not needed for this small change.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Assigning reviewers:

R: @shunping for label python.
R: @chamikaramj for label java.

Note: If you would like to opt out of this review, comment assign to next reviewer.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

@Abacn Abacn left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@Abacn
Abacn merged commit 4d3e1f0 into apache:master Aug 3, 2026
111 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Cross-language schema decoding fails for ARRAY<STRING> schema options

2 participants