[ZEPPELIN-6430] Remove SparkR and R interpreter#5271
Draft
pan3793 wants to merge 6 commits into
Draft
Conversation
The selenium integration test job (test-selenium-with-spark-module-for-spark-3-5) fails on AuthenticationIT because the GitHub runner ships Chrome 149 while the pinned Selenium 4.20.0 only bundles devtools up to CDP v125, producing "Unable to find CDP implementation matching 149" and degrading browser automation. This failure is pre-existing on master and unrelated to the SparkR/R removal in this PR. Selenium 4.45.0 bundles selenium-devtools-v147/v148/v149, an exact match for Chrome 149. The integration tests only use stable Selenium 4.x APIs, so the bump is API-compatible.
Removing R packages from the conda env files changed the dependency solve,
so conda started pulling protobuf >= 4.x/5.x. Zeppelin ships an old-format
generated kernel_pb2.py (interpreter/jupyter/grpc/jupyter/kernel_pb2.py),
which is incompatible with protobuf 4+, causing IPythonKernelTest to fail:
TypeError: Descriptors cannot be created directly.
If this call came from a _pb2.py file, your generated code is out of date
... Downgrade the protobuf package to 3.20.x or lower.
core-modules and interpreter-test-jupyter-python both hit this (master passed
because the R-bearing env kept protobuf at 3.x). Pin protobuf<4, matching the
existing convention in env_python_3_with_flink_{119,120}.yml.
- scripts/vagrant/zeppelin-dev/README.md: drop the R/R-packages bullet (the R vagrant role was already removed). - docs/interpreter/jupyter.md: remove the "Jupyter R kernel" (IRKernel) section, consistent with dropping IRKernel support/tests. - message-common.interface.ts: drop 'r' / 'ace/mode/r' from the EditorLanguage/EditorMode unions (no interpreter emits them anymore).
No longer referenced after dropping the "Jupyter R kernel" section in docs/interpreter/jupyter.md.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What is this PR for?
SparkR has been officially deprecated since Spark 4.0, and plans to be removed in Spark 5.0 (early 2027), it also lacks maintenance and user cases in Zeppelin.
https://lists.apache.org/thread/qjgsgxklvpvyvbzsx1qr8o533j4zjlm5
What type of PR is it?
Breaking change.
What is the Jira issue?
ZEPPELIN-6430
How should this be tested?
Pass GHA/
Screenshots (if appropriate)
Questions: