Skip to content

fix: Ensure DataprocSparkConnectException displays error messages in all Jupyter environments - #136

Merged
medb merged 16 commits into
GoogleCloudDataproc:mainfrom
fangyh20:jupyter
Sep 24, 2025
Merged

medb merged 16 commits into
GoogleCloudDataproc:mainfrom
fangyh20:jupyter

Conversation

@fangyh20

@fangyh20 fangyh20 commented Sep 9, 2025 •

Copy link
Copy Markdown
Member

jupyter or workbench doesnt' automatically display exception error info

addressed issue for branch-0.1 #138
adding the same changes to main branch

@fangyh20
fangyh20 requested a review from medb September 9, 2025 15:54

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Summary of Changes

Hello @fangyh20, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request improves the user experience when creating Dataproc sessions by making error information more accessible. It addresses a limitation in certain interactive development environments where exception details are not always visible, by ensuring these critical details are logged, thereby simplifying troubleshooting and debugging for users.

Highlights

  • Enhanced Error Visibility: Implemented conditional logging for exceptions that occur during Dataproc session creation. This ensures that error details are captured in logs, particularly in environments like Jupyter or Workbench where exceptions might not be automatically displayed to the user.
  • More Informative Error Messages: Updated the error messages for both DataprocSparkConnectException and general Exception types to include the specific details of the underlying exception, providing clearer context for debugging.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point in your pull request via creating an issue comment (i.e. comment on the pull request page) using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in issue comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request improves error handling during Dataproc session creation by adding explicit logging for exceptions. This is a valuable change for environments like Jupyter or Vertex AI Workbench where exception details might not be displayed automatically. The implementation correctly addresses the issue, but it introduces some code duplication in the exception handling blocks. I've added a comment with a suggestion to refactor this to improve maintainability.

Comment thread google/cloud/dataproc_spark_connect/session.py Outdated
@medb
medb requested a review from ojarjur September 9, 2025 19:53
Comment thread google/cloud/dataproc_spark_connect/session.py Outdated
@medb
medb requested a review from dborowitz September 12, 2025 00:48
@fangyh20
fangyh20 requested a review from medb September 15, 2025 20:32
@medb medb changed the title fix: Improve error handling and logging during Dataproc session creation fix: Ensure DataprocSparkConnectException displays error messages in all Jupyter environments Sep 23, 2025

@medb medb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's update this PR to be consistent with #138

@fangyh20

Copy link
Copy Markdown
Member Author

Let's update this PR to be consistent with #138

updated

@fangyh20
fangyh20 requested a review from medb September 24, 2025 15:29
@medb
medb merged commit 1fc26f5 into GoogleCloudDataproc:main Sep 24, 2025
4 checks passed
fangyh20 added a commit that referenced this pull request Sep 30, 2025
…ages in all Jupyter environments (#136)"

This reverts commit 1fc26f5.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants