fix: resolve lineage extraction bug for MySQL 5.7.3

[cchenan]

Problem

Lineage extraction fails when connecting to MySQL 5.7.3. The queries in queries.py use syntax or columns that are not available in this version.

Solution

Modified ingestion/src/metadata/ingestion/source/database/mysql/queries.py to be compatible with MySQL 5.7.3.

Changes:

• Adjusted information_schema queries for MySQL 5.7.3 compatibility
• Added conditional logic where needed

Testing

• Verified with MySQL 5.7.3 container: lineage extraction works correctly
• Verified with MySQL 5.7.23 and 8.0: no regression

Related issue

Closes #28029

[github-actions]

Hi there 👋 Thanks for your contribution!

The OpenMetadata team will review the PR shortly! Once it has been labeled as safe to test, the CI workflows
will start executing and we'll be able to make sure everything is working as expected.

Let us know if you need any help!

[github-actions]

Hi there 👋 Thanks for your contribution!

The OpenMetadata team will review the PR shortly! Once it has been labeled as safe to test, the CI workflows
will start executing and we'll be able to make sure everything is working as expected.

Let us know if you need any help!

[gitar-bot]

Code Review ✅ Approved 1 resolved / 1 findings

Adjusts information_schema queries for MySQL 5.7.3 compatibility and addresses the missing conversion for slow_log.sql_text, resolving the lineage extraction bug.

✅ 1 resolved

✅ Bug: Incomplete fix: slow_log.sql_text has the same MEDIUMBLOB issue

📄 ingestion/src/metadata/ingestion/source/database/mysql/queries.py:56-57 📄 ingestion/src/metadata/ingestion/source/database/mysql/queries.py:72
The PR correctly applies CONVERT(argument USING utf8mb4) to general_log queries, but MYSQL_SQL_STATEMENT_SLOW_LOGS (lines 56-57) still references sql_text directly without conversion. In MySQL 5.7+, slow_log.sql_text is also a MEDIUMBLOB column, so the same encoding issue will occur when slow-log-based lineage extraction is used against MySQL 5.7.3.

Similarly, MYSQL_TEST_GET_QUERIES_SLOW_LOGS (line 72) reads sql_text without CONVERT.

Options

Display: compact → Showing less information.

Comment with these commands to change:

Compact

gitar display:verbose

_{Was this helpful? React with 👍 / 👎 | Gitar}

[cchenan]

@open-metadata/ingestion Could you please add the safe to test label to this PR? Thanks!

[cchenan]

/add-label "safe to test"

[harshach]

will this work with only msyql 5.7 or any version after that too?

[cchenan]

will this work with only msyql 5.7 or any version after that too?

It works for both MySQL 5.7.3+ and 8.0. I've tested with 5.7.23 and 8.0, no regression. The CONVERT function is supported in all MySQL 5.7+ and 8.0 versions.

[cchenan]

The static check errors reported (e.g., unquote_plus import, missing type annotations) are not related to my changes. They exist in the current main branch. Could you please advise how to proceed? Should I merge latest main again, or is there a baseline configuration I need to update?

[cchenan]

Thanks for testing! I see the deployment hit some failures. Is there anything on my side that I can help fix? Or is

[github-actions]

🟡 Playwright Results — all passed (4 flaky)

✅ 1785 passed · ❌ 0 failed · 🟡 4 flaky · ⏭️ 52 skipped

Shard	Passed	Failed	Flaky	Skipped
🟡 Shard 1	297	0	2	4
🟡 Shard 3	779	0	2	7
✅ Shard 5	709	0	0	41

🟡 4 flaky test(s) (passed on retry)

• Features/DescriptionSuggestion.spec.ts › should decline a suggested container column description (shard 1, 1 retry)
• Pages/AuditLogs.spec.ts › should apply both User and EntityType filters simultaneously (shard 1, 1 retry)
• Features/RTL.spec.ts › Verify Following widget functionality (shard 3, 1 retry)
• Features/Table.spec.ts › Tags term should be consistent for search (shard 3, 1 retry)

📦 Download artifacts

How to debug locally

# Download playwright-test-results-<shard> artifact and unzip
npx playwright show-trace path/to/trace.zip    # view trace