{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":753064979,"defaultBranch":"master","name":"kyuubi","ownerLogin":"PorterZhang2021","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2024-02-05T11:59:06.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/96274454?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1721097210.0","currentOid":""},"activityList":{"items":[{"before":"b8696c228d6288ad350b5697ef266fe2981d25f9","after":"8b9e7b50136971e6faf5670f65edf8ac5271b667","ref":"refs/heads/issue-6254","pushedAt":"2024-07-30T10:38:20.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[issue-6254] fix crossing reference","shortMessageHtmlLink":"[issue-6254] fix crossing reference"}},{"before":"a020098bc2d1cc4ea32df43fd41049266d7b081e","after":"b8696c228d6288ad350b5697ef266fe2981d25f9","ref":"refs/heads/issue-6254","pushedAt":"2024-07-30T03:42:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[issue-6254] fix header level","shortMessageHtmlLink":"[issue-6254] fix header level"}},{"before":"80f7496dde317dd820be3ce836e69fce974754a9","after":"996cdccc097e046fc2f61c7be5d0069b6c8eda9b","ref":"refs/heads/master","pushedAt":"2024-07-30T03:32:24.000Z","pushType":"push","commitsCount":20,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6567] Fix compatibility of pyhive with setuptools==72.0.0\n\n# :mag: Description\n## Issue References ๐Ÿ”—\nThis pull request fixes #6567\n\n## Describe Your Solution ๐Ÿ”ง\nWith `setuptools==72.0.0`, the `test` command was removed after being deprecated for a long time.\nThis completely breaks the installation of any packages using the `test` command, including PyHive.\nThis PR fixes PyHive to be compatible with `setuptools` 72+ again.\nIt seems that `setup.py test` wasn't used anywhere at all, which is why I just removed it.\n\n## Types of changes :bookmark:\n- [x] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n```\n$ pip install -e .\nObtaining file:///home/localstack/Repos/kyuubi/python\n Preparing metadata (setup.py) ... error\n error: subprocess-exited-with-error\n\n ร— python setup.py egg_info did not run successfully.\n โ”‚ exit code: 1\n โ•ฐโ”€> [6 lines of output]\n Traceback (most recent call last):\n File \"\", line 2, in \n File \"\", line 34, in \n File \"/home/localstack/Repos/kyuubi/python/setup.py\", line 4, in \n from setuptools.command.test import test as TestCommand\n ModuleNotFoundError: No module named 'setuptools.command.test'\n [end of output]\n\n note: This error originates from a subprocess, and is likely not a problem with pip.\nerror: metadata-generation-failed\n\nร— Encountered error while generating package metadata.\nโ•ฐโ”€> See above for output.\n\nnote: This is an issue with the package mentioned above, not pip.\nhint: See above for details\n```\n\n#### Behavior With This Pull Request :tada:\n```\n$ pip install --upgrade setuptools\nRequirement already satisfied: setuptools in .../.pyenv/versions/3.11.5/lib/python3.11/site-packages (72.0.0)\n$ pip install -e .\nObtaining file:///home/.../repos/kyuubi/python\n Preparing metadata (setup.py) ... done\nCollecting future (from PyHive==0.7.0)\n Obtaining dependency information for future from https://files.pythonhosted.org/packages/da/71/ae30dadffc90b9006d77af76b393cb9dfbfc9629f339fc1574a1c52e6806/future-1.0.0-py3-none-any.whl.metadata\n Using cached future-1.0.0-py3-none-any.whl.metadata (4.0 kB)\nRequirement already satisfied: python-dateutil in /home/.../.pyenv/versions/3.11.5/lib/python3.11/site-packages (from PyHive==0.7.0) (2.8.2)\nRequirement already satisfied: six>=1.5 in /home/.../.pyenv/versions/3.11.5/lib/python3.11/site-packages (from python-dateutil->PyHive==0.7.0) (1.16.0)\nUsing cached future-1.0.0-py3-none-any.whl (491 kB)\nInstalling collected packages: future, PyHive\n Running setup.py develop for PyHive\nSuccessfully installed PyHive-0.7.0 future-1.0.0\n\n[notice] A new release of pip is available: 23.2.1 -> 24.1.2\n[notice] To update, run: pip install --upgrade pip\n```\n\n#### Related Unit Tests\nNone\n\n---\n\n# Checklist ๐Ÿ“\n\n- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6568 from alexrashed/fix-pyhive-setuptools-72.\n\nCloses #6567\n\nacfb80903 [Alexander Rashed] remove usage of setuptools.command.test\n\nAuthored-by: Alexander Rashed \nSigned-off-by: Cheng Pan ","shortMessageHtmlLink":"[KYUUBI apache#6567] Fix compatibility of pyhive with setuptools==72.0.0"}},{"before":"6b4d27de8346bcb4ff2203d2f483e672c89b983c","after":"a020098bc2d1cc4ea32df43fd41049266d7b081e","ref":"refs/heads/issue-6254","pushedAt":"2024-07-16T02:34:29.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into issue-6254","shortMessageHtmlLink":"Merge branch 'apache:master' into issue-6254"}},{"before":null,"after":"6b4d27de8346bcb4ff2203d2f483e672c89b983c","ref":"refs/heads/issue-6254","pushedAt":"2024-07-16T02:33:30.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[issue-6254] fix can not find url: 'Github repository', 'Read The Docs'","shortMessageHtmlLink":"[issue-6254] fix can not find url: 'Github repository', 'Read The Docs'"}},{"before":"e14d22f13b1d7984ccb4e84d75582115fc8094b7","after":"80f7496dde317dd820be3ce836e69fce974754a9","ref":"refs/heads/master","pushedAt":"2024-07-06T03:54:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6528] Bump Netty 4.1.108.Final\n\n# :mag: Description\nUpgrade the Netty version to fix the CVEs\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\nGHAs\n\n---\n\n# Checklist ๐Ÿ“\n\n- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6528 from Madhukar525722/netty_upgrade.\n\nCloses #6528\n\n6c083c1fa [madlnu] Bump Netty 4.1.108.Final\n\nAuthored-by: madlnu \nSigned-off-by: Cheng Pan ","shortMessageHtmlLink":"[KYUUBI apache#6528] Bump Netty 4.1.108.Final"}},{"before":"1fb1f854eb40e19dfaad86192017b8b4efd9a2c4","after":"e14d22f13b1d7984ccb4e84d75582115fc8094b7","ref":"refs/heads/master","pushedAt":"2024-07-05T10:40:46.000Z","pushType":"push","commitsCount":38,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6446] Add tests for Spark saveToFile function\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nThis pull request fixes #6446\n\n## Describe Your Solution ๐Ÿ”ง\n\nAdd tests for Spark saveToFile function\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n#### Related Unit Tests\n\n---\n\n# Checklist ๐Ÿ“\n\n- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6467 from lsm1/branch-kyuubi-6446.\n\nCloses #6446\n\n433f78cb4 [senmiaoliu] fix style\nf16821c97 [senmiaoliu] add ut for spark engine save result\n\nAuthored-by: senmiaoliu \nSigned-off-by: senmiaoliu ","shortMessageHtmlLink":"[KYUUBI apache#6446] Add tests for Spark saveToFile function"}},{"before":"97aa4f7e1fd758adbe1314217ef51dd6a23cc9fd","after":"1fb1f854eb40e19dfaad86192017b8b4efd9a2c4","ref":"refs/heads/master","pushedAt":"2024-06-04T07:08:13.000Z","pushType":"push","commitsCount":27,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6439] kyuubi-util-scala test jar leaked to compile scope\n\n# :mag: Description\n\nThe `kyuubi-util-scala_2.12--tests.jar` accidentally leaked to the compile scope but should be in the test scope.\n\n## Types of changes :bookmark:\n\n- [x] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\nRun `build/dist` and check `dist/jars`\n\n---\n\n# Checklist ๐Ÿ“\n\n- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6439 from pan3793/util-scala-test.\n\nCloses #6439\n\n0576248f5 [Cheng Pan] fix\n2bf2408f5 [Cheng Pan] fix\nf7151dfc6 [Cheng Pan] kyuubi-util-scala test jar leaked to compile scope\n\nAuthored-by: Cheng Pan \nSigned-off-by: Cheng Pan ","shortMessageHtmlLink":"[KYUUBI apache#6439] kyuubi-util-scala test jar leaked to compile scope"}},{"before":"c8e645734b0cee93627741c24d3e9d8ff16a4e11","after":"97aa4f7e1fd758adbe1314217ef51dd6a23cc9fd","ref":"refs/heads/master","pushedAt":"2024-05-21T09:02:49.000Z","pushType":"push","commitsCount":10,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6400] Fix memory leak when using saveToFile\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nFix memory leak when using saveToFile mode.\n\nFYI: https://stackoverflow.com/questions/45649044/scala-stream-iterate-and-memory-management\n\nStream is IterableAgain, which means, that it will keep all the elements you iterate through in case you want to see them again.\n\n## Describe Your Solution ๐Ÿ”ง\n\nPlease include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n#### Related Unit Tests\n\n---\n\n# Checklist ๐Ÿ“\n\n- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6400 from turboFei/memory_leak.\n\nCloses #6400\n\ncdea358d6 [Wang, Fei] fix memory leak\n\nAuthored-by: Wang, Fei \nSigned-off-by: Wang, Fei ","shortMessageHtmlLink":"[KYUUBI apache#6400] Fix memory leak when using saveToFile"}},{"before":"cccb94d98a8f71980dcc00a255b3ab337c4cf50e","after":"5524b13f5f9dc1bb5adb51d7eb42575d70de2251","ref":"refs/heads/followup-6297","pushedAt":"2024-05-15T03:11:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"pan3793","name":"Cheng Pan","path":"/pan3793","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26535726?s=80&v=4"},"commit":{"message":"nit","shortMessageHtmlLink":"nit"}},{"before":"90491fc07eb895c9b773cce94dbe54ba636c11f5","after":"c8e645734b0cee93627741c24d3e9d8ff16a4e11","ref":"refs/heads/master","pushedAt":"2024-05-14T12:07:25.000Z","pushType":"push","commitsCount":23,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6344] FlinkProcessBuilder prioritizes user configurations\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nThis pull request fixes #6344\n\n`FlinkProcessBuilder` specifies `yarn.ship-files`, `yarn.application.name` and `yarn.tags` configurations of kyuubi platform. Sometimes we also need to customize these configurations, so we should prioritize these user configurations.\n\n## Describe Your Solution ๐Ÿ”ง\n\nFlinkProcessBuilder prioritizes user configurations.\n\n## Types of changes :bookmark:\n\n- [x] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n#### Related Unit Tests\n\nadded new unit test\n\n---\n\n# Checklist ๐Ÿ“\n\n- [X] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6342 from wForget/hotfix2.\n\nCloses #6344\n\nfeca972ca [wforget] address comment\n17df0844d [wforget] fix test and add flink constant\nece91cc0c [wforget] FlinkProcessBuilder prioritizes user configurations\n\nAuthored-by: wforget <643348094@qq.com>\nSigned-off-by: wforget <643348094@qq.com>","shortMessageHtmlLink":"[KYUUBI apache#6344] FlinkProcessBuilder prioritizes user configurations"}},{"before":"fb03d60c226e1a2e5b0bac1ee4decf96e6e8ac0a","after":"cccb94d98a8f71980dcc00a255b3ab337c4cf50e","ref":"refs/heads/followup-6297","pushedAt":"2024-05-07T01:23:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[# 6297] imporve Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up","shortMessageHtmlLink":"[# 6297] imporve Package Spark SQL engine both Scala 2.12 and 2.13 Foโ€ฆ"}},{"before":"393435ea94231198d42770f9fd18a77cfaf1191a","after":"fb03d60c226e1a2e5b0bac1ee4decf96e6e8ac0a","ref":"refs/heads/followup-6297","pushedAt":"2024-05-06T10:27:33.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into followup-6297","shortMessageHtmlLink":"Merge branch 'apache:master' into followup-6297"}},{"before":"0b49f60e6dd8f339a69c04a5adabcc47519e0c07","after":"393435ea94231198d42770f9fd18a77cfaf1191a","ref":"refs/heads/followup-6297","pushedAt":"2024-04-27T22:15:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[# 6297] imporve Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up","shortMessageHtmlLink":"[# 6297] imporve Package Spark SQL engine both Scala 2.12 and 2.13 Foโ€ฆ"}},{"before":"f7c7a65c89e2f9fd69c0c8e1a54ba23021d0e216","after":"0b49f60e6dd8f339a69c04a5adabcc47519e0c07","ref":"refs/heads/followup-6297","pushedAt":"2024-04-27T11:05:23.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into followup-6297","shortMessageHtmlLink":"Merge branch 'apache:master' into followup-6297"}},{"before":"3d2926afca33165360deca5f37551b6b90fadced","after":"f7c7a65c89e2f9fd69c0c8e1a54ba23021d0e216","ref":"refs/heads/followup-6297","pushedAt":"2024-04-27T10:28:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[# 6297] Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up","shortMessageHtmlLink":"[# 6297] Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up"}},{"before":"eb64061483c800538e2393231ef2b9edc27583a7","after":"3d2926afca33165360deca5f37551b6b90fadced","ref":"refs/heads/followup-6297","pushedAt":"2024-04-21T22:05:59.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into followup-6297","shortMessageHtmlLink":"Merge branch 'apache:master' into followup-6297"}},{"before":null,"after":"eb64061483c800538e2393231ef2b9edc27583a7","ref":"refs/heads/followup-6297","pushedAt":"2024-04-21T12:24:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[followup-issue6297] improve issue6297","shortMessageHtmlLink":"[followup-issue6297] improve issue6297"}},{"before":"1b7fa05d90c6c862e488c8d6d8556afc75d789f3","after":null,"ref":"refs/heads/followup-6297","pushedAt":"2024-04-21T12:23:43.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"}},{"before":"956ac4955adbcacbf55d7ab48144d398b02624a5","after":"1b7fa05d90c6c862e488c8d6d8556afc75d789f3","ref":"refs/heads/followup-6297","pushedAt":"2024-04-21T11:56:14.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into followup-6297","shortMessageHtmlLink":"Merge branch 'apache:master' into followup-6297"}},{"before":"8edcb005ee8c863d5fd070e276a05d9c0c30d018","after":"90491fc07eb895c9b773cce94dbe54ba636c11f5","ref":"refs/heads/master","pushedAt":"2024-04-21T11:41:05.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6321] Support to get Spark Kubernetes app URL\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nNow for kubernetes application, there is no runtime AppURL return in the application report.\n\nIn fact, we can get the driver svc and get the spark-ui port, then build the Spark UI URL same with that of spark.\n\nhttps://github.com/apache/spark/blob/074ddc2825674edcea1bb7febf2c6d8b27c2e375/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L67\n\nhttps://github.com/apache/spark/blob/074ddc2825674edcea1bb7febf2c6d8b27c2e375/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L96-L102\n\nService Selector example:\n```\n selector:\n kyuubi-unique-tag: bf5fa281-0b2f-4096-aa0a-13a463c147a6\n spark-app-selector: spark-bf074093a7994954a89101eb2831bd1e\n```\n## Describe Your Solution ๐Ÿ”ง\n\nPlease include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [ ] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n#### Related Unit Tests\n\n---\n\n# Checklist ๐Ÿ“\n\n- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6318 from turboFei/k8s_spark_ui.\n\nCloses #6321\n\nf77999ef0 [Wang, Fei] with label selector does not work\n4e8d5767b [Wang, Fei] typo\n3f1eb545c [Wang, Fei] comments\n6f0d01d94 [Wang, Fei] ut\n9edfde034 [Wang, Fei] ut\n65d5e8175 [Wang, Fei] using pattern\n9b21d30df [Wang, Fei] Support to get kubernetes app url\n\nAuthored-by: Wang, Fei \nSigned-off-by: Wang, Fei ","shortMessageHtmlLink":"[KYUUBI apache#6321] Support to get Spark Kubernetes app URL"}},{"before":null,"after":"956ac4955adbcacbf55d7ab48144d398b02624a5","ref":"refs/heads/followup-6297","pushedAt":"2024-04-18T11:18:51.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[# 6297] Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up","shortMessageHtmlLink":"[# 6297] Package Spark SQL engine both Scala 2.12 and 2.13 Follow Up"}},{"before":"9aa5269665ef4c153bdafc3cdeb9c45944384bcf","after":"8edcb005ee8c863d5fd070e276a05d9c0c30d018","ref":"refs/heads/master","pushedAt":"2024-04-18T10:32:56.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6315] Spark 3.5: MaxScanStrategy supports DSv2\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nNow, MaxScanStrategy can be adopted to limit max scan file size in some datasources, such as Hive. Hopefully we can enhance MaxScanStrategy to include support for the datasourcev2.\n## Describe Your Solution ๐Ÿ”ง\n\nget the statistics about files scanned through datasourcev2 API\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [x] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n#### Related Unit Tests\n\n---\n\n# Checklists\n## ๐Ÿ“ Author Self Checklist\n\n- [x] My code follows the [style guidelines](https://kyuubi.readthedocs.io/en/master/contributing/code/style.html) of this project\n- [x] I have performed a self-review\n- [x] I have commented my code, particularly in hard-to-understand areas\n- [ ] I have made corresponding changes to the documentation\n- [x] My changes generate no new warnings\n- [x] I have added tests that prove my fix is effective or that my feature works\n- [x] New and existing unit tests pass locally with my changes\n- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n## ๐Ÿ“ Committer Pre-Merge Checklist\n\n- [x] Pull request title is okay.\n- [x] No license issues.\n- [x] Milestone correctly set?\n- [x] Test coverage is ok\n- [x] Assignees are selected.\n- [ ] Minimum number of approvals\n- [ ] No changes are requested\n\n**Be nice. Be informative.**\n\nCloses #5852 from zhaohehuhu/dev-1213.\n\nCloses #6315\n\n3c5b0c276 [hezhao2] reformat\nfb113d625 [hezhao2] disable the rule that checks the maxPartitions for dsv2\nacc358732 [hezhao2] disable the rule that checks the maxPartitions for dsv2\nc8399a021 [hezhao2] fix header\n70c845bee [hezhao2] add UTs\n3a0739686 [hezhao2] add ut\n4d26ce131 [hezhao2] reformat\nf87cb072c [hezhao2] reformat\nb307022b8 [hezhao2] move code to Spark 3.5\n73258c2ae [hezhao2] fix unused import\ncf893a0e1 [hezhao2] drop reflection for loading iceberg class\ndc128bc8e [hezhao2] refactor code\n661834cce [hezhao2] revert code\n6061f42ab [hezhao2] delete IcebergSparkPlanHelper\n5f1c3c082 [hezhao2] fix\nb15652f05 [hezhao2] remove iceberg dependency\nfe620ca92 [hezhao2] enable MaxScanStrategy when accessing iceberg datasource\n\nAuthored-by: hezhao2 \nSigned-off-by: Cheng Pan ","shortMessageHtmlLink":"[KYUUBI apache#6315] Spark 3.5: MaxScanStrategy supports DSv2"}},{"before":"cdb435d01c2a3be7f850a82c5e70b990954c4a7d","after":"327030170f32c046e9cf179cf98cf05d8077678c","ref":"refs/heads/issue-6294","pushedAt":"2024-04-17T03:19:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"pan3793","name":"Cheng Pan","path":"/pan3793","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26535726?s=80&v=4"},"commit":{"message":"simplify netty dependency management","shortMessageHtmlLink":"simplify netty dependency management"}},{"before":"e0676ed5a902e68d8e0c6c0dd47f078a000d2cd2","after":"cdb435d01c2a3be7f850a82c5e70b990954c4a7d","ref":"refs/heads/issue-6294","pushedAt":"2024-04-16T13:30:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[# 6294] Prune unused Netty libraries","shortMessageHtmlLink":"[# 6294] Prune unused Netty libraries"}},{"before":null,"after":"e0676ed5a902e68d8e0c6c0dd47f078a000d2cd2","ref":"refs/heads/issue-6294","pushedAt":"2024-04-15T10:42:26.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Finished Prune unused Netty libraries [#6294]","shortMessageHtmlLink":"Finished Prune unused Netty libraries [apache#6294]"}},{"before":"efc864373e9a2487dc59828b936e8bcd33bf8ec9","after":"5e00a9eae9c54fc906773643a03a9631a56e06c7","ref":"refs/heads/issue-6297","pushedAt":"2024-04-15T10:41:30.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Merge branch 'apache:master' into issue-6297","shortMessageHtmlLink":"Merge branch 'apache:master' into issue-6297"}},{"before":"9086cfe054969320bc5a29ffbbdd11e2412abfff","after":"9aa5269665ef4c153bdafc3cdeb9c45944384bcf","ref":"refs/heads/master","pushedAt":"2024-04-15T10:41:14.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6253] Support running JDBC engine on YARN AM\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nThis pull request fixes #6253\n\n## Describe Your Solution ๐Ÿ”ง\n\nPlease include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [x] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n#### Behavior Without This Pull Request :coffin:\n\n#### Behavior With This Pull Request :tada:\n\n\"image\"\n\n#### Related Unit Tests\n\n---\n\n# Checklist ๐Ÿ“\n\n- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6275 from lsm1/branch-jdbc-engine-on-yarn.\n\nCloses #6253\n\n5ed4af041 [senmiaoliu] fix style\n86e032688 [senmiaoliu] fix style\nb3e114445 [senmiaoliu] fix style\nbf33de300 [senmiaoliu] fix style\nc38404918 [senmiaoliu] jdbc engine on yarn\n\nAuthored-by: senmiaoliu \nSigned-off-by: Shaoyun Chen ","shortMessageHtmlLink":"[KYUUBI apache#6253] Support running JDBC engine on YARN AM"}},{"before":"37bf24423644911ac3e9d6d0d5444561b0858cda","after":"9086cfe054969320bc5a29ffbbdd11e2412abfff","ref":"refs/heads/master","pushedAt":"2024-04-15T02:22:20.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"[KYUUBI #6297] Package Spark SQL engine both Scala 2.12 and 2.13\n\n# :mag: Description\n## Issue References ๐Ÿ”—\n\nThis pull request fixes #6297\n\n## Describe Your Solution ๐Ÿ”ง\n\nHere are my main modifications:\n1. In the `build/dist` file, I added an additional packaging command that detects the version of `SCALA_VERSION`. If it is version 2.12, then it will additionally package version 2.13, otherwise it will package version 2.12\n2. In the section of `# Copy spark engines`, the Jar packages of versions 2.12 and 2.13 will be moved to `$DISTDIR/externals/engines/spark/`\n\nThis is my first time submitting a PR, so there may be many unfamiliar areas, and I don't know if my changes meet the needs of the community. More guidance may be needed. When testing locally, it was able to be packaged successfully\n\n## Types of changes :bookmark:\n\n- [ ] Bugfix (non-breaking change which fixes an issue)\n- [x] New feature (non-breaking change which adds functionality)\n- [ ] Breaking change (fix or feature that would cause existing functionality to change)\n\n## Test Plan ๐Ÿงช\n\n![image](https://github.com/apache/kyuubi/assets/96274454/fb1981e0-dc3f-47a3-a497-2ae0d3161e6b)\n\n![image](https://github.com/apache/kyuubi/assets/96274454/b7307738-7699-4c2c-b6ad-08b323539d90)\n\n---\n\n# Checklist ๐Ÿ“\n\n- [x] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)\n\n**Be nice. Be informative.**\n\nCloses #6305 from PorterZhang2021/issue-6297.\n\nCloses #6297\n\nefc864373 [PorterZhang2021] Improved task \"Package Spark SQL engine both Scala 2.12 and 2.13\" #6297\ncb9310bee [PorterZhang2021] Improved task \"Package Spark SQL engine both Scala 2.12 and 2.13\" #6297\nb6c907509 [PorterZhang2021] Finished task \"Package Spark SQL engine both Scala 2.12 and 2.13\" #6297\n\nAuthored-by: PorterZhang2021 \nSigned-off-by: Cheng Pan ","shortMessageHtmlLink":"[KYUUBI apache#6297] Package Spark SQL engine both Scala 2.12 and 2.13"}},{"before":"b6c9075097cd2ead686249640d88443e2905d351","after":"efc864373e9a2487dc59828b936e8bcd33bf8ec9","ref":"refs/heads/issue-6297","pushedAt":"2024-04-14T09:37:45.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"PorterZhang2021","name":"Porter Zhang","path":"/PorterZhang2021","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/96274454?s=80&v=4"},"commit":{"message":"Improved task \"Package Spark SQL engine both Scala 2.12 and 2.13\" #6297","shortMessageHtmlLink":"Improved task \"Package Spark SQL engine both Scala 2.12 and 2.13\" apaโ€ฆ"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNy0zMFQxMDozODoyMC4wMDAwMDBazwAAAASM2yyl","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNy0zMFQxMDozODoyMC4wMDAwMDBazwAAAASM2yyl","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNC0xNFQwOTozNzo0NS4wMDAwMDBazwAAAAQwJCTx"}},"title":"Activity ยท PorterZhang2021/kyuubi"}