Skip to content
Draft

RMI #3662

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
125 commits
Select commit Hold shift + click to select a range
28bc668
feat: init
leechor Mar 9, 2024
8891fa8
Spotless Apply
leechor Mar 9, 2024
37017b0
fix:
leechor Mar 11, 2024
81f34ef
Merge branch 'deseparate' of github.com:leechor/dinky into deseparate
leechor Mar 11, 2024
0a0cb84
Spotless Apply
leechor Mar 11, 2024
825500b
refactor: move DinkyLoader to Executor.java
leechor Mar 11, 2024
0409a31
refactor: add Executor interface
leechor Mar 11, 2024
6ad4759
refactor: JobManager executor
leechor Mar 11, 2024
069ed9e
feat: patch ServerExecutorServiceImpl
leechor Mar 11, 2024
121edad
Merge branch 'deseparate' of github.com:leechor/dinky into deseparate
leechor Mar 11, 2024
0ccf5e4
Spotless Apply
leechor Mar 11, 2024
57aabe2
storage
leechor Mar 12, 2024
b74582a
test: gpg
leechor Mar 12, 2024
13ebc40
storage: refactor move
leechor Mar 14, 2024
df752e5
Spotless Apply
leechor Mar 14, 2024
b1ac89f
refactor:
leechor Mar 14, 2024
359ad2a
refactor: Explainer remove flink dependency
leechor Mar 14, 2024
59febc8
refactor: getLineage
leechor Mar 14, 2024
9a46ed0
refactor: JobBuilder
leechor Mar 16, 2024
6a7e9a8
refactor: JobManager
leechor Mar 16, 2024
ef4b151
Spotless Apply
leechor Mar 16, 2024
b84fb0a
feat: creae JobManagerHandler
leechor Mar 17, 2024
48a2dd4
Spotless Apply
leechor Mar 17, 2024
40190dd
refactor:
leechor Mar 20, 2024
6f3239c
feat: compile complete
leechor Mar 20, 2024
175a394
feat: could startup
leechor Mar 20, 2024
9c597f0
feat: could startup
leechor Mar 21, 2024
c788625
storage
leechor Mar 23, 2024
931cccd
Spotless Apply
leechor Mar 23, 2024
9a4906c
feat: could execute
leechor Mar 24, 2024
f080cab
Spotless Apply
leechor Mar 24, 2024
d38f779
fix: remvoe weak dinkyClassLoader
Mar 24, 2024
94dbab6
Spotless Apply
leechor Mar 24, 2024
69df3d2
fix: job change at remote server
Mar 26, 2024
a326439
refactor: remove job member
Mar 26, 2024
e91a68d
feat: refactor remove dinky-core dependence and could compile
Mar 31, 2024
50e1e73
Spotless Apply
leechor Mar 31, 2024
5ff2dbc
fix
Mar 31, 2024
ec094a4
Spotless Apply
leechor Mar 31, 2024
ef6f6de
feat: could run
Apr 2, 2024
59e08f8
feat: could run task
Apr 2, 2024
8e693d7
[Improvement] Optimize selection prompt information when querying in …
LeonYoah Mar 9, 2024
b931caf
[Fix] fix the decimal precision of postgres transform (#3263)
javaht Mar 9, 2024
3613ff7
[Fix] fix modal cannot close (#3264)
Zzzz-zmy Mar 9, 2024
0b6c059
[Optimization]Optimize the environment check of git project build (#3…
Zzzz-zmy Mar 9, 2024
935a53c
[Fix] Fix unrecognized global variables defined by registry in applic…
Zzzz-zmy Mar 9, 2024
ab3ae95
[Fix] fix proxy url is error (#3270)
Zzzz-zmy Mar 11, 2024
db300d8
[Optimization] [web] move url to constants (#3271)
Zzzz-zmy Mar 11, 2024
31915db
[Document-3268][doc] Update dinky_principle.png (#3269)
aiwenmo Mar 11, 2024
4417599
[Optimization][admin] NULL may be used when optimizing heartbeat dete…
czshh0628 Mar 11, 2024
a26d92a
[Document]Fix cdcsource practice documents for Mysql and PostgreSQL (…
czshh0628 Mar 11, 2024
0a12f5a
[Fix] fix addfile cannot parse (#3278)
Zzzz-zmy Mar 12, 2024
06f4487
[Bug] fix rs filesystem some problem (#3234)
gaoyan1998 Mar 12, 2024
8c5b295
[Fix] fix array out of bounds (#3279)
Zzzz-zmy Mar 13, 2024
aca823b
[Doc]Overview of entire library synchronization: update dinky-client-…
Gianzie Mar 13, 2024
291a4a5
[Document-3281][web]JobManager HA address example misses port number …
pangliang Mar 13, 2024
6735db4
[Feature] Release-1.0.1 (#3287)
Zzzz-zmy Mar 13, 2024
0b00565
[Doc] fix jump url error (#3288)
Zzzz-zmy Mar 14, 2024
15f95fc
[HotFix] hotfix auto.sh (#3289)
Zzzz-zmy Mar 14, 2024
77d8c52
[Fix] Fix the global variable recognition order issue in the applicat…
Zzzz-zmy Mar 15, 2024
5ef12b9
[Optimization] Optimization start scripts (#3296)
Zzzz-zmy Mar 15, 2024
29a54eb
[Optimization] Optimization setting page overflow (#3297)
Zzzz-zmy Mar 18, 2024
be79c90
[Optimization] Optimization udf manage tips (#3295)
Zzzz-zmy Mar 18, 2024
2d40f50
[Fix][Admin] Fix the SQL error for querying user roles (#3305)
18216499322 Mar 18, 2024
13849db
[Fix] fix possible 404 in redirect routing (#3303)
Zzzz-zmy Mar 19, 2024
42413ce
[Doc] modify expression variable extension document (#3302)
Zzzz-zmy Mar 19, 2024
6787f30
[Fix] fix datasource heartbeat error (#3298)
Zzzz-zmy Mar 19, 2024
a050a6b
[Fix] fix some component cannot render (#3272)
Zzzz-zmy Mar 19, 2024
076ebdd
Update cdcsource_mysqlcdc2kafka.md (#3310)
Pandas886 Mar 19, 2024
cb6c5af
[Optimization] optimization execute jar params parse (#3277)
Pandas886 Mar 20, 2024
55a9e2c
[Doc][faq] add JDBC tinyint type conversion failure log faqs (#3313)
Ghostbaby Mar 21, 2024
2b35c64
[Optmize] Devops list support order by Time (#3319)
gaoyan1998 Mar 22, 2024
5bb6cae
[Bug] Fix vaible parse err missing tips (#3316)
gaoyan1998 Mar 22, 2024
0fa7482
Refactor app submit with sql file (#3315)
gaoyan1998 Mar 22, 2024
b35fc95
[Fix] Fix cursor movement flicker in editor (#3321)
zRains Mar 24, 2024
35b13e5
[BugFix] [PyFlink] Fix flink1.18 python options (#3324)
zackyoungh Mar 25, 2024
e187d63
[Fix][docker] Fix the docker file of DockerfileDinkyFlink (#3323)
dailai Mar 25, 2024
402f580
[Doc] support doc home page Carousel component (#3328)
Zzzz-zmy Mar 26, 2024
067d876
[Fix][Admin] Fix the null pointer exception in the user list of the r…
18216499322 Mar 26, 2024
de3bf89
[Doc] Fix doc home page layout (#3329)
Zzzz-zmy Mar 26, 2024
928289b
[Bug] fix some k8s bug (#3338)
gaoyan1998 Mar 29, 2024
d60d153
[Improvement] Excluding high risk endpoints (#3339)
Zzzz-zmy Mar 31, 2024
4a324f5
[Optimize][Sql] Optimize git demo address (#3334)
zackyoungh Apr 1, 2024
0578443
[Fix] fix time type convert (#3348)
Zzzz-zmy Apr 2, 2024
6dd5ca6
[Fix-3354][dinky-admin] Fix CodeGeneratorImpl load fail by spi (#3355)
sgsdehen Apr 3, 2024
ec581d3
[Bug] Fix k8s pod template not decorate bug (#3350)
gaoyan1998 Apr 3, 2024
e0c7dee
Merge commit '66c719443e00007ac5ed381ad19d40e6540246ff' into deseparate
Jul 14, 2024
1b6e3de
Merge commit '195ae61d042efced6f29a4f1072ce69e1d071a57' into deseparate
Jul 14, 2024
725462b
Merge commit 'ea4599d369d28e937ee2a3be715ccbbb72e8cd58' into deseparate
Jul 14, 2024
0276901
Merge commit '0f5acd0d18ab01066b4a7a7837d59829e64ac054' into deseparate
Jul 14, 2024
befff40
Merge commit '2fd0baa93f614f09b8ba017c192af622b9f880da' into deseparate
Jul 14, 2024
224c050
Merge commit '29cbffa2faf4219558182b84de157a7777f734a0' into deseparate
Jul 14, 2024
312065b
Merge commit 'b099de0d7cc088a0ae342b4879d0fe0d1994951f' into deseparate
Jul 14, 2024
894ff68
Merge commit 'd30910ff21c9635cf95b04e37f0dda0f9c593545' into deseparate
Jul 14, 2024
f80f40c
Merge commit 'c08a0d20e5bdf1d78554795a7cb1a79234a6111d' into deseparate
Jul 14, 2024
aa20d4e
Merge commit '3c07d9ba36d128a7e2567db4def8fb26043e011a' into deseparate
Jul 14, 2024
c83c7ea
Merge commit 'ee5d367bd606fc571c35c51360bbe1f4ca72f4ae' into deseparate
Jul 14, 2024
4bb239b
Merge commit '7fa870fb10efa164cff95f85fd7513892bf03655' into deseparate
Jul 14, 2024
d11fabb
Merge commit '67b7a7e76274606aa6aa3ed00a0ac65e78a52214' into deseparate
Jul 14, 2024
63e5610
Merge commit '695b78d427e8532dc8104bafd8d259999bdeab19' into deseparate
Jul 14, 2024
99163c1
Merge commit '375df0c78fa72608fbce6b5afccf53c0888197e6' into deseparate
Jul 14, 2024
dbeb517
Merge commit '48f7e9cbaeb404807f20b106c88b55f69aac7333' into deseparate
Jul 14, 2024
0d22410
Merge commit '4cfd123d3887f3f49d8f05d3c7089d75a40ac5c3' into deseparate
Jul 14, 2024
3414fc8
Merge commit '443f501116e5a10676e796a8cc5160f081ed5187' into deseparate
Jul 14, 2024
dc77b51
Merge commit '64fe0da076366c5d7b12d4932d4b6b13acbc1001' into deseparate
Jul 14, 2024
53f8251
Merge commit '4013cfae3a1ff1a9879469b082453d91c5f92f07' into deseparate
Jul 14, 2024
c1e4b8c
Merge commit '72c765d482583ad6c7d4757bf4b1c5a328bcd81f' into deseparate
Jul 14, 2024
bd6b2e4
Merge commit '2b9f627e75ace023cfd50de6ee9cd94c50d14c58' into deseparate
Apr 4, 2024
813a13f
Merge commit '779c485727cd538cd5bc5c79d6ae1726206cd615' into deseparate
Jul 16, 2024
efda8d4
Merge commit '3b4b431e2a3be5df1da7780099fa61a26b782c46' into deseparate
Jul 16, 2024
37475ad
Merge commit 'ec1abfe1fcc46b0412c3568b7100e829a53e4f67' into deseparate
Jul 16, 2024
7b40a5d
this imporve not merged, if need, implement it again, Merge commit '9…
Jul 17, 2024
e1e3659
Merge branch 'udev' into deseparate
Jul 17, 2024
ee0f8d3
Merge branch 'udev' into deseparate
Jul 17, 2024
830557d
style: spotless
Jul 17, 2024
c5ad627
Merge branch 'udev' into deseparate
Jul 18, 2024
35b0fe0
Merge branch 'udev' into odeseparate
Jul 18, 2024
298c556
Merge commit '2b9f627e75ace023cfd50de6ee9cd94c50d14c58' into deseparate
Aug 3, 2024
29d343b
feat: merge
Aug 3, 2024
a2de2ab
feat: add calude.md
Aug 26, 2025
03ed396
Merge commit '2aaa1e0ee19dcbfb47e7886c9b9cc31a6457b302' into rmi
Aug 27, 2025
83927cd
Merge commit 'b8c2da895fadd312bc652c9312f052e4112d0553' into rmi
Aug 27, 2025
ac8a31a
Merge commit '16f9a57880adb4befc19d8749fa6383bb2664f2e' into rmi
Aug 27, 2025
4171a5a
Merge commit 'c35b797902205ca40b904a72ed4342efacb9cbba' into rmi
Aug 27, 2025
64287be
Merge commit '1b2995d86d9e79d8cdc82da196656339a3f6148f' into rmi
Aug 27, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1,400 changes: 0 additions & 1,400 deletions .idea/icon.svg

This file was deleted.

11 changes: 0 additions & 11 deletions .idea/vcs.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

87 changes: 87 additions & 0 deletions CLAUDE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,87 @@
# CLAUDE.md

This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.

## Project Overview

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation. It's a full-stack application with a Java/Spring Boot backend and React/TypeScript frontend.

## Build and Development Commands

### Backend (Java/Maven)
- **Build**: `./mvnw clean package -Dmaven.test.skip=true -P aliyun,prod,web,flink-1.14`
- **Build script**: `./build.sh` (uses Flink 1.14 profile by default)
- **Test**: `./mvnw test`
- **Format code**: `./mvnw spotless:apply`
- **Check code style**: `./mvnw spotless:check`

### Frontend (React/TypeScript)
Navigate to `dinky-web/` directory:
- **Development server**: `npm run dev` or `npm run start:dev`
- **Build**: `npm run build`
- **Lint**: `npm run lint`
- **Format**: `npm run prettier`
- **Type check**: `npm run tsc`

### Profiles and Configurations
- **Flink versions**: Supports Flink 1.14-1.19 via Maven profiles (`flink-1.14`, `flink-1.15`, etc.)
- **Environment**: Use `-P dev` for development (compile scope) or `-P prod` for production (provided scope)
- **Repositories**: Default uses Aliyun mirror (`-P aliyun`), can switch to Maven Central (`-P maven-central`)

## Code Architecture

### Backend Structure
- **dinky-admin**: Main Spring Boot application entry point (`org.dinky.Dinky`)
- **dinky-core**: Core execution engine and Flink integration
- **dinky-flink**: Flink version-specific implementations (1.14-1.19)
- **dinky-gateway**: Gateway and cluster management
- **dinky-metadata**: Database metadata providers (MySQL, PostgreSQL, ClickHouse, etc.)
- **dinky-cdc**: Change Data Capture functionality
- **dinky-alert**: Alert system with multiple providers (DingTalk, WeChat, Email, etc.)
- **dinky-web**: React frontend application

### Frontend Structure
- **DataStudio**: Main FlinkSQL development interface with editor, console, and results
- **DevOps**: Job monitoring, metrics, and operations
- **RegCenter**: Registration center for clusters, datasources, UDFs, etc.
- **AuthCenter**: User management, roles, and permissions
- **SettingCenter**: System configuration and settings

### Key Components
- **Executor Framework**: Abstracts different Flink execution modes (Local, Standalone, Yarn, Kubernetes)
- **Multi-version Support**: Supports multiple Flink versions through modular architecture
- **SQL Enhancement**: Extends FlinkSQL with custom statements (CDC, variables, etc.)
- **Catalog Integration**: Supports various data catalogs and metadata discovery

## Development Notes

### Multi-module Maven Project
- Root POM manages all module dependencies and versions
- Each Flink version has its own module for compatibility
- Uses dependency management for consistent versioning across modules

### Frontend Technology Stack
- **Framework**: React 18 + TypeScript + UMI 4
- **UI Library**: Ant Design + Pro Components
- **Editor**: Monaco Editor for SQL development
- **Charts**: ECharts, G2, Ant Design Charts
- **State Management**: Built-in UMI models

### Code Quality
- **Java**: Uses Spotless with Palantir Java format
- **Frontend**: ESLint + Prettier configuration
- **License**: All files must include Apache 2.0 license header

## Testing

- **Backend**: JUnit 5 + Mockito for unit tests
- **Integration**: TestContainers for database testing
- **Frontend**: Jest configuration available

## Database Support

Supports multiple databases with dedicated metadata modules:
- MySQL, PostgreSQL (primary)
- ClickHouse, Doris, StarRocks
- Oracle, SQL Server
- H2 (for testing/development)
56 changes: 30 additions & 26 deletions dinky-admin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,10 @@
</properties>

<dependencies>
<!-- <dependency>-->
<!-- <groupId>org.dinky</groupId>-->
<!-- <artifactId>dinky-executor-server</artifactId>-->
<!-- </dependency>-->
<dependency>
<groupId>org.xerial</groupId>
<artifactId>sqlite-jdbc</artifactId>
Expand Down Expand Up @@ -183,28 +187,28 @@
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-actuator</artifactId>
</dependency>
<dependency>
<groupId>org.dinky</groupId>
<artifactId>dinky-gateway</artifactId>
</dependency>
<dependency>
<groupId>org.dinky</groupId>
<artifactId>dinky-core</artifactId>
<exclusions>
<exclusion>
<groupId>cn.hutool</groupId>
<artifactId>hutool-crypto</artifactId>
</exclusion>
<exclusion>
<groupId>cn.hutool</groupId>
<artifactId>hutool-http</artifactId>
</exclusion>
<exclusion>
<groupId>cn.hutool</groupId>
<artifactId>hutool-json</artifactId>
</exclusion>
</exclusions>
</dependency>
<!-- <dependency>-->
<!-- <groupId>org.dinky</groupId>-->
<!-- <artifactId>dinky-gateway</artifactId>-->
<!-- </dependency>-->
<!-- <dependency>-->
<!-- <groupId>org.dinky</groupId>-->
<!-- <artifactId>dinky-core</artifactId>-->
<!-- <exclusions>-->
<!-- <exclusion>-->
<!-- <groupId>cn.hutool</groupId>-->
<!-- <artifactId>hutool-crypto</artifactId>-->
<!-- </exclusion>-->
<!-- <exclusion>-->
<!-- <groupId>cn.hutool</groupId>-->
<!-- <artifactId>hutool-http</artifactId>-->
<!-- </exclusion>-->
<!-- <exclusion>-->
<!-- <groupId>cn.hutool</groupId>-->
<!-- <artifactId>hutool-json</artifactId>-->
<!-- </exclusion>-->
<!-- </exclusions>-->
<!-- </dependency>-->
<dependency>
<groupId>org.dinky</groupId>
<artifactId>dinky-daemon</artifactId>
Expand All @@ -225,10 +229,10 @@
<groupId>org.dinky</groupId>
<artifactId>dinky-alert-base</artifactId>
</dependency>
<dependency>
<groupId>org.dinky</groupId>
<artifactId>dinky-client-base</artifactId>
</dependency>
<!-- <dependency>-->
<!-- <groupId>org.dinky</groupId>-->
<!-- <artifactId>dinky-client-base</artifactId>-->
<!-- </dependency>-->
<dependency>
<groupId>org.dinky</groupId>
<artifactId>dinky-client-hadoop</artifactId>
Expand Down
Loading
Loading