Dinky v1.2.0

Feature

• added npm profiles
• Add bug template version number
• Add built-in Flink History Server to reduce the state of the Unknown, the final information of the Flink task is more accurate
• Added support for Flink 1.20 and updated dependencies on other Flink versions
• Support task export
• Add global token
• Support resource of physical deletion
• Support paimon hdfs hive datasource
• Obtain job information using the ingress address
• Flink SQL task Support insert result preview
• Add welcome init page
• FlinkSQL Studio supports real-time update task status
• Flink jar add form
• Provide init tools
• Support pgsql flink catalog
• Add E2E Test Programing process

Fix

• Fix the issue of error when executing show statement
• Fix Json serialization and deserialization
• Fix flink 1.19 cli bug
• Fix bug "all ip port is not available"
• Fix the issue where the enable button in Git Project forms does not have a default value
• Fix the issue with the saveOrUpdate method in the git project module
• Fix SavePoint path logic and adjust the configuration method of Flink configuration acquisition
• Resolve the issue of "Exceeding storage quota" when too many job tabs are open
• Fix git build some bug
• Fix the issue of unsupported global variable substitution when fetching field lineage
• Fix thumbnail display in code editor
• Fix the SQL auto initialization issue of PG
• Fix oracle column type convert error
• Fix some bugs that occurred when Flink was submitted in local mode
• Fix the issue where flyway does not support mysql5.7
• Fix abnormal data in pg query
• Fix exception caused by no instance when clicking on a job on the optimization workbench
• Fix execute failed
• Fix query oracle primary key column bug
• Fix task tree can not sorting
• Fix the issue of unlimited refresh of Git project pages
• Fix null pointer exception occurs when dinky configures DingTalk alarm
• Fix some minor bugs
• Fix the issue of array out of bounds when fetching lineage information
• Fix SQL injection error caused by upgrading Druid version
• Fix the catalog display field bug
• Fix execute jar submit in yarn-application
• Fix null pointer exception occurs in alert
• Fix the issue where the table name has a middle line that prevents task execution
• Fix configuration key error
• Fix job alert dinky address url
• Fix menu mapper
• Fix job id is null exception in query model
• Fix Keberos bug related repair, SQL SET value does not take effect, etc
• Fix do not save job instance in query mode
• Fix ws bug
• Fix web package
• Fix Dinky backend CI workflow with Flink 1.20
• Fix the issue of primary key generation strategy
• Fix the issue of Object not found when mocking statement
• Fix datastudio footer state
• Fix the issue of incomplete dependencies in the docs module
• Close the data development page, floating button
• Fix the data development page and enable system configuration
• Fix k8s form ingresss bug
• Fix the route redirection error on the welcome page
• Fix the Flink task to submit the session mode
• Fix web npe
• Fix web clear bug
• Fixed an error when using the copy button in the Resource Center
• Issue with creating a new task with a subdirectory of the same name
• Restrictions on task names when running in Kubernetes mode
• Fix k8s test bug
• Fix data development and introduce LESS to cause the global CSS style confusion
• Fix data development, Flink jar task toolbar display
• Fix pg bug
• Fix dolphinscheduler calls dinky tasks and concurrent execution exceptions
• Fix Yarn webui fails to obtain task status when submitting a Flink task after turning on Kerberos authentication
• Fix the issue where the submitted job name remains unchanged when renaming the job
• Fix alert serializable
• Fix login bug
• Fix flink jar submit
• Fix automation script path issue
• Fix git code builds error
• Fix yarn parallel submit
• Fix NPE when executing a query statement on the PG table
• Fix the issue where FlinkJar cannot use global variables

Optimize

• Optimize version update logic to solve cache issues caused by upgrades
• Optimize the worker's place page display
• Refactor metric request
• Refactor the method of obtaining user.dir
• SSE switch to global websocket and web container switches from Tomcat to Undertow
• Add getSchemas and getTables api
• Delete dinky_cluster index
• Optimize mapper queries
• Optimizing class attribute type issues
• Delete the prompt message on the UDF registration management page
• Optimize some web layouts to make them more user-friendly when displayed on small screens
• Optimizing the virtual scrolling problem of data source detail list
• Optimize login page
• Optimize doc action
• Upgrade doc some deps
• Improve get table info of the schema
• Optimize program start
• Optimize cluster configuration and start session cluster for manual registration
• Introduction and layout of configuration items in the optimization configuration center
• Tips for optimizing role permissions
• Obtain bloodline to increase loading effect
• Try to achieve unified JSON(jackson) serialization as much as possible
• Add hints: role and tenant are bound
• Optimize some page layouts, update web dependencies, and fix some bugs
• Modify and upgrade SQL file version number
• Optimize the display of Flink operator diagram in the operation and maintenance center
• Optimize dinky flink web UI
• oracle timestamp column type order is changed to precede time column
• Optimize task list layout
• Optimize some code
• Add repeat import task
• Limit the maximum percentage of container memory used by the JVM via -XX:MaxRAMPercentage
• Optimized the printing of K8S logs
• Optimize flink application mode status refresh
• Refactoring a new data development interface to enhance the user experience
• Remove the restriction on underscores in job names
• Change token key name
• Remove quotation marks when building FlinkSQL
• Upgrade cdc to 3.2.0
• Add package-lock.json
• Refactor get version function
• Add tag right-click function
• Optimized the new UI
• Optimize debug task to preview data
• Optimize FlinkDDL execution sequence
• Remove the old version of the data development page and fix some minor details
• Uniformly use '/' as the file separator
• Optimize explain and add test
• Move DataStudioNew to DataStudio
• Refactor result query
• Add websocket PING PONG
• Add footer last update time
• Optimize the style of IDE
• Remove old lineage
• Optimize datastudio theme
• Optimize CDCSOURCE and support sink print and mock
• Optimized offline button icon
• Optimize web icon
• Improve print table data display method
• Optimize the status of runing task and beautify UI
• Optimize the logic for constructing role menus
• Improved the missing exception message when uploading files in the Resource Center
• Optimize submit task print error log
• Click the Tasks tab to switch to Service Synchronization
• Delete the previously failed cluster when resubmitting the task
• Optimize flink jar form select
• Optimize app package size
• Variable suggestion optimization
• Add Deployment status monitoring
• Add resource management to the datastudio page
• Optimize some script
• Add default jobmanager.memory.process.size parameter
• Optimization scheduler request error assert method
• Refactor udf execute
• Optimize blood relationship acquisition, add Savepoint, optimize udf class name display
• Optimization devops page ui
• Modify sqllite data position
• Change Chinese comments to English comments
• Add welcome page auto width
• Add push task into DolphinScheduler

Document

• In k8s mode, submit tasks and refine documents
• Add Datasophon integration with Dinky
• Add Flink Cli Doc
• Update ICP in document
• Update deploy guide reference
• Fix deploy doc
• Doc of debug data preview update
• Update images in Quick Start documentation
• Optimize the status of runing task and beautify UI
• Optimize Dinky without Flink dependency, unable to start
• Optimized the package size of the App and the rs protocol
• Modify the wrong links in README.md and README_zh_CN.md regarding source code deployment on how to deploy.

Contributors

@aiwenmo
@binggana
@chenhaipeng
@dagenjun
@emmanuel-ferdman
@gaoyan1998
@gphwxhq
@hashmapybx
@Jam804
@javaht
@jianjun159
@leechor
@MactavishCui
@maikouliujian
@MaoMiMao
@miaoze8
@RainHXXXX
@stevenkitter
@soulmz
@suger-bl
@suxinshuo
@yuxiqian
@zackyoungh
@zhuangchong
@zhuxt2015
@Zzm0809
@18216499322