Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: ERROR 20101 (HY000): internal error: Data too long for blob #20666

Closed
1 task done
yangj1211 opened this issue Dec 9, 2024 · 6 comments
Closed
1 task done

[Bug]: ERROR 20101 (HY000): internal error: Data too long for blob #20666

yangj1211 opened this issue Dec 9, 2024 · 6 comments
Assignees
Labels
kind/bug Something isn't working phase/testing priority/p0 Critical feature that should be implemented in this version severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Milestone

Comments

@yangj1211
Copy link
Contributor

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch Name

main

Commit ID

newest

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

使用load_file()查看496k的二进制文件报错"data too long for blob"

image image

Expected Behavior

No response

Steps to Reproduce

1、下载二进制文件:https://github.com/matrixorigin/matrixone/blob/main/test/distributed/resources/blob_file/blob2.mp3

2、执行查询语句:
 SELECT LOAD_FILE('/Users/admin/Downloads/fruit01/blob2.mp3');

Additional information

No response

@yangj1211 yangj1211 added kind/bug Something isn't working priority/p0 Critical feature that should be implemented in this version needs-triage severity/s0 Extreme impact: Cause the application to break down and seriously affect the use labels Dec 9, 2024
@yangj1211 yangj1211 added this to the 2.0.1 milestone Dec 9, 2024
@yangj1211 yangj1211 modified the milestones: 2.0.1, 2.0.2 Dec 9, 2024
@ouyuanning ouyuanning assigned daviszhen and unassigned ouyuanning Dec 9, 2024
@ouyuanning
Copy link
Contributor

image
目前配置上支持的大小是 65536 。目前的返回看来是预期行为。

估计要跟产品一起对一下处理方式

@yangj1211
Copy link
Contributor Author

mysql中 BLOB 类型有四种,根据存储数据的最大大小不同:
https://dev.mysql.com/doc/refman/8.0/en/storage-requirements.html
image

根据mo官网文档,mo只有blob一种类型,大小为1gb:
image

@allengaoo ,需要明确产品行为:
1、和mysql对齐,支持四种类型的blob
2、保持之前设计,支持blob一种类型,最大支持1gb
3、其他

@fengttt
Copy link
Contributor

fengttt commented Dec 9, 2024

I think we should make text and blob back to some bigger value. 64KB is probably too small. On the other hand, 1GB is stretching our limit -- we will not be able to allocate and will not be able to do any useful things.

A more reasonable number is something like 8 - 64MB. I don't think we should go for 1GB -- user should use S3 object and datalink for that kind of stuff.

@daviszhen daviszhen assigned qingxinhome and unassigned daviszhen Dec 9, 2024
@yangj1211
Copy link
Contributor Author

bug 转 feature: #20677

@qingxinhome
Copy link
Contributor

This issue has been fixed, please verify and test it @yangj1211 @aressu1985

@heni02
Copy link
Contributor

heni02 commented Jan 9, 2025

#20677 测试后没有这个问题,closed

@heni02 heni02 closed this as completed Jan 9, 2025
@matrix-meow matrix-meow reopened this Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working phase/testing priority/p0 Critical feature that should be implemented in this version severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Projects
None yet
Development

No branches or pull requests

8 participants