[GH-ISSUE #1201] Performance degradation in case of SQLite JSON fields with size ~1 MB #264

Closed
opened 2026-03-07 20:47:01 +03:00 by kerem · 5 comments
Owner

Originally created by @YuraKril on GitHub (Oct 6, 2022).
Original GitHub issue: https://github.com/dbeaver/cloudbeaver/issues/1201

Describe the bug
Performance degradation
The computer lags.
Table view not work

image

To Reproduce
Steps to reproduce the behavior:

  1. Create a new SQLite database file with at least one JSON field.
  2. Insert some rows of data.
  3. Try to open the database file

Desktop (please complete the following information):

  • OS: Ubuntu 22.04
  • Chrome
  • Version 106.0.5249.91 (Official Build) (64-bit)
Originally created by @YuraKril on GitHub (Oct 6, 2022). Original GitHub issue: https://github.com/dbeaver/cloudbeaver/issues/1201 **Describe the bug** Performance degradation The computer lags. Table view not work ![image](https://user-images.githubusercontent.com/4184026/194374951-23b4ccfa-eeb3-490a-934c-b82490029f22.png) **To Reproduce** Steps to reproduce the behavior: 1. Create a new SQLite database file with at least one JSON field. 2. Insert some rows of data. 3. Try to open the database file **Desktop (please complete the following information):** - OS: Ubuntu 22.04 - Chrome - Version 106.0.5249.91 (Official Build) (64-bit)
kerem 2026-03-07 20:47:01 +03:00
Author
Owner

@kseniaguzeeva commented on GitHub (Oct 12, 2022):

Could you please add more details about your issue? Do I understand right, you have an SQLite table with a big JSON value in a column? Could you please provide me with a table DDL and JSON value examples?

It will help me to find a reason and give better assitance to you.

<!-- gh-comment-id:1276060363 --> @kseniaguzeeva commented on GitHub (Oct 12, 2022): Could you please add more details about your issue? Do I understand right, you have an SQLite table with a big JSON value in a column? Could you please provide me with a table DDL and JSON value examples? It will help me to find a reason and give better assitance to you.
Author
Owner

@YuraKril commented on GitHub (Oct 14, 2022):

I created a table with two columns and five rows in it (each one 2MB). I provide an example of the database in the attachment.
example.txt

<!-- gh-comment-id:1278569574 --> @YuraKril commented on GitHub (Oct 14, 2022): I created a table with two columns and five rows in it (each one 2MB). I provide an example of the database in the attachment. [example.txt](https://github.com/dbeaver/cloudbeaver/files/9783268/example.txt)
Author
Owner

@kseniaguzeeva commented on GitHub (Oct 14, 2022):

Thank you for the example. I have bad perfomance when open the Value panel for a JSON value from your example.

<!-- gh-comment-id:1278913405 --> @kseniaguzeeva commented on GitHub (Oct 14, 2022): Thank you for the example. I have bad perfomance when open the Value panel for a JSON value from your example.
Author
Owner

@YuraKril commented on GitHub (Oct 14, 2022):

if the table has more than 1k records, no data is displayed at all.

Also, you don't always need to load 200 rows. This value can be set in the settings or change the default to 50 rows.
image

<!-- gh-comment-id:1278976865 --> @YuraKril commented on GitHub (Oct 14, 2022): if the table has more than 1k records, no data is displayed at all. Also, you don't always need to load 200 rows. This value can be set in the settings or change the default to 50 rows. ![image](https://user-images.githubusercontent.com/4184026/195852648-abefdb7a-a3ef-43ac-b590-2e04e4d9670a.png)
Author
Owner

@kseniaguzeeva commented on GitHub (Nov 7, 2022):

We've improved JSON display in 22.2.4:

  • The size of displayed JSON values is limited and you can change the limit in the configuration file sqlBinaryPreviewMaxLength
  • you can change the limit of cell values in the Data Editor in the configuration file sqlTextPreviewMaxLength (the detailed information is heree https://github.com/dbeaver/cloudbeaver/wiki/Server-configuration)
  • big JSON values can be saved to an external file
<!-- gh-comment-id:1305754470 --> @kseniaguzeeva commented on GitHub (Nov 7, 2022): We've improved JSON display in 22.2.4: - The size of displayed JSON values is limited and you can change the limit in the configuration file `sqlBinaryPreviewMaxLength` - you can change the limit of cell values in the Data Editor in the configuration file `sqlTextPreviewMaxLength` (the detailed information is heree https://github.com/dbeaver/cloudbeaver/wiki/Server-configuration) - big JSON values can be saved to an external file
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/cloudbeaver#264
No description provided.