starred/koel-koel
1
0
Fork 0
mirror of https://github.com/koel/koel.git synced 2026-04-25 08:46:00 +03:00
Code Issues 67 Projects Releases 10 Packages Wiki Activity

[GH-ISSUE #636] Postgres error while syncing: invalid byte sequence for encoding "UTF8" #455

New issue
Closed
opened 2026-02-26 02:33:15 +03:00 by kerem · 2 comments
kerem commented 2026-02-26 02:33:15 +03:00
Owner
Copy link

Originally created by @svalo on GitHub (Aug 18, 2017).
Original GitHub issue: https://github.com/koel/koel/issues/636

Hello, I'm encounering some issues while using postgres with koel, tryied with mariadb and did not have problems.
I'm not sure whether this is an issue with koel itself or not.
OS: archlinux
Postgres version:9.6.3
MariaDB version:10.1.26-MariaDB
Php version: 7.1.8
Koel is configured using php-fpm + nginx

Issue is:
While scanning koel excepts and dies with errors like

 [Illuminate\Database\QueryException (22021)]                                                                                                                           
 SQLSTATE[22021]: Character not in repertoire: 7 ERROR:  invalid byte sequence for encoding "UTF8": 0xff (SQL: select * from "albums" where ("artist_id" = 52 and "nam  
 e" = ��nUnkwo) limit 1)                                                                                                                                                
                                                                                                                                                                        

Exception trace:
() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:647
Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607
Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:326
Illuminate\Database\Connection->select() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1711
Illuminate\Database\Query\Builder->runSelect() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1696
Illuminate\Database\Query\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:462
Illuminate\Database\Eloquent\Builder->getModels() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:446
Illuminate\Database\Eloquent\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Concerns/BuildsQueries.php:71
Illuminate\Database\Eloquent\Builder->first() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:354
Illuminate\Database\Eloquent\Builder->firstOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329
Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341
Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/Album.php:65
App\Models\Album::get() at /srv/http/koel/app/Models/File.php:248
App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84
App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221
Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74
App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54
App\Console\Commands\SyncMedia->handle() at n/a:n/a
call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29
Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87
Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31
Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531
Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182
Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265
Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167
Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826
Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189
Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120
Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123
Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35

                                                                                                          
 [PDOException (22021)]                                                                                   
 SQLSTATE[22021]: Character not in repertoire: 7 ERROR:  invalid byte sequence for encoding "UTF8": 0xff  
                                                                                                          

Exception trace:
() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:323
PDOStatement->execute() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:323
Illuminate\Database\Connection->Illuminate\Database\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:640
Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607
Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:326
Illuminate\Database\Connection->select() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1711
Illuminate\Database\Query\Builder->runSelect() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1696
Illuminate\Database\Query\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:462
Illuminate\Database\Eloquent\Builder->getModels() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:446
Illuminate\Database\Eloquent\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Concerns/BuildsQueries.php:71
Illuminate\Database\Eloquent\Builder->first() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:354
Illuminate\Database\Eloquent\Builder->firstOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329
Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341
Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/Album.php:65
App\Models\Album::get() at /srv/http/koel/app/Models/File.php:248
App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84
App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221
Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74
App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54
App\Console\Commands\SyncMedia->handle() at n/a:n/a
call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29
Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87
Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31
Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531
Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182
Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265
Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167
Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826
Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189
Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120
Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123
Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35

and

[Illuminate\Database\QueryException (22021)]                                                                                                                           
  SQLSTATE[22021]: Character not in repertoire: 7 ERROR:  invalid byte sequence for encoding "UTF8": 0xfe (SQL: insert into "songs" ("id", "title", "length", "track",   
  "lyrics", "path", "mtime", "album_id", "contributing_artist_id", "updated_at", "created_at") values (ce24f5dd9c07c0868917cde2efa3da44, Any Colour You Like, 205.68812  
  5, 7, ��, <redacted>/Pink Floyd/Dark Side Of The Moon/07 Any Colour You Like.mp3, 1250523022, 318, 157, 2017-08-18 08:26:55, 2017-08-18 08:26:55))              
                                                                                                                                                                         

Exception trace:
 () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:647
 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607
 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:450
 Illuminate\Database\Connection->statement() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:404
 Illuminate\Database\Connection->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:2116
 Illuminate\Database\Query\Builder->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:1242
 Illuminate\Database\Eloquent\Builder->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:650
 Illuminate\Database\Eloquent\Model->performInsert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:508
 Illuminate\Database\Eloquent\Model->save() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:377
 Illuminate\Database\Eloquent\Builder->Illuminate\Database\Eloquent\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/helpers.php:878
 tap() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:378
 Illuminate\Database\Eloquent\Builder->updateOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329
 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341
 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/File.php:277
 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84
 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221
 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74
 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54
 App\Console\Commands\SyncMedia->handle() at n/a:n/a
 call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29
 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87
 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31
 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531
 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182
 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265
 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167
 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826
 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189
 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120
 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123
 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35

                                                                                                           
  [PDOException (22021)]                                                                                   
  SQLSTATE[22021]: Character not in repertoire: 7 ERROR:  invalid byte sequence for encoding "UTF8": 0xfe  
                                                                                                           

Exception trace:
 () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:449
 PDOStatement->execute() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:449
 Illuminate\Database\Connection->Illuminate\Database\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:640
 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607
 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:450
 Illuminate\Database\Connection->statement() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:404
 Illuminate\Database\Connection->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:2116
 Illuminate\Database\Query\Builder->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:1242
 Illuminate\Database\Eloquent\Builder->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:650
 Illuminate\Database\Eloquent\Model->performInsert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:508
 Illuminate\Database\Eloquent\Model->save() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:377
 Illuminate\Database\Eloquent\Builder->Illuminate\Database\Eloquent\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/helpers.php:878
 tap() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:378
 Illuminate\Database\Eloquent\Builder->updateOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329
 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341
 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/File.php:277
 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84
 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221
 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74
 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54
 App\Console\Commands\SyncMedia->handle() at n/a:n/a
 call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29
 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87
 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31
 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531
 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182
 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265
 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167
 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826
 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189
 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120
 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123
 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35

Checking the entry which caused the first error in MySQL db results in:

MariaDB [koel]> select * from albums where id=141;
+-----+-----------+----------+-------+----------------+---------------------+---------------------+
| id  | artist_id | name     | cover | is_compilation | created_at          | updated_at          |
+-----+-----------+----------+-------+----------------+---------------------+---------------------+
| 141 |        52 | ??nUnkwo |       |           NULL | 2017-08-18 08:02:06 | 2017-08-18 08:02:06 |
+-----+-----------+----------+-------+----------------+---------------------+---------------------+
1 row in set (0.00 sec)

and similarly for the second error

MariaDB [koel]> select * from songs where id = 'ce24f5dd9c07c0868917cde2efa3da44'\G;
*************************** 1. row ***************************
                    id: ce24f5dd9c07c0868917cde2efa3da44
              album_id: 314
contributing_artist_id: 157
                 title: Any Colour You Like
                length: 205.69
                 track: 7
                lyrics: ??
                  path: <redacted>/Pink Floyd/Dark Side Of The Moon/07 Any Colour You Like.mp3
                 mtime: 1250523022
            created_at: 2017-08-18 08:03:16
            updated_at: 2017-08-18 08:03:16
1 row in set (0.00 sec)

ERROR: No query specified

The characters are somehow accepted.

If it's not possible to sanitize in some way the characters it would be nice not to exit due to the exception as this results in failing to scan the rest of the library.
Thanks for the nice work!

Originally created by @svalo on GitHub (Aug 18, 2017). Original GitHub issue: https://github.com/koel/koel/issues/636 Hello, I'm encounering some issues while using postgres with koel, tryied with mariadb and did not have problems. I'm not sure whether this is an issue with koel itself or not. OS: archlinux Postgres version:9.6.3 MariaDB version:10.1.26-MariaDB Php version: 7.1.8 Koel is configured using php-fpm + nginx Issue is: While scanning koel excepts and dies with errors like ``` [Illuminate\Database\QueryException (22021)] SQLSTATE[22021]: Character not in repertoire: 7 ERROR: invalid byte sequence for encoding "UTF8": 0xff (SQL: select * from "albums" where ("artist_id" = 52 and "nam e" = ��nUnkwo) limit 1) Exception trace: () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:647 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:326 Illuminate\Database\Connection->select() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1711 Illuminate\Database\Query\Builder->runSelect() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1696 Illuminate\Database\Query\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:462 Illuminate\Database\Eloquent\Builder->getModels() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:446 Illuminate\Database\Eloquent\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Concerns/BuildsQueries.php:71 Illuminate\Database\Eloquent\Builder->first() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:354 Illuminate\Database\Eloquent\Builder->firstOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/Album.php:65 App\Models\Album::get() at /srv/http/koel/app/Models/File.php:248 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54 App\Console\Commands\SyncMedia->handle() at n/a:n/a call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35 [PDOException (22021)] SQLSTATE[22021]: Character not in repertoire: 7 ERROR: invalid byte sequence for encoding "UTF8": 0xff Exception trace: () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:323 PDOStatement->execute() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:323 Illuminate\Database\Connection->Illuminate\Database\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:640 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:326 Illuminate\Database\Connection->select() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1711 Illuminate\Database\Query\Builder->runSelect() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:1696 Illuminate\Database\Query\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:462 Illuminate\Database\Eloquent\Builder->getModels() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:446 Illuminate\Database\Eloquent\Builder->get() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Concerns/BuildsQueries.php:71 Illuminate\Database\Eloquent\Builder->first() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:354 Illuminate\Database\Eloquent\Builder->firstOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/Album.php:65 App\Models\Album::get() at /srv/http/koel/app/Models/File.php:248 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54 App\Console\Commands\SyncMedia->handle() at n/a:n/a call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35 ``` and ``` [Illuminate\Database\QueryException (22021)] SQLSTATE[22021]: Character not in repertoire: 7 ERROR: invalid byte sequence for encoding "UTF8": 0xfe (SQL: insert into "songs" ("id", "title", "length", "track", "lyrics", "path", "mtime", "album_id", "contributing_artist_id", "updated_at", "created_at") values (ce24f5dd9c07c0868917cde2efa3da44, Any Colour You Like, 205.68812 5, 7, ��, <redacted>/Pink Floyd/Dark Side Of The Moon/07 Any Colour You Like.mp3, 1250523022, 318, 157, 2017-08-18 08:26:55, 2017-08-18 08:26:55)) Exception trace: () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:647 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:450 Illuminate\Database\Connection->statement() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:404 Illuminate\Database\Connection->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:2116 Illuminate\Database\Query\Builder->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:1242 Illuminate\Database\Eloquent\Builder->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:650 Illuminate\Database\Eloquent\Model->performInsert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:508 Illuminate\Database\Eloquent\Model->save() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:377 Illuminate\Database\Eloquent\Builder->Illuminate\Database\Eloquent\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/helpers.php:878 tap() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:378 Illuminate\Database\Eloquent\Builder->updateOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/File.php:277 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54 App\Console\Commands\SyncMedia->handle() at n/a:n/a call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35 [PDOException (22021)] SQLSTATE[22021]: Character not in repertoire: 7 ERROR: invalid byte sequence for encoding "UTF8": 0xfe Exception trace: () at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:449 PDOStatement->execute() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:449 Illuminate\Database\Connection->Illuminate\Database\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:640 Illuminate\Database\Connection->runQueryCallback() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:607 Illuminate\Database\Connection->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:450 Illuminate\Database\Connection->statement() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Connection.php:404 Illuminate\Database\Connection->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Query/Builder.php:2116 Illuminate\Database\Query\Builder->insert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:1242 Illuminate\Database\Eloquent\Builder->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:650 Illuminate\Database\Eloquent\Model->performInsert() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:508 Illuminate\Database\Eloquent\Model->save() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:377 Illuminate\Database\Eloquent\Builder->Illuminate\Database\Eloquent\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/helpers.php:878 tap() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Builder.php:378 Illuminate\Database\Eloquent\Builder->updateOrCreate() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1329 Illuminate\Database\Eloquent\Model->__call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php:1341 Illuminate\Database\Eloquent\Model::__callStatic() at /srv/http/koel/app/Models/File.php:277 App\Models\File->sync() at /srv/http/koel/app/Services/Media.php:84 App\Services\Media->sync() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:221 Illuminate\Support\Facades\Facade::__callStatic() at /srv/http/koel/app/Console/Commands/SyncMedia.php:74 App\Console\Commands\SyncMedia->syncAll() at /srv/http/koel/app/Console/Commands/SyncMedia.php:54 App\Console\Commands\SyncMedia->handle() at n/a:n/a call_user_func_array() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:29 Illuminate\Container\BoundMethod::Illuminate\Container\{closure}() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:87 Illuminate\Container\BoundMethod::callBoundMethod() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/BoundMethod.php:31 Illuminate\Container\BoundMethod::call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Container/Container.php:531 Illuminate\Container\Container->call() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:182 Illuminate\Console\Command->execute() at /srv/http/koel/vendor/symfony/console/Command/Command.php:265 Symfony\Component\Console\Command\Command->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Console/Command.php:167 Illuminate\Console\Command->run() at /srv/http/koel/vendor/symfony/console/Application.php:826 Symfony\Component\Console\Application->doRunCommand() at /srv/http/koel/vendor/symfony/console/Application.php:189 Symfony\Component\Console\Application->doRun() at /srv/http/koel/vendor/symfony/console/Application.php:120 Symfony\Component\Console\Application->run() at /srv/http/koel/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php:123 Illuminate\Foundation\Console\Kernel->handle() at /srv/http/koel/artisan:35 ``` Checking the entry which caused the first error in MySQL db results in: ``` MariaDB [koel]> select * from albums where id=141; +-----+-----------+----------+-------+----------------+---------------------+---------------------+ | id | artist_id | name | cover | is_compilation | created_at | updated_at | +-----+-----------+----------+-------+----------------+---------------------+---------------------+ | 141 | 52 | ??nUnkwo | | NULL | 2017-08-18 08:02:06 | 2017-08-18 08:02:06 | +-----+-----------+----------+-------+----------------+---------------------+---------------------+ 1 row in set (0.00 sec) ``` and similarly for the second error ``` MariaDB [koel]> select * from songs where id = 'ce24f5dd9c07c0868917cde2efa3da44'\G; *************************** 1. row *************************** id: ce24f5dd9c07c0868917cde2efa3da44 album_id: 314 contributing_artist_id: 157 title: Any Colour You Like length: 205.69 track: 7 lyrics: ?? path: <redacted>/Pink Floyd/Dark Side Of The Moon/07 Any Colour You Like.mp3 mtime: 1250523022 created_at: 2017-08-18 08:03:16 updated_at: 2017-08-18 08:03:16 1 row in set (0.00 sec) ERROR: No query specified ``` The characters are somehow accepted. If it's not possible to sanitize in some way the characters it would be nice not to exit due to the exception as this results in failing to scan the rest of the library. Thanks for the nice work!
kerem commented 2026-02-26 02:33:16 +03:00
Author
Owner
Copy link

@djelic commented on GitHub (Sep 7, 2017):

Tripped on this one too, solved by wrapping fetching $lyrics in utf8_encode here app/Models/File.php.
Not sure if it is the best solution but I agree that sync should not fail because of single track.

<!-- gh-comment-id:327788873 --> @djelic commented on GitHub (Sep 7, 2017): Tripped on this one too, solved by wrapping fetching `$lyrics` in `utf8_encode` here [app/Models/File.php](https://github.com/phanan/koel/blob/v3.6.2/app/Models/File.php#L170). Not sure if it is the best solution but I agree that sync should not fail because of single track.
kerem commented 2026-02-26 02:33:16 +03:00
Author
Owner
Copy link

@phanan commented on GitHub (Dec 29, 2023):

Each scan is wrapped in a try//catch now.

<!-- gh-comment-id:1872222506 --> @phanan commented on GitHub (Dec 29, 2023): Each scan is wrapped in a try//catch now.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
dependabot/composer/phpunit/phpunit-12.5.22
dependabot/npm_and_yarn/dompurify-3.4.0
dependabot/npm_and_yarn/vite-plus-0.1.17
dependabot/composer/phpseclib/phpseclib-3.0.51
release
1889-duplicate-upload-detection
test/home-screen-empty-to-content
fix/exclude-songless-albums-from-recently-added
refactor/laravel-prompts
fix/wma-cover-art-exception
fix/remove-redundant-seed-step
chore/upgrade-laravel-13
chore/upgrade-vue-3.5.29
test/phase-7-components
dbg-2142
demo-fix
debug-mysql
trusthosts
seek
fix-equalizer
sentry
invite-user
remove-v6-obsolete
fix/song-list
feat/paths-filter
fix/home
fix/footer
feat/progressive
php81
dev/public-playlists
cy
feat/l7
dependabot/composer/pusher/pusher-php-server-4.1.4
dependabot/composer/laravel/framework-5.8.38
dependabot/composer/jackiedo/dotenv-editor-1.1.1
renovate/pin-dependencies
actions
api-doc
feat/recently-played
fix-tests
fix-cover-page
upload
stylejs-196
compilation
vuex
android-notif
nojquery
demo
vue2
2.0
1.1
v9.1.1
latest
v9.1.0
v9.0.0
v8.3.1
v8.3.0
v8.2.0
v8.1.0
v8.0.0
v7.15.1
v7.15.0
v7.14.0
v7.13.0
v7.12.0
v7.11.0
v7.10.4
v7.10.3
v7.10.2
v7.10.1
v7.10.0
v7.9.0
v7.8.1
v7.8.0
v7.7.1
v7.7.0
v7.6.3
v7.6.2
v7.6.1
v7.6.0
v7.5.2
v7.5.1
v7.5.0
v7.4.2
v7.4.1
v7.4.0
v7.3.1
v7.3.0
v7.2.2
v7.2.1
v7.2.0
v7.1.0
v7.0.12
v7.0.11
v7.0.10
v7.0.9
v7.0.8
v7.0.7
v7.0.6
v7.0.5
v7.0.4
v7.0.3
v7.0.2
v7.0.1
v7.0.0
v6.12.1
v6.12.0
v6.11.5
v6.11.4
v6.11.3
v6.11.2
v6.11.1
v6.11.0
v6.10.0
v6.9.0
v6.8.5
v6.8.4
v6.8.3
v6.8.2
v6.8.1
v6.8.0
v6.7.5
v6.7.4
v6.7.3
v6.7.2
v6.7.1
v6.7.0
v6.6.0
v6.5.3
v6.5.2
v6.5.1
v6.5.0
v6.4.3
v6.4.2
v6.4.1
v6.4.0
v6.3.0
v6.2.2
v6.2.1
v6.2.0
v6.1.0
v6.0.6
v6.0.5
v6.0.4
v6.0.3
v6.0.2
v6.0.1
v6.0.0
v0.0.0-beta
v5.1.14
v5.1.13
v5.1.12
v5.1.11
v5.1.10
v5.1.9
v5.1.8
v5.1.7
v5.1.6
v5.1.5
v5.1.4
v5.1.3
v5.1.2
v5.1.1
v5.1.0
v5.0.2
v5.0.1
v5.0.0
v4.4.0
v4.3.1
v4.3.0
v4.2.2
v4.2.1
v4.2.0
v4.1.1
v4.1.0
v4.0.0
v3.7.2
v3.7.1
v3.7.0
v3.6.2
v3.6.1
v3.6.0
v3.5.5
v3.5.4
v3.5.3
v3.5.2
v3.5.1
v3.5.0
v3.4.1
v3.4.0
v3.3.1
v3.3.0
v3.2.0
v3.1.1
v3.1.0
v3.0.1
v3.0.0
v2.2.1
v2.2.0
v2.1.0
v2.0.2
v2.0.1
v2.0.0
v1.1.2
v1.1.1
1.0.0-beta
Labels
Clear labels   
Authentication

   
Dependencies

   
Documentation

   
Feature Request

   
Flac

   
Help Wanted

   
Installation/Setup

   
Integration

   
Mobile

   
PR Welcome

   
Pending Release

   
Performance

   
Playlist

   
S3

   
Search

   
Sync

   
[Pri] Low

   
[Pri] Normal

   
[Status] Keep Open

   
[Status] Needs Author Reply

   
[Status] Needs Review

   
[Status] Stale

   
[Status] Will Implement

   
[Type] Blessed

   
[Type] Bug

   
[Type] Duplicate

   
[Type] Enhancement

   
[Type] Help Request

   
[Type] Question

   
[Type] Task

   
pull-request

Mirrored from GitHub Pull Request

No labels
Authentication
Dependencies
Documentation
Feature Request
Flac
Help Wanted
Installation/Setup
Integration
Mobile
PR Welcome
Pending Release
Performance
Playlist
S3
Search
Sync
[Pri] Low
[Pri] Normal
[Status] Keep Open
[Status] Needs Author Reply
[Status] Needs Review
[Status] Stale
[Status] Will Implement
[Type] Blessed
[Type] Bug
[Type] Duplicate
[Type] Enhancement
[Type] Help Request
[Type] Question
[Type] Task
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/koel-koel#455
No description provided.