mirror of
https://github.com/jehna/humanify.git
synced 2026-04-27 01:26:00 +03:00
[GH-ISSUE #34] A warning: Using this model may not work as intended #22
Labels
No labels
bug
enhancement
pull-request
wontfix
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/humanify#22
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @AGenchev on GitHub (Aug 13, 2024).
Original GitHub issue: https://github.com/jehna/humanify/issues/34
The new version is much better, I mean it started working easily and with Vulcan offloading.
The local mode returns a warning:
[node-llama-cpp] Using this model ("~/.humanifyjs/models/Phi-3.1-mini-4k-instruct-Q4_K_M.gguf") to tokenize text with special tokens and then detokenize it resulted in a different text. There might be an issue with the model or the tokenizer implementation. Using this model may not work as intendedShould I ignore this warning or this isn't expected and I must investigate what happens ?
@jehna commented on GitHub (Aug 13, 2024):
Yes, this warning is a known issue for now. The model should work fine, at least in my testing. I'll check later if I can find a fix for this.
@jehna commented on GitHub (Aug 13, 2024):
I'll keep this issue open for now so I don't forget to fix it