feat: Llama 3.2 3B function calling support by giladgd · Pull Request #386 · withcatai/node-llama-cpp (original) (raw)

Pricing

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Merged

giladgd

merged 28 commits into

Nov 27, 2024

Conversation

Description of change

feat: Llama 3.2 3B function calling support
feat: use llama.cpp backend registry for GPUs instead of custom implementations
feat(getLlama): build: "try" option
feat(init command): --model flag
fix: improve binary compatibility testing on Electron apps
fix: too many abort signal listeners
fix: log level of some lower level logs
fix: context window missing response during generation on specific extreme conditions
fix: adapt to breaking llama.cpp changes
fix: automatically resolve compiler is out of heap space CUDA build error
chore: update bug report template
docs: separate open source and proprietary sections in the awesome list
docs(troubleshooting): Electron build error on Windows
docs(Electron): GitHub Actions template for cross-compilation

Fixes #381

Pull-Request Checklist

Code is up-to-date with the master branch
npm run format to apply eslint formatting
npm run test passes with this change
This pull request links relevant issues as Fixes #0000
There are new or updated unit tests validating the change
Documentation has been updated to reflect this change
The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

giladgd deleted the gilad/electronBugFixes branch

November 27, 2024 23:03

This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters

[ Show hidden characters]({{ revealButtonHref }})