Ollama v0.30.0-rc23: "directly support llama.cpp" & "compatibility with GGUF"

theanonymousone1 pts0 comments

Release v0.30.0 路 ollama/ollama 路 GitHub

//releases/show" data-turbo-transient="true" />

Skip to content

Search or jump to...

Search code, repositories, users, issues, pull requests...

-->

Search

Clear

Search syntax tips

Provide feedback

--><br>We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Cancel

Submit feedback

Saved searches

Use saved searches to filter your results more quickly

-->

Name

Query

To see all available qualifiers, see our documentation.

Cancel

Create saved search

Sign in

//releases/show;ref_cta:Sign up;ref_loc:header logged out"}"<br>Sign up

Appearance settings

Resetting focus

You signed in with another tab or window. Reload to refresh your session.<br>You signed out in another tab or window. Reload to refresh your session.<br>You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

{{ message }}

ollama

ollama

Public

Notifications<br>You must be signed in to change notification settings

Fork<br>16.3k

Star<br>172k

v0.30.0

Pre-release

Pre-release

Compare

Choose a tag to compare

Sorry, something went wrong.

Filter

Loading

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

No results found

View all tags

github-actions

released this

13 May 14:32

&middot;

2 commits

to main<br>since this release

v0.30.0-rc23

94afd57

This version of Ollama will change the architecture to directly support llama.cpp instead of building on top of GGML, and allows for compatibility with GGUF file format. MLX is used to accelerate model inference on Apple Silicon.

While in pre-release we'd love feedback on:

Performance improvements or degradation

Errors or crashes that did not previously occur

Memory utilization improvements or degradation

Known issues:

laguna-xs.2 is not supported yet on this pre-release

llama3.2-vision is not supported yet on this pre-release

Installing:

Mac/Linux

curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.30.0-rc23 sh

Windows

$env:OLLAMA_VERSION="0.30.0-rc23"; irm https://ollama.com/install.ps1 | iex

Assets<br>19

Loading

Uh oh!

There was an error while loading. Please reload this page.

-->

馃憤<br>85<br>Kad314-777, m20l22, urbanonymous, amddeus, effegi-lab, geyerandreas, 4p3rtur3, donatas-xyz, adamw7, Harvester62, and 75 more reacted with thumbs up emoji<br>馃槃<br>15<br>Chaoses-Ib, amddeus, pwab, zztop007, josephlugo, EnlistedGhost, WilliamKarvat, Zetaphor, Tom-M-Git, neiroset-7373, and 5 more reacted with laugh emoji<br>馃帀<br>30<br>amirh123123, cammo22, TzurSoffer, Kad314-777, tristan-k, ameaninglessname, miguelcaldas0103, ch4bes, josephlugo, amddeus, and 20 more reacted with hooray emoji<br>鉂わ笍<br>25<br>Kad314-777, amddeus, 4p3rtur3, TzurSoffer, ameaninglessname, josephlugo, Project516, MorganMarshall, EnlistedGhost, Isulion, and 15 more reacted with heart emoji<br>馃殌<br>27<br>jeffpaul, amddeus, 4p3rtur3, nico-arianto, patmakesapps, TzurSoffer, Kad314-777, tristan-k, josephlugo, devivomichele, and 17 more reacted with rocket emoji<br>馃憖<br>30<br>albihasani94, Apartman36, GameEnder, Kad314-777, amddeus, amytimed, 4p3rtur3, YannMagnin, thoven87, TzurSoffer, and 20 more reacted with eyes emoji

All reactions

馃憤<br>85 reactions

馃槃<br>15 reactions

馃帀<br>30 reactions

鉂わ笍<br>25 reactions

馃殌<br>27 reactions

馃憖<br>30 reactions

141 people reacted

You can鈥檛 perform that action at this time.

ollama release reacted reactions amddeus emoji

Related Articles